| Revision:

metacat / metacat-index @ 7811

# Date Author Comment
7811 06/20/2013 12:23 PM ben leinfelder

consolidate SystemMetadata map retrieval in preparation for using a different structure for objects to index.

7810 06/20/2013 09:24 AM ben leinfelder

adding ability to remove event from the [error] queue.

7807 06/17/2013 05:07 PM Jing Tao

Add code to implment set and get the last processed date.

7806 06/17/2013 04:28 PM Jing Tao

It will make the index only for those objects which were modified after the marked time.

7805 06/17/2013 01:50 PM Jing Tao

Add set and get the lastprocessedDate in the IndexEventLog.
Remove the code to write the successful event.

7802 06/12/2013 02:36 PM Jing Tao

Log the timed index jobs.

7801 06/12/2013 02:08 PM Jing Tao

Add the code to log the failed events.

7800 06/11/2013 06:24 PM Jing Tao

Add a temporary file log for debugging.

7799 06/11/2013 06:23 PM Jing Tao

Use commons-io 2.4

7797 06/07/2013 04:38 PM Jing Tao

Add a serial number for the event.
Add method to set events to be archived.

7796 06/07/2013 11:22 AM Jing Tao

Add a new class variable - isArchived for class IndexEvent.

7795 06/06/2013 04:13 PM Jing Tao

Update the documentation about those classes.

7794 06/06/2013 03:17 PM Jing Tao

Add a event and eventlog for the index.

7793 06/05/2013 03:03 PM Jing Tao

Use the identifier set to get the list of ids in the member node.

7792 06/05/2013 02:20 PM Jing Tao

The returned ISet should be Identifier.

7791 06/05/2013 01:50 PM Jing Tao

Add code to test getIdentifierSet method.

7790 06/05/2013 01:50 PM Jing Tao

Add method to get identifier set.

7788 06/04/2013 02:47 PM Jing Tao

Set up a Timer to run the regenerating solr index task periodically.

7786 05/31/2013 03:29 PM Jing Tao

Add code to handle delete data package information when delete a pid in the solr index.

7785 05/31/2013 02:05 PM Jing Tao

Add two static methods to get the SystemMetadata and data object InputStream for the specified id.

7784 05/28/2013 05:19 PM Jing Tao

Change the code since the ApplicationController's constructor was changed.

7783 05/28/2013 05:18 PM Jing Tao

Add code to check if the is available.

7782 05/28/2013 01:21 PM Jing Tao

If solr is not enabled, it would not be running.

7776 05/23/2013 11:57 PM Jing Tao

Use another thread in the Servlet init method to wait hazelcast.

7774 05/23/2013 09:59 PM Jing Tao

Put the waiting mechanism for the hazelcast at the first place.

7771 05/23/2013 06:28 PM Jing Tao

Temporarily remove the code to disable solr engine if it isn't listed in the property file.

7769 05/23/2013 04:27 PM Jing Tao

If the solr engine is disabled, the metacat index will do nothing.

7754 05/22/2013 04:18 PM Jing Tao

set the dataone.hazelcast.location.clientconfig property to be the local config file. It will be used in the d1_cn_index_processor

7748 05/22/2013 11:19 AM Jing Tao

Read the waiting time and maximum attempts from the file.

7744 05/22/2013 10:29 AM Jing Tao

Add some new properties for the test.

7740 05/21/2013 11:33 PM Jing Tao

Index the none-resourcemap data objects first, then the resourcemap objects.

7734 05/21/2013 02:23 PM Jing Tao

Try to get the metacat ids first.

7733 05/21/2013 11:11 AM Jing Tao

Use SolrQueryServiceController to get the ValidFieldList.

7724 05/18/2013 11:32 PM Jing Tao

Change the package name of SolrQueryResponseTransformer and SolrQueryWriterFactory.

7717 05/18/2013 04:49 PM Jing Tao

Add the depency of d1_cn_index_processor here.

7715 05/18/2013 03:57 PM Jing Tao

move the depency of d1_cn_index_processor to the metacat-common module.

7711 05/17/2013 05:01 PM Jing Tao

Add the code to add a resource map information.

7710 05/17/2013 04:07 PM Jing Tao

Add code the transform query response to SolrDoc.

7701 05/16/2013 04:02 PM ben leinfelder

use java 1.6 for maven compiler

7697 05/16/2013 12:04 PM Jing Tao

Use the new class to handle the resource map.

7696 05/15/2013 05:48 PM Jing Tao

Modify the subprocessor to use SolrServer rather than solr service url.

7691 05/13/2013 09:23 PM Jing Tao

Add code to wait the readiness of the hazelcast service.

7690 05/13/2013 04:34 PM Jing Tao

Use the DistributedMapsFactory to get maps.

7689 05/13/2013 03:51 PM Jing Tao

Add a class to get distributed maps such as the system metadata map.

7688 05/13/2013 11:58 AM Jing Tao

Removed the comment on the process of building index.

7687 05/13/2013 11:55 AM Jing Tao

Add code to wait the startup of the MNode.

7684 05/10/2013 02:37 PM Jing Tao

Use the log info to replace the print.

7683 05/10/2013 02:36 PM Jing Tao

Add log information for archiving or inserting indexes.

7682 05/09/2013 12:11 PM Jing Tao

Consider mutithread issue there.

7658 05/02/2013 11:21 AM Jing Tao

Catch a new exception base on the change of the calling method.

7631 04/29/2013 09:14 AM Jing Tao

use the sharing code from the metacat-common.

7630 04/29/2013 09:13 AM Jing Tao

Move this class to the metacat-common.

7627 04/26/2013 05:12 PM Jing Tao

Use an update method to replace the insert and update methods in the SolrIndex class.

7626 04/26/2013 05:10 PM Jing Tao

Add a system metadata for archiving.

7613 04/24/2013 02:23 PM Jing Tao

Add code to generate index during the servlet initialization.

7612 04/24/2013 12:12 PM Jing Tao

Add the names of the system metadata and the data object imaps.

7611 04/24/2013 11:57 AM Jing Tao

Use the Identifier object rather than String as the key to get the system metadata and object path.

7610 04/24/2013 11:30 AM Jing Tao

Add code to start hazelcast.

7607 04/23/2013 04:17 PM Jing Tao

Add a junit test for the IndexGenerator class.

7606 04/23/2013 12:00 PM Jing Tao

Add a new class which will generate index for the ids.

7604 04/22/2013 06:08 PM Jing Tao

Add code to get all doc ids in the solr server.

7603 04/22/2013 02:46 PM Jing Tao

Add a remove(List) method in the class and an obsoletes list parameter in the update method.

7602 04/22/2013 02:23 PM Jing Tao

Add the getSystemMetadata and getObsoletes methods.

7596 04/19/2013 05:51 PM Jing Tao

Change the default solr endpoint to be the localhost.

7595 04/19/2013 05:47 PM Jing Tao

Base the configuration to create either EmbeddedSolrServer or HttpSolrServer.

7593 04/19/2013 05:19 PM Jing Tao

Read the solr configuration file name and collection name from the property file.

7592 04/19/2013 04:37 PM Jing Tao

Print out the solr query result in the xml format.

7591 04/19/2013 01:03 PM ben leinfelder

naive version of SolrServerFactory - no reflection. It returns an EmbeddedSolrServer implementation based on the solr.homeDir set in Settings class.

7590 04/19/2013 12:43 PM ben leinfelder

simplify testing with embedded solr server locations -- no need to copy solr-home or set system properties. Still more to do (factory method) but this is getting cleaner.

7589 04/19/2013 11:38 AM ben leinfelder

add place-holder for using SolrServerFactory to get the correct SOlrServer impl during application init

7588 04/19/2013 11:24 AM ben leinfelder

clean up configuration initialization

7587 04/19/2013 11:15 AM ben leinfelder

clean up logging for hz config file error

7586 04/19/2013 10:25 AM ben leinfelder

rely on Settings loaded from test resources config rather than hardcoding the paths in code.

7585 04/19/2013 09:48 AM ben leinfelder

include test resource bundles to be loaded into Settings configuration during testing.

7584 04/19/2013 09:48 AM ben leinfelder

move hazelcast config file location code into the MetacatIndexServlet init method

7582 04/19/2013 09:01 AM ben leinfelder

use integration-test ("mvn verify") to test things that require Metacat to be running. These classes should end be named "*" and unit tests that do not require metacat to be running can be named "*" -

7581 04/18/2013 05:35 PM ben leinfelder

format before editing.

7580 04/18/2013 01:14 PM Jing Tao

Comment out the testRemove method temporarily.

7579 04/18/2013 01:10 PM Jing Tao

Temporarily to comment out the remove test.

7578 04/18/2013 11:28 AM Jing Tao

Add a test method to test the update method.

7577 04/18/2013 11:27 AM Jing Tao

Add the update method.

7576 04/18/2013 11:26 AM Jing Tao

Add documents for updating solr index.

7574 04/17/2013 05:00 PM Jing Tao

Get the solr home dir from the

7573 04/17/2013 04:01 PM Jing Tao

Set the test solr home in the target directory.

7572 04/17/2013 03:53 PM Jing Tao

Add the necessary files for the solr home.

7571 04/17/2013 01:36 PM Jing Tao

Set the hazelcast.xml path for the test.

7569 04/16/2013 05:14 PM Jing Tao

Add a query method in the test.

7566 04/16/2013 04:08 PM ben leinfelder

correctly look up the context init parameter for the metacat properties file

7565 04/16/2013 03:44 PM Jing Tao

Move this file to the solr home and rename it to the schema.xml.

7564 04/16/2013 03:42 PM Jing Tao

Add the solr home directory.

7562 04/16/2013 03:34 PM ben leinfelder

lookup the hz client connection information from the hazelcast.xml file being used by metacat.

7560 04/16/2013 11:28 AM ben leinfelder

start the SystemMetadataListener for each solr index configured (expecting only one).

7559 04/16/2013 11:22 AM Jing Tao

Remove this obsoleted file.

7558 04/16/2013 11:19 AM ben leinfelder

draft for sharing the with the metacat-index webapp.

7557 04/16/2013 10:18 AM ben leinfelder

add methods to set the SolrIndex instance and initialize the listener (includes overloaded constructor)

7556 04/16/2013 10:13 AM ben leinfelder

use SystemMetadata parameter for inserting into SolrIndex

7555 04/16/2013 10:04 AM Jing Tao

Change one parameter type of the insert method from the InputStream to the SystemMetadata.

7554 04/15/2013 05:51 PM Jing Tao

Add a file prefix to tell it is absolute path.

7553 04/15/2013 05:50 PM Jing Tao

Excludes the slf4j-log4j12.jar for removing duplicated class.

7552 04/15/2013 05:04 PM Jing Tao

The module will create a servlet class in a war file.