Fixed a bug that the event log can't save the real lastest process date.
Change the date format.Remove the replication part of log4j.
Use a new date format.
Add a log4j properties file.
Add a file to specify the log4j as the logger.
add MapStore/Loader test for the IndexEvents -- adding and removing events in the DB table through hazelcast. https://projects.ecoinformatics.org/ecoinfo/issues/5944
Add the code that only the ids with the correct system metadata modification time will be added to the index queue.
Add code to get and set the last process date.
move IndexEvent into metacat-common. Perparation for Metacat responding to events and writing them to a persistent store. https://projects.ecoinformatics.org/ecoinfo/issues/5944
refactor IndexEventLog a bit to simplify type/action information. prep for serializing IndexEvent objects to Metacat. https://projects.ecoinformatics.org/ecoinfo/issues/5944
remove serial number from indexeventlog - it is not used elsewhere in the api. https://projects.ecoinformatics.org/ecoinfo/issues/5944
correct spelling for index.eventlog.classname property
use an independent ISet<SystemMetadata> structure to communicate objects that should be indexed by metacat-index. https://projects.ecoinformatics.org/ecoinfo/issues/5943
consolidate SystemMetadata map retrieval in preparation for using a different structure for objects to index.
adding ability to remove event from the [error] queue.
Add code to implment set and get the last processed date.
It will make the index only for those objects which were modified after the marked time.
Add set and get the lastprocessedDate in the IndexEventLog.Remove the code to write the successful event.
Log the timed index jobs.
Add the code to log the failed events.
Add a temporary file log for debugging.
Use commons-io 2.4
Add a serial number for the event.Add method to set events to be archived.
Add a new class variable - isArchived for class IndexEvent.
Update the documentation about those classes.
Add a event and eventlog for the index.
Use the identifier set to get the list of ids in the member node.
The returned ISet should be Identifier.
Add code to test getIdentifierSet method.
Add method to get identifier set.
Set up a Timer to run the regenerating solr index task periodically.
Add code to handle delete data package information when delete a pid in the solr index.
Add two static methods to get the SystemMetadata and data object InputStream for the specified id.
Change the code since the ApplicationController's constructor was changed.
Add code to check if the metacat.properties is available.
If solr is not enabled, it would not be running.
Use another thread in the Servlet init method to wait hazelcast.
Put the waiting mechanism for the hazelcast at the first place.
Temporarily remove the code to disable solr engine if it isn't listed in the property file.
If the solr engine is disabled, the metacat index will do nothing.
set the dataone.hazelcast.location.clientconfig property to be the local config file. It will be used in the d1_cn_index_processor
Read the waiting time and maximum attempts from the metacat.properties file.
Add some new properties for the test.
Index the none-resourcemap data objects first, then the resourcemap objects.
Try to get the metacat ids first.
Use SolrQueryServiceController to get the ValidFieldList.
Change the package name of SolrQueryResponseTransformer and SolrQueryWriterFactory.
Add the depency of d1_cn_index_processor here.
move the depency of d1_cn_index_processor to the metacat-common module.
Add the code to add a resource map information.
Add code the transform query response to SolrDoc.
use java 1.6 for maven compiler
Use the new class to handle the resource map.
Modify the subprocessor to use SolrServer rather than solr service url.
Add code to wait the readiness of the hazelcast service.
Use the DistributedMapsFactory to get maps.
Add a class to get distributed maps such as the system metadata map.
Removed the comment on the process of building index.
Add code to wait the startup of the MNode.
Use the log info to replace the print.
Add log information for archiving or inserting indexes.
Consider mutithread issue there.
Catch a new exception base on the change of the calling method.
use the sharing code from the metacat-common.
Move this class to the metacat-common.
Use an update method to replace the insert and update methods in the SolrIndex class.
Add a system metadata for archiving.
Add code to generate index during the servlet initialization.
Add the names of the system metadata and the data object imaps.
Use the Identifier object rather than String as the key to get the system metadata and object path.
Add code to start hazelcast.
Add a junit test for the IndexGenerator class.
Add a new class which will generate index for the ids.
Add code to get all doc ids in the solr server.
Add a remove(List) method in the class and an obsoletes list parameter in the update method.
Add the getSystemMetadata and getObsoletes methods.
Change the default solr endpoint to be the localhost.
Base the configuration to create either EmbeddedSolrServer or HttpSolrServer.
Read the solr configuration file name and collection name from the property file.
Print out the solr query result in the xml format.
naive version of SolrServerFactory - no reflection. It returns an EmbeddedSolrServer implementation based on the solr.homeDir set in Settings class. https://projects.ecoinformatics.org/ecoinfo/issues/5883
simplify testing with embedded solr server locations -- no need to copy solr-home or set system properties. Still more to do (factory method) but this is getting cleaner.
add place-holder for using SolrServerFactory to get the correct SOlrServer impl during application init
clean up configuration initialization
clean up logging for hz config file error
rely on Settings loaded from test resources config rather than hardcoding the paths in code. https://projects.ecoinformatics.org/ecoinfo/issues/5918
include test resource bundles to be loaded into Settings configuration during testing.
move hazelcast config file location code into the MetacatIndexServlet init method
use integration-test ("mvn verify") to test things that require Metacat to be running. These classes should end be named "*IT.java" and unit tests that do not require metacat to be running can be named "*Test.java" - https://projects.ecoinformatics.org/ecoinfo/issues/5918
format before editing.
Comment out the testRemove method temporarily.
Temporarily to comment out the remove test.
Add a test method to test the update method.
Add the update method.
Add documents for updating solr index.
Get the solr home dir from the metacat.properties.
Set the test solr home in the target directory.
Add the necessary files for the solr home.
Set the hazelcast.xml path for the test.
Add a query method in the test.