Project

General

Profile

Activity

From 06/09/2013 to 07/08/2013

07/08/2013

06:19 PM Revision 7862 (metacat): comment out the index queue call when archive() is called - I think it is causing the duplicate events for the listener. https://projects.ecoinformatics.org/ecoinfo/issues/6030
ben leinfelder
06:10 PM Revision 7861 (metacat): implement the view service (uses existing skin-based dbtransform) - and include the REST endpoint. https://projects.ecoinformatics.org/ecoinfo/issues/6028
ben leinfelder
05:51 PM Revision 7860 (metacat): use StreamSource instead of StringReader for method signature -- can be used with different sources this way. https://projects.ecoinformatics.org/ecoinfo/issues/6019
ben leinfelder
05:10 PM Revision 7859 (metacat): clean up DBTransform in preparation for "view" service. https://projects.ecoinformatics.org/ecoinfo/issues/6019
ben leinfelder
03:09 PM Revision 7858 (metacat): In determining the time arrange, the equality was removed.
Jing Tao
03:05 PM Revision 7857 (metacat): Add code to handle failed ids.
Jing Tao
02:00 PM Revision 7856 (metacat): Remove the EventLog write.
Jing Tao
12:14 PM Revision 7855 (metacat): include GET /package/{pid} endpoint in MN service. https://projects.ecoinformatics.org/ecoinfo/issues/6027
ben leinfelder
12:09 PM Revision 7854 (metacat): Add the EventLog code.
Jing Tao

07/05/2013

06:33 PM Revision 7853 (metacat): MN.getPackage() - test with ORE that includes 2 data files and a "metadata" file (still should be using EML for that test). https://projects.ecoinformatics.org/ecoinfo/issues/6026
ben leinfelder
05:14 PM Revision 7852 (metacat): It will throw an exception if the subprocessor can't handle the document.
Jing Tao
04:59 PM Revision 7851 (metacat): Check if the all components of a resource map have been processed before processing the resource map.
Jing Tao

07/04/2013

12:33 PM Revision 7850 (metacat): First pass at MN.getPackage() implementation using Bagit library from LOC. https://projects.ecoinformatics.org/ecoinfo/issues/6026
ben leinfelder

07/03/2013

09:58 PM Revision 7849 (metacat): add method for publishing existing object (usually assumed to be scimeta) with a DOI. https://projects.ecoinformatics.org/ecoinfo/issues/6014
ben leinfelder
04:34 PM Revision 7848 (metacat): Fixed a bug that the event log can't save the real lastest process date.
Jing Tao
03:56 PM Revision 7847 (metacat): Change the date format.
Remove the replication part of log4j. Jing Tao
10:28 AM Revision 7846 (metacat): Use a new date format.
Jing Tao
10:25 AM Revision 7845 (metacat): Add a log4j properties file.
Jing Tao
10:24 AM Revision 7844 (metacat): Add a file to specify the log4j as the logger.
Jing Tao
10:13 AM Revision 7843 (metacat): add Metacat servlet action to force the reindexing of one or more or all pids in the system. https://projects.ecoinformatics.org/ecoinfo/issues/5945
ben leinfelder
12:28 AM Revision 7842 (metacat): only use MapStore/MapLoader for saving/loading IndexEvent objects. No need to use a listener since there is only the single node -- all entries are persisted to DB using the hazelcast.xml config we have for the map. https://projects.ecoinformatics.org/ecoinfo/issues/5944
ben leinfelder
12:03 AM Revision 7841 (metacat): add MapStore/Loader test for the IndexEvents -- adding and removing events in the DB table through hazelcast. https://projects.ecoinformatics.org/ecoinfo/issues/5944
ben leinfelder

07/02/2013

04:47 PM Revision 7840 (metacat): support a "force replication delete all action" during replication. This is used when we want Metacat to remove the content from the other target replicas because the DataONE delete() action was called (more powerful than just "archive").
ben leinfelder
04:41 PM Revision 7839 (metacat): add simple test for the IndexEventDAO class -- adding, removing, listing events in the DB table. https://projects.ecoinformatics.org/ecoinfo/issues/5944
ben leinfelder
03:21 PM Revision 7838 (metacat): Add the code that only the ids with the correct system metadata modification time will be added to the index queue.
Jing Tao

07/01/2013

03:09 PM Revision 7837 (metacat): Use the hazelcast event log.
Jing Tao
01:59 PM Revision 7836 (metacat): Add code to get and set the last process date.
Jing Tao

06/26/2013

04:43 PM Revision 7834 (metacat): merging upgrade scripts from 2.0 branch to trunk. https://redmine.dataone.org/issues/3847
ben leinfelder
04:42 PM Revision 7833 (metacat): scripts for 2.1.0 upgrade
ben leinfelder

06/25/2013

04:42 PM Revision 7830 (metacat): upgrade to Metacat 2.1.0 on the trunk. This includes a new index_event table for storing indexing events that need to be reprocessed. https://projects.ecoinformatics.org/ecoinfo/issues/5944
ben leinfelder
01:23 PM Revision 7829 (metacat): stub for storing IndexEvent objects in Metacat (from metacat-index processing). https://projects.ecoinformatics.org/ecoinfo/issues/5944
ben leinfelder
01:23 PM Revision 7828 (metacat): move IndexEvent into metacat-common. Perparation for Metacat responding to events and writing them to a persistent store. https://projects.ecoinformatics.org/ecoinfo/issues/5944
ben leinfelder
01:17 PM Revision 7827 (metacat): do not force a get() during refresh (causing EML-defined data access rules to be lost when inserting EML docs about data files). note that this reverses a change that was meant to trigger indexing, but now we are using a new queue to share index events with metacat-index and so should not be necessary.
ben leinfelder

06/24/2013

12:05 PM Revision 7824 (metacat): do not use tmp file to return an inputstream on read() operations - just read from the file we already have. https://projects.ecoinformatics.org/ecoinfo/issues/6009
ben leinfelder

06/21/2013

09:44 PM Revision 7823 (metacat): use standard File.createTempFile() method for uploaded data files and delete them when we are done with them. https://projects.ecoinformatics.org/ecoinfo/issues/6008
ben leinfelder
04:15 PM Revision 7822 (metacat): correctly delete data file when we are done with it. https://projects.ecoinformatics.org/ecoinfo/issues/6007
ben leinfelder
04:06 PM Revision 7821 (metacat): include filename in the filepart part. https://projects.ecoinformatics.org/ecoinfo/issues/6007
ben leinfelder
03:18 PM Revision 7820 (metacat): send the original filename in the upload() method since that is supported by the Metacat API. https://projects.ecoinformatics.org/ecoinfo/issues/6007
ben leinfelder
03:10 PM Revision 7819 (metacat): remove the unique string when generating data file metadata. https://projects.ecoinformatics.org/ecoinfo/issues/6007
ben leinfelder
02:48 PM Revision 7818 (metacat): debugging. https://projects.ecoinformatics.org/ecoinfo/issues/6007
ben leinfelder
01:44 PM Revision 7817 (metacat): use File::Temp to write data files in registry. https://projects.ecoinformatics.org/ecoinfo/issues/6007
ben leinfelder
11:11 AM Revision 7816 (metacat): correct regex for whitespace in D1 identifier.
ben leinfelder
09:09 AM Revision 7815 (metacat): refactor IndexEventLog a bit to simplify type/action information. prep for serializing IndexEvent objects to Metacat. https://projects.ecoinformatics.org/ecoinfo/issues/5944
ben leinfelder

06/20/2013

05:28 PM Revision 7814 (metacat): remove serial number from indexeventlog - it is not used elsewhere in the api. https://projects.ecoinformatics.org/ecoinfo/issues/5944
ben leinfelder
05:21 PM Revision 7813 (metacat): correct spelling for index.eventlog.classname property
ben leinfelder
04:49 PM Revision 7812 (metacat): use an independent ISet<SystemMetadata> structure to communicate objects that should be indexed by metacat-index. https://projects.ecoinformatics.org/ecoinfo/issues/5943
ben leinfelder
12:23 PM Revision 7811 (metacat): consolidate SystemMetadata map retrieval in preparation for using a different structure for objects to index.
ben leinfelder
09:24 AM Revision 7810 (metacat): adding ability to remove event from the [error] queue.
ben leinfelder

06/18/2013

02:59 PM Revision 7809 (metacat): do not create solr-home if there is no template to compy into that directory (need to be able to create it later if/when someone decides to use and deploy metacat-index). https://projects.ecoinformatics.org/ecoinfo/issues/6006
ben leinfelder
01:54 PM Revision 7808 (metacat): do not attempt to copy solr-home template from metacat-index webapp if it does not exist. This would be in cases where metacat-index is not deployed. https://projects.ecoinformatics.org/ecoinfo/issues/6006
ben leinfelder

06/17/2013

05:07 PM Revision 7807 (metacat): Add code to implment set and get the last processed date.
Jing Tao
04:28 PM Revision 7806 (metacat): It will make the index only for those objects which were modified after the marked time.
Jing Tao
01:50 PM Revision 7805 (metacat): Add set and get the lastprocessedDate in the IndexEventLog.
Remove the code to write the successful event. Jing Tao

06/13/2013

05:20 PM Revision 7804 (metacat): Add the dataone repository.
Jing Tao
04:41 PM Revision 7803 (metacat): The "war" target will build the metacat-index.war as well.
Jing Tao

06/12/2013

02:36 PM Revision 7802 (metacat): Log the timed index jobs.
Jing Tao
02:08 PM Revision 7801 (metacat): Add the code to log the failed events.
Jing Tao

06/11/2013

06:24 PM Revision 7800 (metacat): Add a temporary file log for debugging.
Jing Tao
06:23 PM Revision 7799 (metacat): Use commons-io 2.4
Jing Tao
03:47 PM Revision 7798 (metacat): Add a new property for the index event log class name.
Jing Tao
 

Also available in: Atom