Project

General

Profile

Statistics
| Revision:

metacat @ 7862

  • svn:ignore: build
  • svn:mergeinfo: /branches/D1_0_6_2_BRANCH:6107-6121
# Date Author Comment
7862 07/08/2013 06:19 PM ben leinfelder

comment out the index queue call when archive() is called - I think it is causing the duplicate events for the listener. https://projects.ecoinformatics.org/ecoinfo/issues/6030

7861 07/08/2013 06:10 PM ben leinfelder

implement the view service (uses existing skin-based dbtransform) - and include the REST endpoint. https://projects.ecoinformatics.org/ecoinfo/issues/6028

7860 07/08/2013 05:51 PM ben leinfelder

use StreamSource instead of StringReader for method signature -- can be used with different sources this way. https://projects.ecoinformatics.org/ecoinfo/issues/6019

7859 07/08/2013 05:10 PM ben leinfelder

clean up DBTransform in preparation for "view" service. https://projects.ecoinformatics.org/ecoinfo/issues/6019

7858 07/08/2013 03:09 PM Jing Tao

In determining the time arrange, the equality was removed.

7857 07/08/2013 03:05 PM Jing Tao

Add code to handle failed ids.

7856 07/08/2013 02:00 PM Jing Tao

Remove the EventLog write.

7855 07/08/2013 12:14 PM ben leinfelder

include GET /package/{pid} endpoint in MN service. https://projects.ecoinformatics.org/ecoinfo/issues/6027

7854 07/08/2013 12:09 PM Jing Tao

Add the EventLog code.

7853 07/05/2013 06:33 PM ben leinfelder

MN.getPackage() - test with ORE that includes 2 data files and a "metadata" file (still should be using EML for that test). https://projects.ecoinformatics.org/ecoinfo/issues/6026

7852 07/05/2013 05:14 PM Jing Tao

It will throw an exception if the subprocessor can't handle the document.

7851 07/05/2013 04:59 PM Jing Tao

Check if the all components of a resource map have been processed before processing the resource map.

7850 07/04/2013 12:33 PM ben leinfelder

First pass at MN.getPackage() implementation using Bagit library from LOC. https://projects.ecoinformatics.org/ecoinfo/issues/6026

7849 07/03/2013 09:58 PM ben leinfelder

add method for publishing existing object (usually assumed to be scimeta) with a DOI. https://projects.ecoinformatics.org/ecoinfo/issues/6014

7848 07/03/2013 04:34 PM Jing Tao

Fixed a bug that the event log can't save the real lastest process date.

7847 07/03/2013 03:56 PM Jing Tao

Change the date format.
Remove the replication part of log4j.

7846 07/03/2013 10:28 AM Jing Tao

Use a new date format.

7845 07/03/2013 10:25 AM Jing Tao

Add a log4j properties file.

7844 07/03/2013 10:24 AM Jing Tao

Add a file to specify the log4j as the logger.

7843 07/03/2013 10:13 AM ben leinfelder

add Metacat servlet action to force the reindexing of one or more or all pids in the system. https://projects.ecoinformatics.org/ecoinfo/issues/5945

7842 07/03/2013 12:28 AM ben leinfelder

only use MapStore/MapLoader for saving/loading IndexEvent objects. No need to use a listener since there is only the single node -- all entries are persisted to DB using the hazelcast.xml config we have for the map. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7841 07/03/2013 12:03 AM ben leinfelder

add MapStore/Loader test for the IndexEvents -- adding and removing events in the DB table through hazelcast. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7840 07/02/2013 04:47 PM ben leinfelder

support a "force replication delete all action" during replication. This is used when we want Metacat to remove the content from the other target replicas because the DataONE delete() action was called (more powerful than just "archive").

7839 07/02/2013 04:41 PM ben leinfelder

add simple test for the IndexEventDAO class -- adding, removing, listing events in the DB table. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7838 07/02/2013 03:21 PM Jing Tao

Add the code that only the ids with the correct system metadata modification time will be added to the index queue.

7837 07/01/2013 03:09 PM Jing Tao

Use the hazelcast event log.

7836 07/01/2013 01:59 PM Jing Tao

Add code to get and set the last process date.

7834 06/26/2013 04:43 PM ben leinfelder

merging upgrade scripts from 2.0 branch to trunk. https://redmine.dataone.org/issues/3847

7833 06/26/2013 04:42 PM ben leinfelder

scripts for 2.1.0 upgrade

7830 06/25/2013 04:42 PM ben leinfelder

upgrade to Metacat 2.1.0 on the trunk. This includes a new index_event table for storing indexing events that need to be reprocessed. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7829 06/25/2013 01:23 PM ben leinfelder

stub for storing IndexEvent objects in Metacat (from metacat-index processing). https://projects.ecoinformatics.org/ecoinfo/issues/5944

7828 06/25/2013 01:23 PM ben leinfelder

move IndexEvent into metacat-common. Perparation for Metacat responding to events and writing them to a persistent store. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7827 06/25/2013 01:17 PM ben leinfelder

do not force a get() during refresh (causing EML-defined data access rules to be lost when inserting EML docs about data files). note that this reverses a change that was meant to trigger indexing, but now we are using a new queue to share index events with metacat-index and so should not be necessary.

7824 06/24/2013 12:05 PM ben leinfelder

do not use tmp file to return an inputstream on read() operations - just read from the file we already have. https://projects.ecoinformatics.org/ecoinfo/issues/6009

7823 06/21/2013 09:44 PM ben leinfelder

use standard File.createTempFile() method for uploaded data files and delete them when we are done with them. https://projects.ecoinformatics.org/ecoinfo/issues/6008

7822 06/21/2013 04:15 PM ben leinfelder

correctly delete data file when we are done with it. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7821 06/21/2013 04:06 PM ben leinfelder

include filename in the filepart part. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7820 06/21/2013 03:18 PM ben leinfelder

send the original filename in the upload() method since that is supported by the Metacat API. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7819 06/21/2013 03:10 PM ben leinfelder

remove the unique string when generating data file metadata. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7818 06/21/2013 02:48 PM ben leinfelder

debugging. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7817 06/21/2013 01:44 PM ben leinfelder

use File::Temp to write data files in registry. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7816 06/21/2013 11:11 AM ben leinfelder

correct regex for whitespace in D1 identifier.

7815 06/21/2013 09:09 AM ben leinfelder

refactor IndexEventLog a bit to simplify type/action information. prep for serializing IndexEvent objects to Metacat. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7814 06/20/2013 05:28 PM ben leinfelder

remove serial number from indexeventlog - it is not used elsewhere in the api. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7813 06/20/2013 05:21 PM ben leinfelder

correct spelling for index.eventlog.classname property

7812 06/20/2013 04:49 PM ben leinfelder

use an independent ISet<SystemMetadata> structure to communicate objects that should be indexed by metacat-index. https://projects.ecoinformatics.org/ecoinfo/issues/5943

7811 06/20/2013 12:23 PM ben leinfelder

consolidate SystemMetadata map retrieval in preparation for using a different structure for objects to index.

7810 06/20/2013 09:24 AM ben leinfelder

adding ability to remove event from the [error] queue.

7809 06/18/2013 02:59 PM ben leinfelder

do not create solr-home if there is no template to compy into that directory (need to be able to create it later if/when someone decides to use and deploy metacat-index). https://projects.ecoinformatics.org/ecoinfo/issues/6006

7808 06/18/2013 01:54 PM ben leinfelder

do not attempt to copy solr-home template from metacat-index webapp if it does not exist. This would be in cases where metacat-index is not deployed. https://projects.ecoinformatics.org/ecoinfo/issues/6006

7807 06/17/2013 05:07 PM Jing Tao

Add code to implment set and get the last processed date.

7806 06/17/2013 04:28 PM Jing Tao

It will make the index only for those objects which were modified after the marked time.

7805 06/17/2013 01:50 PM Jing Tao

Add set and get the lastprocessedDate in the IndexEventLog.
Remove the code to write the successful event.

7804 06/13/2013 05:20 PM Jing Tao

Add the dataone repository.

7803 06/13/2013 04:41 PM Jing Tao

The "war" target will build the metacat-index.war as well.

7802 06/12/2013 02:36 PM Jing Tao

Log the timed index jobs.

7801 06/12/2013 02:08 PM Jing Tao

Add the code to log the failed events.

7800 06/11/2013 06:24 PM Jing Tao

Add a temporary file log for debugging.

7799 06/11/2013 06:23 PM Jing Tao

Use commons-io 2.4

7798 06/11/2013 03:47 PM Jing Tao

Add a new property for the index event log class name.

7797 06/07/2013 04:38 PM Jing Tao

Add a serial number for the event.
Add method to set events to be archived.

7796 06/07/2013 11:22 AM Jing Tao

Add a new class variable - isArchived for class IndexEvent.

7795 06/06/2013 04:13 PM Jing Tao

Update the documentation about those classes.

7794 06/06/2013 03:17 PM Jing Tao

Add a event and eventlog for the index.

7793 06/05/2013 03:03 PM Jing Tao

Use the identifier set to get the list of ids in the member node.

7792 06/05/2013 02:20 PM Jing Tao

The returned ISet should be Identifier.

7791 06/05/2013 01:50 PM Jing Tao

Add code to test getIdentifierSet method.

7790 06/05/2013 01:50 PM Jing Tao

Add method to get identifier set.

7789 06/04/2013 02:49 PM Jing Tao

Add a new property to specify the interval of a Timer to run the thread generating solr index.

7788 06/04/2013 02:47 PM Jing Tao

Set up a Timer to run the regenerating solr index task periodically.

7787 06/03/2013 04:35 PM Jing Tao

Use the ";" as the seperator to replace "," in the resource name spaces.

7786 05/31/2013 03:29 PM Jing Tao

Add code to handle delete data package information when delete a pid in the solr index.

7785 05/31/2013 02:05 PM Jing Tao

Add two static methods to get the SystemMetadata and data object InputStream for the specified id.

7784 05/28/2013 05:19 PM Jing Tao

Change the code since the ApplicationController's constructor was changed.

7783 05/28/2013 05:18 PM Jing Tao

Add code to check if the metacat.properties is available.

7782 05/28/2013 01:21 PM Jing Tao

If solr is not enabled, it would not be running.

7781 05/28/2013 01:20 PM Jing Tao

Solr will be enabled if it is in the db.enabledEngines.

7780 05/28/2013 01:18 PM Jing Tao

Use ";" to separate db.enabledEngines.

7779 05/24/2013 04:47 PM Jing Tao

Use the ";" as the seperator for properties.

7778 05/24/2013 10:20 AM ben leinfelder

do not require PortalCertificateManager be configured. Fix NPE because session was not created when using old sessionid-based authentication. https://projects.ecoinformatics.org/ecoinfo/issues/5942

7777 05/24/2013 12:09 AM Jing Tao

change the waiting time to 10 seconds and attempts to 600 for the hazelcast.

7776 05/23/2013 11:57 PM Jing Tao

Use another thread in the Servlet init method to wait hazelcast.

7775 05/23/2013 10:42 PM Jing Tao

Make the target init depend on build-metacat-common.

7774 05/23/2013 09:59 PM Jing Tao

Put the waiting mechanism for the hazelcast at the first place.

7773 05/23/2013 09:45 PM ben leinfelder

handle client certificates, portal certificates and jsessionid as three ways to prove you are an uthenticated user. https://projects.ecoinformatics.org/ecoinfo/issues/5942

7772 05/23/2013 06:39 PM Jing Tao

Use some contants from the EnabledQueryEngines.

7771 05/23/2013 06:28 PM Jing Tao

Temporarily remove the code to disable solr engine if it isn't listed in the property file.

7770 05/23/2013 04:29 PM ben leinfelder

exlude /lib/maven from the war file

7769 05/23/2013 04:27 PM Jing Tao

If the solr engine is disabled, the metacat index will do nothing.

7768 05/23/2013 01:43 PM Jing Tao

Use the new name of a method.

7767 05/23/2013 01:42 PM Jing Tao

Rename a method to isEnabled.

7766 05/23/2013 01:26 PM Matt Jones

Updated documentation, and added modification date to the sitemap index file entries.

7765 05/23/2013 12:55 PM Matt Jones

Remove unused import.

7764 05/23/2013 12:52 PM Matt Jones

Mofdified Sitemap class to also generate the sitemap index file that is needed when more than one sitemap file is provided.

7763 05/23/2013 12:42 PM Jing Tao

Remove the junit test for an obsoleted class.

7762 05/23/2013 12:41 PM Jing Tao

Remove the obsoleted class.

7761 05/23/2013 12:40 PM Jing Tao

Add a junit test class for EnabledQueryEngines.

7760 05/23/2013 12:40 PM Jing Tao

Add a test base class.

7759 05/23/2013 12:39 PM Jing Tao

Add a class to repsent the enabled engine list.

7758 05/23/2013 11:55 AM Jing Tao

Change the junit version to 4.8