Project

General

Profile

Statistics
| Revision:

metacat @ 7839

  • svn:ignore: build
  • svn:mergeinfo: /branches/D1_0_6_2_BRANCH:6107-6121
# Date Author Comment
7839 07/02/2013 04:41 PM ben leinfelder

add simple test for the IndexEventDAO class -- adding, removing, listing events in the DB table. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7838 07/02/2013 03:21 PM Jing Tao

Add the code that only the ids with the correct system metadata modification time will be added to the index queue.

7837 07/01/2013 03:09 PM Jing Tao

Use the hazelcast event log.

7836 07/01/2013 01:59 PM Jing Tao

Add code to get and set the last process date.

7834 06/26/2013 04:43 PM ben leinfelder

merging upgrade scripts from 2.0 branch to trunk. https://redmine.dataone.org/issues/3847

7833 06/26/2013 04:42 PM ben leinfelder

scripts for 2.1.0 upgrade

7830 06/25/2013 04:42 PM ben leinfelder

upgrade to Metacat 2.1.0 on the trunk. This includes a new index_event table for storing indexing events that need to be reprocessed. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7829 06/25/2013 01:23 PM ben leinfelder

stub for storing IndexEvent objects in Metacat (from metacat-index processing). https://projects.ecoinformatics.org/ecoinfo/issues/5944

7828 06/25/2013 01:23 PM ben leinfelder

move IndexEvent into metacat-common. Perparation for Metacat responding to events and writing them to a persistent store. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7827 06/25/2013 01:17 PM ben leinfelder

do not force a get() during refresh (causing EML-defined data access rules to be lost when inserting EML docs about data files). note that this reverses a change that was meant to trigger indexing, but now we are using a new queue to share index events with metacat-index and so should not be necessary.

7824 06/24/2013 12:05 PM ben leinfelder

do not use tmp file to return an inputstream on read() operations - just read from the file we already have. https://projects.ecoinformatics.org/ecoinfo/issues/6009

7823 06/21/2013 09:44 PM ben leinfelder

use standard File.createTempFile() method for uploaded data files and delete them when we are done with them. https://projects.ecoinformatics.org/ecoinfo/issues/6008

7822 06/21/2013 04:15 PM ben leinfelder

correctly delete data file when we are done with it. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7821 06/21/2013 04:06 PM ben leinfelder

include filename in the filepart part. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7820 06/21/2013 03:18 PM ben leinfelder

send the original filename in the upload() method since that is supported by the Metacat API. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7819 06/21/2013 03:10 PM ben leinfelder

remove the unique string when generating data file metadata. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7818 06/21/2013 02:48 PM ben leinfelder

debugging. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7817 06/21/2013 01:44 PM ben leinfelder

use File::Temp to write data files in registry. https://projects.ecoinformatics.org/ecoinfo/issues/6007

7816 06/21/2013 11:11 AM ben leinfelder

correct regex for whitespace in D1 identifier.

7815 06/21/2013 09:09 AM ben leinfelder

refactor IndexEventLog a bit to simplify type/action information. prep for serializing IndexEvent objects to Metacat. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7814 06/20/2013 05:28 PM ben leinfelder

remove serial number from indexeventlog - it is not used elsewhere in the api. https://projects.ecoinformatics.org/ecoinfo/issues/5944

7813 06/20/2013 05:21 PM ben leinfelder

correct spelling for index.eventlog.classname property

7812 06/20/2013 04:49 PM ben leinfelder

use an independent ISet<SystemMetadata> structure to communicate objects that should be indexed by metacat-index. https://projects.ecoinformatics.org/ecoinfo/issues/5943

7811 06/20/2013 12:23 PM ben leinfelder

consolidate SystemMetadata map retrieval in preparation for using a different structure for objects to index.

7810 06/20/2013 09:24 AM ben leinfelder

adding ability to remove event from the [error] queue.

7809 06/18/2013 02:59 PM ben leinfelder

do not create solr-home if there is no template to compy into that directory (need to be able to create it later if/when someone decides to use and deploy metacat-index). https://projects.ecoinformatics.org/ecoinfo/issues/6006

7808 06/18/2013 01:54 PM ben leinfelder

do not attempt to copy solr-home template from metacat-index webapp if it does not exist. This would be in cases where metacat-index is not deployed. https://projects.ecoinformatics.org/ecoinfo/issues/6006

7807 06/17/2013 05:07 PM Jing Tao

Add code to implment set and get the last processed date.

7806 06/17/2013 04:28 PM Jing Tao

It will make the index only for those objects which were modified after the marked time.

7805 06/17/2013 01:50 PM Jing Tao

Add set and get the lastprocessedDate in the IndexEventLog.
Remove the code to write the successful event.

7804 06/13/2013 05:20 PM Jing Tao

Add the dataone repository.

7803 06/13/2013 04:41 PM Jing Tao

The "war" target will build the metacat-index.war as well.

7802 06/12/2013 02:36 PM Jing Tao

Log the timed index jobs.

7801 06/12/2013 02:08 PM Jing Tao

Add the code to log the failed events.

7800 06/11/2013 06:24 PM Jing Tao

Add a temporary file log for debugging.

7799 06/11/2013 06:23 PM Jing Tao

Use commons-io 2.4

7798 06/11/2013 03:47 PM Jing Tao

Add a new property for the index event log class name.

7797 06/07/2013 04:38 PM Jing Tao

Add a serial number for the event.
Add method to set events to be archived.

7796 06/07/2013 11:22 AM Jing Tao

Add a new class variable - isArchived for class IndexEvent.

7795 06/06/2013 04:13 PM Jing Tao

Update the documentation about those classes.

7794 06/06/2013 03:17 PM Jing Tao

Add a event and eventlog for the index.

7793 06/05/2013 03:03 PM Jing Tao

Use the identifier set to get the list of ids in the member node.

7792 06/05/2013 02:20 PM Jing Tao

The returned ISet should be Identifier.

7791 06/05/2013 01:50 PM Jing Tao

Add code to test getIdentifierSet method.

7790 06/05/2013 01:50 PM Jing Tao

Add method to get identifier set.

7789 06/04/2013 02:49 PM Jing Tao

Add a new property to specify the interval of a Timer to run the thread generating solr index.

7788 06/04/2013 02:47 PM Jing Tao

Set up a Timer to run the regenerating solr index task periodically.

7787 06/03/2013 04:35 PM Jing Tao

Use the ";" as the seperator to replace "," in the resource name spaces.

7786 05/31/2013 03:29 PM Jing Tao

Add code to handle delete data package information when delete a pid in the solr index.

7785 05/31/2013 02:05 PM Jing Tao

Add two static methods to get the SystemMetadata and data object InputStream for the specified id.

7784 05/28/2013 05:19 PM Jing Tao

Change the code since the ApplicationController's constructor was changed.

7783 05/28/2013 05:18 PM Jing Tao

Add code to check if the metacat.properties is available.

7782 05/28/2013 01:21 PM Jing Tao

If solr is not enabled, it would not be running.

7781 05/28/2013 01:20 PM Jing Tao

Solr will be enabled if it is in the db.enabledEngines.

7780 05/28/2013 01:18 PM Jing Tao

Use ";" to separate db.enabledEngines.

7779 05/24/2013 04:47 PM Jing Tao

Use the ";" as the seperator for properties.

7778 05/24/2013 10:20 AM ben leinfelder

do not require PortalCertificateManager be configured. Fix NPE because session was not created when using old sessionid-based authentication. https://projects.ecoinformatics.org/ecoinfo/issues/5942

7777 05/24/2013 12:09 AM Jing Tao

change the waiting time to 10 seconds and attempts to 600 for the hazelcast.

7776 05/23/2013 11:57 PM Jing Tao

Use another thread in the Servlet init method to wait hazelcast.

7775 05/23/2013 10:42 PM Jing Tao

Make the target init depend on build-metacat-common.

7774 05/23/2013 09:59 PM Jing Tao

Put the waiting mechanism for the hazelcast at the first place.

7773 05/23/2013 09:45 PM ben leinfelder

handle client certificates, portal certificates and jsessionid as three ways to prove you are an uthenticated user. https://projects.ecoinformatics.org/ecoinfo/issues/5942

7772 05/23/2013 06:39 PM Jing Tao

Use some contants from the EnabledQueryEngines.

7771 05/23/2013 06:28 PM Jing Tao

Temporarily remove the code to disable solr engine if it isn't listed in the property file.

7770 05/23/2013 04:29 PM ben leinfelder

exlude /lib/maven from the war file

7769 05/23/2013 04:27 PM Jing Tao

If the solr engine is disabled, the metacat index will do nothing.

7768 05/23/2013 01:43 PM Jing Tao

Use the new name of a method.

7767 05/23/2013 01:42 PM Jing Tao

Rename a method to isEnabled.

7766 05/23/2013 01:26 PM Matt Jones

Updated documentation, and added modification date to the sitemap index file entries.

7765 05/23/2013 12:55 PM Matt Jones

Remove unused import.

7764 05/23/2013 12:52 PM Matt Jones

Mofdified Sitemap class to also generate the sitemap index file that is needed when more than one sitemap file is provided.

7763 05/23/2013 12:42 PM Jing Tao

Remove the junit test for an obsoleted class.

7762 05/23/2013 12:41 PM Jing Tao

Remove the obsoleted class.

7761 05/23/2013 12:40 PM Jing Tao

Add a junit test class for EnabledQueryEngines.

7760 05/23/2013 12:40 PM Jing Tao

Add a test base class.

7759 05/23/2013 12:39 PM Jing Tao

Add a class to repsent the enabled engine list.

7758 05/23/2013 11:55 AM Jing Tao

Change the junit version to 4.8

7757 05/23/2013 10:20 AM ben leinfelder

use ContentTypeInputStream interface (and ByteArray implementation) to specify the desired content-type of the InputStream returned by MN.query().

7756 05/23/2013 09:15 AM Jing Tao

Add the new property dbquery.enabledEngines=pathquery,solr.

7755 05/22/2013 04:44 PM ben leinfelder

load the evicted SM back into the map on a "Refresh" so that listeners hear the update. (metacat-index, for example)

7754 05/22/2013 04:18 PM Jing Tao

set the dataone.hazelcast.location.clientconfig property to be the local config file. It will be used in the d1_cn_index_processor

7753 05/22/2013 03:50 PM ben leinfelder

use DataONE cilogon skin so that we are not prompted for certificate duration (and to make it more cohesive as a prototype using the Metacat DataONE skin

7752 05/22/2013 03:49 PM ben leinfelder

switch back to log4j statements now that I am sure certificate delegation is working.

7751 05/22/2013 03:35 PM ben leinfelder

add link to login or switch user

7750 05/22/2013 03:29 PM ben leinfelder

add simple page to show logged-in user subject DN

7749 05/22/2013 03:02 PM ben leinfelder

use System.out.println until the oa4mp logging issue is resolved.

7748 05/22/2013 11:19 AM Jing Tao

Read the waiting time and maximum attempts from the metacat.properties file.

7747 05/22/2013 10:56 AM Jing Tao

Add the waiting time and max attempts for regenerating the index.

7746 05/22/2013 10:36 AM ben leinfelder

use filesystem store. in-memory store seems to get into deadlock with multiple environments accessing it.

7745 05/22/2013 10:34 AM ben leinfelder

add logging for portal certificate look up process.

7744 05/22/2013 10:29 AM Jing Tao

Add some new properties for the test.

7743 05/22/2013 09:34 AM ben leinfelder

use relative path for oa4mp_client.xml (within servlet context). https://projects.ecoinformatics.org/ecoinfo/issues/5936

7742 05/22/2013 08:05 AM ben leinfelder

use in-memory storage for myproxy. at least for now.

7741 05/21/2013 11:35 PM Jing Tao

Add a property containing the list of the resource map namespaces.

7740 05/21/2013 11:33 PM Jing Tao

Index the none-resourcemap data objects first, then the resourcemap objects.

7739 05/21/2013 11:32 PM ben leinfelder

used pk8 format private key file name

7738 05/21/2013 11:12 PM ben leinfelder

use java 1.6 compliance for compilation

7737 05/21/2013 11:05 PM ben leinfelder

first pass at integrating CILogon/MyProxy certificates in Metacat. Configuration is specific to mn-demo-4.test.dataone.org for the time being (this will cause localhost deployments to fail webapp deployment). https://projects.ecoinformatics.org/ecoinfo/issues/5936

7736 05/21/2013 11:05 PM ben leinfelder

first pass at integrating CILogon/MyProxy certificates in Metacat. Configuration is specific to mn-demo-4.test.dataone.org for the time being (this will cause localhost deployments to fail webapp deployment). https://projects.ecoinformatics.org/ecoinfo/issues/5936

7735 05/21/2013 07:32 PM Matt Jones

Updated Sitemap generation to use latest version of the sitemap protocol schemas.