Project

General

Profile

Statistics
| Revision:

# Date Author Comment
8805 05/30/2014 05:06 PM ben leinfelder

handle multiple subprocessors (RDF and ORE) before the object gets indexed by making sure to merge the solr doc map before submitting to the index.

8799 05/28/2014 11:48 AM ben leinfelder

use default "metacat" context name for metacat-index testing.

8781 05/15/2014 10:27 AM ben leinfelder

include ORE formatId as handled by the RDF subprocessor and index prov:wasDerivedFrom field where it exists in the RDF model. https://projects.ecoinformatics.org/ecoinfo/issues/6548

8774 05/13/2014 03:36 PM ben leinfelder

use a non-public rightsHolder for both EML and Annotation test documents now that the RDF subprocessor checks each annotation to see that it came from a user that as write permission for the object being annotated.

8773 05/13/2014 03:34 PM ben leinfelder

test for update using the updated EML file, not the original. Also add the SM to the shared map so that the indexing process can consult SM.accessPolicy when indexing annotations that assert things about those test documents.

8772 05/13/2014 03:32 PM ben leinfelder

ignore the metacat/solr comparator tests - they are one-offs.

8766 05/07/2014 11:16 PM ben leinfelder

pass around the object file path rather than the data stream so that multiple subprocessors can index the same object and not consume the stream before it gets to the next one. In preparation for extending the assertions stored in OREs. https://projects.ecoinformatics.org/ecoinfo/issues/6548

8761 04/30/2014 03:46 PM ben leinfelder

only allow multiple values for multi-valued fields....

8758 04/29/2014 04:55 PM ben leinfelder

use newer httpclient library so that Jena's dependency is met - this goes all the way back to d1_common/libclient needing to pull in the newer library.

8756 04/29/2014 04:52 PM ben leinfelder

allow multivalued fields to be indexed using the "fields" pass through.

8752 04/28/2014 04:54 PM Jing Tao

Localized the file which doesn't have the bean for dataUrl.

8741 04/18/2014 05:29 PM Jing Tao

Remove the reference to the bean eml.fileID.

8736 04/15/2014 09:36 AM Jing Tao

Remove the bean named eml.fileID which used the ResolveSolrField class.

8735 04/14/2014 02:58 PM ben leinfelder

calculate geohash_3 to three places (typo)

8734 04/14/2014 02:55 PM ben leinfelder

use NSEW for the bounding box geohash calculation from EML - all versions

8732 04/14/2014 02:07 PM Peter Slaughter

Using 1.3.0-SNAPSHOT from d1_cn_index_processor

8730 04/14/2014 01:33 PM Peter Slaughter

Add beans to support geohashes

8729 04/14/2014 01:33 PM Peter Slaughter

Add beans to support geohashes

8722 04/02/2014 03:35 PM ben leinfelder

handle null Boolean in SM.archived field

8720 03/31/2014 03:25 PM ben leinfelder

use Matthew Jones for test creator since he has an ORCID in their staging environment.

8719 03/31/2014 12:31 PM ben leinfelder

augment annotation indexing test/sample to include orcid annotation. https://projects.ecoinformatics.org/ecoinfo/issues/6267
https://projects.ecoinformatics.org/ecoinfo/issues/6423

8708 03/21/2014 05:07 PM ben leinfelder

include characteristic_sm field with SPARQL query

8701 03/14/2014 10:55 AM ben leinfelder

switch to index standard since it is more likely we will be able to determine this from our existing EML attribute information. https://projects.ecoinformatics.org/ecoinfo/issues/6253

8693 03/03/2014 04:33 PM ben leinfelder

Do a more thorough check that the characteristic annotation was successfully indexed as expected (semtools)

8692 03/03/2014 03:56 PM ben leinfelder

switch to the OpenAnnotation (OA) model for annotating datapackages with measurements/characteristics (semtools)

8691 03/03/2014 03:55 PM ben leinfelder

switch to the OpenAnnotation (OA) model for annotating datapackages with measurements/characteristics (semtools)

8690 03/03/2014 03:54 PM ben leinfelder

switch to the OpenAnnotation (OA) model for annotating datapackages with measurements/characteristics (semtools)

8688 03/03/2014 09:30 AM ben leinfelder

bump the poms to 2.4.2

8648 02/25/2014 04:32 PM ben leinfelder

test that obsoleted objects remain indexed, but are marked as obsoleted. https://projects.ecoinformatics.org/ecoinfo/issues/6424

8603 02/14/2014 11:49 AM ben leinfelder

use rangeOfDates | singleDateTime to populate the beginDate and endDate index fields. https://projects.ecoinformatics.org/ecoinfo/issues/6285

8580 02/07/2014 02:20 PM ben leinfelder

include ID field as a minimum for indexing additional fields.

8554 02/03/2014 02:53 PM ben leinfelder

correctly include stacktrace for error debugging.

8552 02/03/2014 02:51 PM ben leinfelder

return null if there is no existing SolrDoc for the given pid.

8545 01/31/2014 10:41 AM ben leinfelder

index singleDateTime value into both begin and end date fields in solr. https://projects.ecoinformatics.org/ecoinfo/issues/6285

8537 01/29/2014 01:41 PM ben leinfelder

uncomment the original tests now that the "field" test is working.

8503 01/15/2014 09:55 AM ben leinfelder

check for existing index document before trying to use existing fields.

8498 01/14/2014 02:57 PM ben leinfelder

allow indexing of RDF documents - provide a sparql query that will return values for the field name. Using measurement_sm initially (a dynamic multivalued solr field). https://projects.ecoinformatics.org/ecoinfo/issues/6253

8496 01/14/2014 02:14 PM ben leinfelder

check for existing documents - don't assume it exists.

8464 01/07/2014 01:56 PM ben leinfelder

Unify solr indexing with an IndexTask that is added to the queue -- allows us to send more than just the systemMetadata to the indexer. Initially this is for READ event counts for each document. https://projects.ecoinformatics.org/ecoinfo/issues/6346

8458 12/20/2013 11:18 AM ben leinfelder

move metacat trunk to 2.4.0-SNAPSHOT

8440 12/19/2013 08:53 AM ben leinfelder

prep for 2.3.1 release

8372 11/08/2013 01:56 PM ben leinfelder

use 2.3.0 without SNAPSHOT pre-release.

8353 10/30/2013 10:37 AM Jing Tao

Renamed the test class.

8352 10/30/2013 10:19 AM Jing Tao

Rename the IndexGenerator to IndexGeneratorTimerTask.

8345 10/28/2013 08:21 PM Jing Tao

Fixed a bug that when a data file was archived, the solr index for the metadata object still kept the "documents" element.

8344 10/28/2013 05:49 PM Jing Tao

made the delete method synchronized.

8343 10/28/2013 04:54 PM Jing Tao

If an object was archived, the solr index will be removed for it.

8339 10/21/2013 01:56 PM ben leinfelder

use 2.3.0 for this next release of metacat.

8336 10/21/2013 12:44 PM ben leinfelder

make sure all versions are using 2.2.2 of some sort -- thinking of making this release a 2.3.0 release because we will be branching/tagging from the trunk, not the 2.2.x branch.

8310 10/11/2013 11:07 AM Jing Tao

Use the setting from the metacat-common component.

8296 10/09/2013 12:10 PM Jing Tao

Use the d1_cn_index_processor 1.2.0 version.

8295 10/09/2013 12:09 PM Jing Tao

Remove those files. They will be get from the d1_cn_index_processor 1.2.0 jar.

8293 10/08/2013 05:51 PM Jing Tao

combine the index code for failed ids and other ids.

8292 10/08/2013 04:49 PM Jing Tao

Clean up the code.

8291 10/08/2013 02:22 PM Jing Tao

The IndexGenerator will index the obsoleted data objects as well.

8288 10/08/2013 11:33 AM Jing Tao

Remove the obsoletes chain from the update method in the SolrIndex class.

8287 10/07/2013 05:56 PM Jing Tao

When an object is archvied, the solr index will not be removed.

8283 10/04/2013 09:26 AM ben leinfelder

merge from 2.2 branch: remove the index queue item when it is being processed. https://projects.ecoinformatics.org/ecoinfo/issues/6117

8282 10/03/2013 05:38 PM Jing Tao

Add a patch for d1_cn_index_processor 1.1.2 version. So it can index taxon information.
Those files will overwrite the ones in the d1_cn_index_process-1.1.2.jar.

8265 09/23/2013 03:54 PM ben leinfelder

Refer to metacat.war deployments since those are now the default. https://projects.ecoinformatics.org/ecoinfo/issues/6082

8187 09/12/2013 10:45 AM ben leinfelder

remove any index event errors if the pid has successfully been reindexed. https://projects.ecoinformatics.org/ecoinfo/issues/6089

8161 08/23/2013 11:39 AM Jing Tao

Change the parameters order of the constructor. We maybe reuse some code from d1_cn_processor.

8153 08/14/2013 02:18 PM Jing Tao

Add a plugin to copy the solr-home from the metacat-common to the target/classes.

8152 08/14/2013 02:17 PM Jing Tao

Remove the solr-home to the metacat-common.

8148 08/13/2013 04:28 PM Jing Tao

Change the version to 2.2.0-SNAPSHOT and the dependency version of metacat-common to 2.2.0-SNAPSHOT.

8146 08/13/2013 04:16 PM ben leinfelder

[merge from branch to keep trunk up to date with upgrade history] prep for Metacat 2.1.1 release

8144 08/13/2013 03:53 PM Jing Tao

Remove the file and it will got from the D1.

8138 08/09/2013 05:07 PM Jing Tao

Modified the documentation.

8136 08/09/2013 04:52 PM Jing Tao

Modified the documentation.

8135 08/09/2013 04:49 PM Jing Tao

Add a junit test to test resourcemap subprocessor.

8134 08/09/2013 04:43 PM Jing Tao

Use the ResourceMapException when a component of a resource map isn't found in the solr index.

8133 08/09/2013 04:42 PM Jing Tao

Add a ResourceMapException.

8132 08/09/2013 03:56 PM Jing Tao

Add the property of dataone.hazelcast.location.clientconfig.

8131 08/09/2013 01:22 PM Jing Tao

Make the method getSolrindex to be public.

8130 08/09/2013 10:25 AM Jing Tao

change the configuration path.

8129 08/09/2013 10:17 AM Jing Tao

Change the configuration path according to the change of the class.

8128 08/08/2013 03:08 PM Jing Tao

Use the class path configuration of spring to replace the file configuration. We can reuse the application context files in the d1_cn_index_processor jar.

8127 08/08/2013 03:01 PM Jing Tao

Remove the application context files (except the resource map one). It will use the ones in the d1_cn_index_processor.

8126 08/08/2013 02:19 PM Jing Tao

Add a new property for the log class name.

8125 08/08/2013 01:43 PM Jing Tao

Add a constructor.

8124 08/08/2013 11:03 AM Jing Tao

Remove the constructor.

8106 08/01/2013 02:52 PM ben leinfelder

use v2.1.0 for all metacat release components for consistency

8105 08/01/2013 02:36 PM ben leinfelder

remove all -SNAPSHOT artifacts in favor of released versions in preparation for Metacat v2.1.0 release

8095 07/31/2013 03:11 PM Jing Tao

fixed a bug that the setup method deleted a result file.

8094 07/31/2013 01:00 PM Jing Tao

Add a method to count how many documents in a specified solr server.

8084 07/30/2013 10:26 AM Jing Tao

Remove a logFile method.

8070 07/22/2013 03:50 PM ben leinfelder

use the v1.1.2 d1-cn-index-processor

8069 07/22/2013 03:48 PM ben leinfelder

use the v1.1.x branch ResourceMap class for metacat-index

8035 07/19/2013 09:08 AM Jing Tao

The exceptions will be caught during the looping of deleting the solr index.

8027 07/18/2013 09:06 AM Jing Tao

Remove the code to write some debug information into a temporary file.

8023 07/17/2013 03:48 PM Jing Tao

Use the ResourceMapFactory rather than the ResourceMap constructor to build a resource map.

8022 07/17/2013 03:33 PM ben leinfelder

rollback: we do want to use 1.2.0-SNAPSHOT from d1 indexing.

8017 07/17/2013 11:33 AM Jing Tao

Write the ids from metacat into a temporary file.

8011 07/16/2013 03:00 PM ben leinfelder

use tagged version of cn-index-processor library

7931 07/12/2013 09:06 AM Jing Tao

Move a file to the temp dir.

7924 07/11/2013 04:28 PM Jing Tao

Add a method to write ids which will be indexed into a file.

7888 07/11/2013 11:43 AM Jing Tao

Fixed a bug that the missed id is not writtent to the file.

7883 07/11/2013 11:20 AM Jing Tao

Add a class to compare ids in the solr and metacat.

7877 07/10/2013 04:32 PM Jing Tao

Besides the getArchvied() method, the getObsoletedBy method was added to determine if the object is archvied or not.

7876 07/10/2013 04:14 PM Jing Tao

Add code to handle deleted ids.