Project

General

Profile

Statistics
| Revision:

# Date Author Comment
8769 05/09/2014 01:48 PM ben leinfelder

cache the imported models to avoid timeouts from remote hosts (or being locked out for too many requests in a given time period).

8768 05/08/2014 04:25 PM ben leinfelder

process all the returned annotation suggestions until we find one that is appropriately located in the subclass hierarchy for the given superclass.

8767 05/08/2014 04:23 PM ben leinfelder

use in-memory TDB dataset for querying annotations for indexing -- this comes with the same reasoning capabilities as the directory-based one, but has the benefit of not filling the directory with triples that will not be used again. prepping for d1 AHM

8765 05/07/2014 11:12 PM ben leinfelder

when indexing annotations directly, just use an in-memory triple store rather than TDB since we remove each graph as it is processed (and my TDB instance would get into the multi-GB range with a few runs, even if I removed the old models)

8764 05/05/2014 05:17 PM ben leinfelder

redirect "short form" metacat read URIs to the the new Metacat UI using the configured UI context. This translates the docid -> pid to use the correct identifier for the correct service. https://projects.ecoinformatics.org/ecoinfo/issues/6546

8763 05/02/2014 04:39 PM ben leinfelder

simplify lookup for classes and orcid. remove the "random" annotation code branches -- just too confusing to look at those bogus classes especially now that we have "real" generated annotations.

8760 04/30/2014 01:02 PM Lauren Walker

Add admin service to update DOI registrations by specifying a list of formatIds or DOIs, or update all.

8759 04/29/2014 05:21 PM ben leinfelder

use new method to override the CN URL when constructing a CNode instance. see https://redmine.dataone.org/issues/5142

8757 04/29/2014 04:54 PM ben leinfelder

first pass at direct EML->semantic index method. Still produces an RDF model, but does not persist it in Metacat, only in the triplestore. Allows us to re-run without adding stale RDF to the MN store.

8749 04/28/2014 03:30 PM Jing Tao

Store the cn url in the backup.

8748 04/24/2014 01:28 PM ben leinfelder

switch to use FIleUpload instead of O'Reilly COS library for handling chunked file uploads. https://projects.ecoinformatics.org/ecoinfo/issues/6517

8747 04/24/2014 01:26 PM ben leinfelder

forgot to check in the actual class: first pass at allowing admins to update DOI registration. This only acts on EML objects at the moment and is meant to illustrate one mechanism for updating the DOIs. https://projects.ecoinformatics.org/ecoinfo/issues/6530

8746 04/23/2014 12:35 PM ben leinfelder

first pass at allowing admins to update DOI registration. This only acts on EML objects at the moment and is meant to illustrate one mechanism for updating the DOIs. https://projects.ecoinformatics.org/ecoinfo/issues/6530

8745 04/23/2014 10:19 AM ben leinfelder

correct the ORE lookup query syntax and add junit assertion to check that it continues to function as expected. https://projects.ecoinformatics.org/ecoinfo/issues/6529

8744 04/22/2014 03:38 PM ben leinfelder

index the ORE after we submit the metadata for indexing. https://projects.ecoinformatics.org/ecoinfo/issues/6520

8743 04/22/2014 11:43 AM ben leinfelder

include BioPortal lookup for Entity matches using the data table description. TODO: only associate measurements to the entity observation if they apply.

8739 04/17/2014 02:19 PM Jing Tao

Index the document after it has been inserted.

8738 04/17/2014 02:18 PM Jing Tao

Index the document after document is written to the db.

8724 04/02/2014 03:36 PM ben leinfelder

check for null entities and/or attributes (typically when otherEntity is being used in EML).

8723 04/02/2014 03:35 PM ben leinfelder

remove extra space in log message

8718 03/31/2014 11:11 AM ben leinfelder

attribute the datapackage to the creator (using orcid if we can find it). https://projects.ecoinformatics.org/ecoinfo/issues/6267
https://projects.ecoinformatics.org/ecoinfo/issues/6423

8717 03/31/2014 10:31 AM ben leinfelder

add test for BioPortal annotator service.

8716 03/28/2014 03:51 PM ben leinfelder

refactor web service calls to bioportal and orcid outside of the annotator class. test with orcid sandbox server. include orcid uri for the annotations being generated (we can index these and drive our searches on these values down the road). related to this: https://projects.ecoinformatics.org/ecoinfo/issues/6423 and also some semtools tasks.

8715 03/27/2014 04:54 PM ben leinfelder

remove leading '?' in the query parameter for MN.query() implementation. We want it to match CN behavior/expectations and comply with the DataONE specification for the interface. https://projects.ecoinformatics.org/ecoinfo/issues/6488

8714 03/26/2014 04:05 PM ben leinfelder

Use OBOE-SBC ontology for looking up concepts (it contains subclasses of our OBOE Characteristic and Standard superclasses). Restrict annotations to only subclasses that fit the OBOE model. Correct the xpointer and individual naming conventions so they are unique, but express the exact entity/attribute being annotated.

8713 03/26/2014 03:10 PM ben leinfelder

remove my api key. oops

8712 03/26/2014 03:02 PM ben leinfelder

add comment/pointer to BioPortal annotation service.

8711 03/26/2014 03:00 PM ben leinfelder

Include method to look up annotation classes from BioPortal. We still have OBOE-SBC in there, and theyhave the SWEET ontology. The suggestions returned are not perfect, but they can be better than nothing. Ideally, we'd only query a few ontologies so we don't end up using terms from medical ontologies that aren't really appropriate for our domain. https://projects.ecoinformatics.org/ecoinfo/issues/6256

8710 03/24/2014 04:17 PM ben leinfelder

Add xpointer FragmentSelectors to each annotation.
Split attribute label into tokens to attempt matching to OBOE concepts.

8709 03/23/2014 12:11 AM ben leinfelder

include code to generate random annotations for UI testing. Effective, but can be confusing to see so many unrelated concepts on duplicate EML packages.

8707 03/21/2014 01:21 PM ben leinfelder

include SSLVerify* directives for client certificates and a pointer for getting the DataONE chain files.

8704 03/14/2014 03:33 PM Jing Tao

Remove the code to lookup alias dn in the getGroups method.

8703 03/14/2014 01:16 PM Jing Tao

Rather than directly to modify the env, we use context.addToEnv.
This fixed a bug in non-tls env, the alias log-in doesn't work.

8702 03/14/2014 10:59 AM ben leinfelder

first pass at generating annotations from EML attribute information. uses the OpenAnnotation model that the metacat-index tests assume which allows us to populate dynamic index fields for the annotation class[es]. There is still much to be done with finding appropriate concepts for each attribute. https://projects.ecoinformatics.org/ecoinfo/issues/6256

8700 03/06/2014 03:28 PM Lauren Walker

Edited the replicaPolicies script to print out a list of IDs that have a different authoritative member node, the number of successes, and failures at the end.

8699 03/05/2014 11:46 AM Lauren Walker

Add comments to bash script to explain its function and dependencies

8698 03/05/2014 11:30 AM Lauren Walker

Added a bash script to call /replicaPolicies/{pid} via the DataONE API for all objects in a MN or a list of ids.

8689 03/03/2014 03:41 PM ben leinfelder

support content from all serverLocations when summarizing entity info (semtools)

8678 02/28/2014 04:06 PM ben leinfelder

allow "+" in solr query syntax. https://projects.ecoinformatics.org/ecoinfo/issues/6435

8670 02/26/2014 10:49 PM ben leinfelder

include read events when re-indexing obsoleted objects. https://projects.ecoinformatics.org/ecoinfo/issues/6424

8664 02/26/2014 04:19 PM Jing Tao

Set the userManagementURL property.

8656 02/26/2014 07:55 AM ben leinfelder

update to use 2.4.1 so the trunk has all artifacts for upgrades.

8655 02/26/2014 07:47 AM ben leinfelder

simple upgrade scripts for version 2.4.1

8652 02/25/2014 07:46 PM Jing Tao

In the authenticate method, if metacat can't get user info, the login still can be successful.

8651 02/25/2014 06:39 PM Jing Tao

change a log information.

8650 02/25/2014 06:31 PM Jing Tao

In the getALiasedName method, the referral set to ignore. Since the alias name is the local referral, we need to set it to ignore.

8647 02/25/2014 04:14 PM ben leinfelder

recursively submit obsoleted objects for indexing when instructed. https://projects.ecoinformatics.org/ecoinfo/issues/6424

8646 02/24/2014 04:30 PM ben leinfelder

First pass at a class for summarizing attribute information for analysis. (semtools) https://projects.ecoinformatics.org/ecoinfo/issues/6256

8642 02/21/2014 03:12 PM ben leinfelder

merge recent upgrade changes from 2.4 branch

8634 02/21/2014 11:20 AM ben leinfelder

look up guid when done setting access by docid so we can sync and refresh accesspolicy on MN and CN.

8633 02/21/2014 10:50 AM ben leinfelder

additional logging for set access

8630 02/21/2014 09:05 AM Peter Slaughter

get guid from online id for call to SyncAccessPolicy

8629 02/21/2014 09:02 AM Peter Slaughter

setAccessAction: get guid from passed in id for calls to SyncAccessPolicy, HazelcastService.refreshSystemMetadataEntry

8628 02/20/2014 04:16 PM ben leinfelder

example of how we can look up pid (guid) given a metacat docid.

8626 02/20/2014 01:57 PM ben leinfelder

remove sensorML from the catalog since we don't actually ship it (yet?)

8617 02/19/2014 02:35 PM Chris Jones

Add in Darwin Core schema support into xml_catalog, and insert it on upgrade as well. The schemas are cached in lib/schema/dwc, and Matt and Ben noted that the tdwg_basetypes.xsd and tdwg_dwctypes.xsd are part of the same namespace, but are xs:include'd rather than imported via namespace.

8614 02/19/2014 12:54 PM ben leinfelder

include a few tests for isEqual method. https://projects.ecoinformatics.org/ecoinfo/issues/6407

8610 02/18/2014 02:48 PM Peter Slaughter

Change isEqual to private so it can be used by test suite

8609 02/17/2014 07:11 AM Chris Jones

Add DataONE, Dublin Core, and Dryad schemas during the 2.4.0 upgrade, and be sure to remove the appropriate entries before inserting to avoid duplicate rows.

8608 02/17/2014 06:53 AM Chris Jones

Add schema support for the DataONE, dublin Core, and Dryad schemas. Schemas get downloaded into lib/schema priior to jar and dist targets, and get loaded into xml_catalog on installation.

8607 02/14/2014 03:43 PM ben leinfelder

move the postgres changes to the oracle version -- update note about not attempting to restore because no Oracle MNs exist.

8606 02/14/2014 03:20 PM ben leinfelder

do not include "sm" alias in the SET clause.

8605 02/14/2014 03:19 PM ben leinfelder

allow statements starting with 'WITH'

8604 02/14/2014 02:56 PM ben leinfelder

comment out the select statements so they do not run during real upgrade.

8601 02/13/2014 03:12 PM ben leinfelder

loosen the restriction on which archive flags we set to false -- if we have an obsoleted_by value then it need not be marked as archived.

8600 02/13/2014 02:44 PM ben leinfelder

add [partial] upgrade to the oracle script -- does not look for any records that the CN deleted because there are no Oracle-backed MNs at this time.

8599 02/13/2014 02:08 PM ben leinfelder

add comment (and commented out code) for possibly inspecting the /dirtySysMeta call for archive=true flag. https://projects.ecoinformatics.org/ecoinfo/issues/6417

8596 02/13/2014 12:01 PM ben leinfelder

only index event information for known events. https://projects.ecoinformatics.org/ecoinfo/issues/6346

8595 02/13/2014 11:12 AM Peter Slaughter

call getDescription on cn.setaccesspolicy service failure

8594 02/12/2014 01:56 PM ben leinfelder

make all objects in a package publicly readable when published. https://projects.ecoinformatics.org/ecoinfo/issues/6415

8593 02/11/2014 02:19 PM Jing Tao

Add the code to check if the docid contains the whitespaces in the handleInsertOrUpdate, handleUpload and handleInsertMultipartInsertAction methods.

8592 02/11/2014 02:15 PM Peter Slaughter
8591 02/11/2014 01:43 PM ben leinfelder

make all package contents publicly readable when publishing with a DOI. https://projects.ecoinformatics.org/ecoinfo/issues/6415

8590 02/11/2014 01:29 PM Peter Slaughter

Run syncAll in a single thread so admin config UI doesn't freeze

8589 02/11/2014 11:05 AM Chris Jones

Change CnodeService.archive() to no longer broadcast MN.archive() calls to all of the replica MNs of a pid, but rather broadcast MN.systemMetadataChanged().

8588 02/10/2014 04:17 PM ben leinfelder

allow utf-8 user first/last names to be used in responses for: login, logout, validatesession, getprincipals.

8585 02/10/2014 11:52 AM ben leinfelder

Couple modifications:
-use "pid" throughout so as not to confuse docids and pids
-ensure any failures in the set do not prevent synching for other pids in the set

8581 02/07/2014 02:20 PM ben leinfelder

adjust whitespace for consistency

8579 02/07/2014 12:40 PM Peter Slaughter

sync pids of <distribution><online> data objects with CN when their access rules change in EML 2.0.* <additionalMetadata>

8578 02/07/2014 09:20 AM ben leinfelder

restrict the archived=false update to revisions that still have current entries in the xml_documents table.

8577 02/06/2014 05:36 PM ben leinfelder

tested the restore insertions - adjusted for FK constraints. I was able to delete a document locally, then restore it, then update the document with a new revision as expected.

8576 02/06/2014 03:03 PM ben leinfelder

use 'with' query to find the most recent revision of an object that was archived. still want more feedback on the criteria.

8575 02/06/2014 02:42 PM Jing Tao

Modified the usage.

8574 02/06/2014 11:56 AM ben leinfelder

continue to work on the criteria for selecting documents to restore.
expanded the criteria for setting archived=false to include any revision that was already obsoleted_by somethign else.

8572 02/05/2014 02:18 PM ben leinfelder

correct syntax - add more criteria for selecting documents.

8566 02/05/2014 01:55 PM ben leinfelder

do not set sm.archived=true when generating system metadata for objects that come in via the old Metacat API.

8565 02/05/2014 01:50 PM ben leinfelder

draft of fix for erroneously archived documents - first discovered by LTER - but also applicable to other Metacat MNs that still use the Metacat API as of Jan 2014 CN changes.

8564 02/05/2014 01:24 PM Jing Tao

Modify the usage message.

8563 02/05/2014 09:43 AM Jing Tao

Use a DN name for the group in the usage message printout.

8561 02/04/2014 02:25 PM Peter Slaughter

Fixed bug where sync'ing not working when CN had more access rules than MN

8560 02/04/2014 02:24 PM Peter Slaughter

Sync access policy between MN -> CN when access rules are updated in EML 2.1+ for data object

8556 02/03/2014 03:35 PM Jing Tao

Remove code to add the organzation in the search filter. This is not necessary since we use the dn as the search base. The code was not actually used but caused some problem.

8555 02/03/2014 02:56 PM ben leinfelder

use v2.4.0 for documentation and upgrade scripts.

8553 02/03/2014 02:52 PM ben leinfelder

can only log events with a valid localId.

8549 01/31/2014 03:09 PM Jing Tao

Add a note to let users know where to run the script.

8548 01/31/2014 02:49 PM Jing Tao

Add a note to let user know he/she should use single quotes to surround the hashed password.

8547 01/31/2014 02:35 PM ben leinfelder

edit some of the user management phrases. use UTF-8 for all returned XML. https://projects.ecoinformatics.org/ecoinfo/issues/6320

8540 01/30/2014 02:47 PM Jing Tao

Use an array of a hash to keep the orgName/orgLabel pair.

8535 01/24/2014 06:56 PM Jing Tao

Fixed a bug that AuthFile constructor didn't read the new value of the password file path from the metacat.properties.

8534 01/24/2014 05:17 PM Jing Tao

Add the code to handle a runtime exception.