Metacat

When calling SystemMetadata.getObjectFormat(), return the value of the ObjectFormatIdentifier rather than ObjectFormat.toString() (which no longer returns the fmtid string).

Merged in the D1_0_6_2_BRANCH changes that include the transition from ObjectFormat calls to ObjectFormatCache calls.

check system metadata for the id as well (in cases when we only have system metadata)

include GUID column for xml_access and related methods for storing/retrieving access rules

handle timed replication of system metadata. there are still a few outstanding issues:
-track server location of system metadata-only entries
-replication policy flag for system metadata-only entries?
-locking for replicated entries?
-forced replication of entries

read and write D1 access policy rules from metacat xml_access table.
still TBD: which mechanism takes precedence when there are systemMetadata access rules and EML access rules and other access rules?

persist system metadata replication policy and status using db tables

do not look in systemMetadata for a docid->guid mapping

-remove system metadata guid -> local id mapping (there is no document for system metadata now)
-include system metadata elements when replicating data objects (TODO: transfer all system metadata structures with the docinfo request).
TODO: remove docid+rev from the systemMetadata table definition

do not use XML files for storing SystemMetadata - use DB tables only.

In order to sync up with DataONE 0.6.1 changes, I'm backing out ObjectFormatService changes temporarily in Metacat. Most functionality will be rolled back in using the DataONE 0.6.2 tag, but some methods in ObjectFormatService (such as getListFromDisk()) will be moved into d1_libclient_java.

Changes in the DataONE ObjectFormat class deprecate the convert() method, and we're now using Metacat's ObjectFormatService to look up object format attributes. The following changes replace ObjectFormat.convert() with ObjectFormatService.getFormat() in several classes....

use update method to update the mapping between local and guid (d1) when we get a force replication request that is an "update

Modified IdentifierManager.getDocumentInfo() to include the docid in the returned hash map, since it is useful to be able to obtain the docid and rev separately from a given fullDocidWithRev (e.g. test.1.1).

fixed bug where the wrong checksum alg got written to the db

adding more debuggin and fixing bug with systemmetadata

fixed replication bug where systemmetadata was not getting procssed correctly

think I fixed the connection problem. one connection in IdentifierManager was being leaked. added more debug info in case it happens again

fixed typo that prevented replication

fixed problem with count in listObjects()

fixed bugs in listObjects

few bug fixes for listObjects

added code to do database query for listObjects

adding fields for additional system metadata info

fixes for creating SM for legacy docs

fixing generateSystemMetadata

still working on getting guid problems fixed with replication

fixed identifier manager problem with getting guid for systememtadaa doc

fixing problems with replication and systemmetadata

fixed more access control problems. also fixed extraneous white space that was getting put into the listobject output stream

fixed problems with access control on sysmeta

fixes for the access control setting for sysmeta

added functionality to set access permissions to system metadata the same as the document that it describes

fixed bug in access control where the sessionid was not correctly passed along so changes of privileges were not being made

working on getting systemmetadata creation working for legacy knb objects

working on a function to create dataone system metadata docs for legacy metacat objects that do not have SM.

removed system.outs

amost have update working. still need to get unit test squared away.

getting getSystemMetadata to work

refactoring to remove duplicate code

adding a system to track system metadata documents for dataone

added a method in IdentifierManager to get a guid from a docid and rev. added fields in the documentinfo replication document to pass the guid. now need to handle the guid and insert it into the table if its found

Added support to ResourceHandler to allow the putObject method to use
arbitrary guid strings as input. These strings are examined, and if they
match the Metacat docid format (scope.id.rev), they are used directly. If
the id is a string in another format, a new localId is generated based on...

Added initial support for arbitrary string identifiers in metacat (referred to as a guid). The new identifier table is used to map arbitrary string identifiers to Metacat's current docid format (referred to as the localId). Added a new IdentifierManager class to manage this table, adding new mappings as objects are added to the system. Modified the MetacatTest service to utilize this mapping table to look up a localId from a guid. IdentiferManagerTest is working with these guids now, as is the MetacatTest service get() method, but other parts of the system are unaware of them (e.g., create, update, delete operations are unaware, and no mapping is created when new documents are created). As a consequence, the MetacatRestClientTest is not working (although it also had lots of hardcoded dependencies that need to be fixed as well).