| Revision:

metacat @ 5397

# Date Author Comment
5397 06/23/2010 03:45 PM berkley

MetacatPopulator is now working. It allows you to do a query from one metacat instance, then insert any returned docs into another metacat instance

5396 06/23/2010 01:56 PM berkley

d1client jar

5395 06/23/2010 01:54 PM berkley

cleanup of 'fixed' ResourceHandler

5394 06/23/2010 12:25 PM berkley

tracked down streaming bug. now need to figure out a better way to fix it.

5393 06/16/2010 09:43 AM berkley

added getValue() to the guid so that it prints the guid and not an object id

5392 06/15/2010 04:13 PM berkley

added a DataOneLogger for event notifications on the CN. The logger is called DataOneLogger and can be managed in the file

5391 06/15/2010 03:40 PM berkley

finished getLogRecords. Fixed some date bugs in metacat.

5390 06/15/2010 12:49 PM berkley

adding getlogrecords to the rest interface.

5389 06/15/2010 11:19 AM berkley

changed getLogRecords to use new classes for log events

5388 06/15/2010 10:45 AM berkley

new service layer jar

5387 06/14/2010 04:40 PM berkley

fixed bug in metacat that allowed attribute data to be appended to element data in returnfields

5386 06/14/2010 02:08 PM berkley

fixed bugs associated with crud access control changes.

5385 06/11/2010 05:00 PM ben leinfelder

starting point for semtools skin. augmenting default skin with Annotation documents.
not yet semantically enhanced search capabilities, but you can see a listing of both EML and Annotations on the server.

5384 06/10/2010 04:11 PM berkley

implementing getLogRecords

5383 06/10/2010 02:21 PM berkley

added EventLog statements to all public methods in CrudService in preparation for addin the getLogRecords() method

5382 06/10/2010 11:03 AM berkley

added better debugging error messages for CN dev errors

5381 06/10/2010 09:51 AM berkley

added generateMissingSystemMetadata to the ResourceHandler so it is now available via a REST call.

5380 06/10/2010 09:47 AM berkley

made the test functional so that it checks that missing system metadata will be created.

5379 06/09/2010 05:03 PM berkley

mostly done with generating systemmetadata from legacy knb docs. need to write a better test and enable this through the ResourceHandler then it will be done.

5378 06/09/2010 04:21 PM berkley

working on getting systemmetadata creation working for legacy knb objects

5377 06/09/2010 02:24 PM berkley

working on a function to create dataone system metadata docs for legacy metacat objects that do not have SM.

5376 06/09/2010 12:21 PM berkley

moved authentication checking out of ResourceHandler and into CrudService

5375 06/08/2010 03:30 PM berkley

added a test for access control changes

5374 06/08/2010 12:34 PM berkley

refactored the sessionService to use a correct singleton initialization scheme. Added true authentication to ResourceHandler.

5373 05/27/2010 01:26 PM berkley

new class to handle system metadata tasks in metacat

5372 05/25/2010 05:15 PM Jing Tao

Commit the change for Madhusudan Gujral from url = new;
to url = new;

5371 05/20/2010 10:59 AM berkley

added systemMetadata table to the upgrade scripts

5370 05/20/2010 09:52 AM berkley

listObjects is now working for rest calls as well as crud calls

5369 05/19/2010 10:25 AM berkley

added some params to the loop that segments the listObjects resultset

5368 05/18/2010 04:52 PM ben leinfelder

allow any nonquote characters in the schemaLocation attribute, otherwise the whole line is matched and this prevents schemaLocation from appearing anywhere but at the end of the line.

5367 05/18/2010 04:27 PM Jing Tao

Fixed bug the download link didn't work.

5366 05/18/2010 03:44 PM berkley

finished the crud part of listObjects. need to implement it in the rest interface now.

5365 05/18/2010 12:28 PM berkley

implementing getObjects in CrudService.

5364 05/18/2010 12:22 PM berkley

implementing getObjects in CrudService.

5363 05/18/2010 11:43 AM berkley

implementing getObjects in CrudService.

5362 05/17/2010 04:31 PM berkley

listObjects is almost working. need to get the result set parsed when returned to CrudService.

5361 05/17/2010 03:36 PM Jing Tao

Add a mapping between kar xml namespace and karxml.xsl.

5360 05/17/2010 03:34 PM Jing Tao

Add a style sheet to transform kar xml document.

5359 05/17/2010 11:50 AM berkley

setting up the framework for the listObjects api call

5358 05/17/2010 10:32 AM berkley

added the renamed Java classes for ObjectList

5357 05/14/2010 05:57 PM Jing Tao

Change the search query according to the karxml change.

5356 05/14/2010 02:55 PM berkley

changed the detailCode for DataOne exceptions to a string

5355 05/14/2010 11:18 AM berkley

added getSystemMetadata to ResourceHandler and changed the url format to be meta/guid. added a new servlet reponse handler in the web.xml file to handle the new urls and send them to the RestServlet.

5354 05/13/2010 04:28 PM Jing Tao

Change the return type from kar to the namespace.

5353 05/13/2010 02:29 PM berkley

implemented update in ResourceHandler and fixed a bug in CrudService where data files were not handled correctly on update

5352 05/12/2010 10:55 AM berkley

removed system.outs

5351 05/12/2010 10:42 AM berkley

update works. it was the test that was faulty. all working now

5350 05/11/2010 04:49 PM berkley

amost have update working. still need to get unit test squared away.

5349 05/11/2010 11:34 AM berkley

removed old method that didn't do anything

5348 05/11/2010 11:32 AM berkley

added exception testing to the crud test

5347 05/11/2010 10:58 AM berkley

added a new target to install the dataone schemas from a loca dir if you don't want svn calls being made during installation

5346 05/10/2010 04:36 PM berkley

getSystemMetadata is now working. added unit test as well.

5345 05/10/2010 04:35 PM berkley

adding stax jar. if this is somewhere else, i'll remove it, but i'm unable to find it anywhere in dataone

5344 05/10/2010 04:18 PM berkley

getting getSystemMetadata to work

5343 05/10/2010 02:59 PM berkley

adding test for getSystemMetadata. a bit of refactoring.

5342 05/10/2010 02:57 PM berkley

adding test for getSystemMetadata. a bit of refactoring.

5341 05/10/2010 02:54 PM berkley

adding test for getSystemMetadata. a bit of refactoring.

5340 05/10/2010 01:15 PM berkley

refactored XMLSchemaService to not have static methods. made the CrudServiceTest more robust.

5339 05/07/2010 04:30 PM berkley

removed system.outs

5338 05/07/2010 04:28 PM berkley

fixed schema location bug. the dataone schemas are now correclty found

5337 05/07/2010 03:15 PM berkley

removed CrudService dependency on servlet params. CrudService is now a singleton. I'm getting an error from metacat saying it can't find teh systemmetadata schema, even though it is, in fact, registered with metacat. need to identify why this is happening.

5336 05/05/2010 09:55 PM Matt Jones

Fixed some minor documentation errors regarding the Harvester.

5335 05/03/2010 05:23 PM berkley

added a test for CrudService and added tests for IdentifierManager for each method

5334 05/03/2010 03:28 PM berkley

refactoring to remove duplicate code

5333 05/03/2010 03:05 PM berkley

adding a system to track system metadata documents for dataone

5332 04/29/2010 09:14 AM Matt Jones

Added initial implementation of getSystemMetadata and its associated REST service. Current implementation is returning a hardcoded system metadata document -- need to look up the real document for each guid and return that.

5331 04/29/2010 01:28 AM Matt Jones

Completed main parts of CrudService.create(). Now the method writes both data and metadata objects along with their system metadata, and handles the mapping between global identifiers and local identifiers. Access control and logging still need to be dealt with to properly authenticate and then log activities.

5330 04/29/2010 12:56 AM Matt Jones

Updating build to properly clear temporary export directory before doing svn export.

5329 04/28/2010 07:04 PM Matt Jones

Modify CrudService to write SystemMetadata to disk with an autogenerated localId and an autogenerated GUID. Validation depends on the DataONE schemas being setup in xml_catalog properly, so still need to check upgrade scripts to be sure these new schemas are added. Still need to handle the metadata document insert, but should be same as system metadata insert.

5328 04/28/2010 07:01 PM Matt Jones

Add support for getting the DataONE schemas from SVN and copying them into metacat's schema catalog. Still need to update the oracle scripts as well.

5327 04/28/2010 06:55 PM Matt Jones

Added comment about MIME form processing.

5326 04/28/2010 06:54 PM Matt Jones

Refactored schema service to call doRefresh() in constructor to eliminate code duplication.

5325 04/28/2010 06:52 PM Matt Jones

Added note on TODO for access bug.

5324 04/26/2010 04:11 PM berkley

replication of guids now works. tested this for both forced replication and update/insert/delete triggered replication

5323 04/26/2010 02:25 PM berkley

fixed bug where guid end tag wasn't getting printed

5322 04/26/2010 12:29 PM berkley

added a method in IdentifierManager to get a guid from a docid and rev. added fields in the documentinfo replication document to pass the guid. now need to handle the guid and insert it into the table if its found

5321 04/22/2010 04:54 AM Duane Costa

Add 'metacat/lib/oaipmh' directory to the list of required jar files in the 'Set up Metacat Dependencies' section.

5320 04/19/2010 10:14 PM Matt Jones

Refactored metacat to use dataone-service-api-0.3.0 jar file, with the new JIBX generated types and serialization. Included JIBX runtime jar in metacat to handle serialization and deserialization of SystemMetadata objects. Removed the old API jar file.

5319 04/19/2010 04:51 PM Matt Jones

Modifications to support the DataONE service API version 0.1.0. For DataONE, the get() and
create() services are partially complete. Several more functions and checks need to be added to
create() before it is viable. This DataONE support is not complete, and the current support breaks the MetacatRestClientTest for the time being (this client will eventually be removed).

5317 04/15/2010 09:47 AM daigle

Add a debug statement to show existing doc id

5316 04/15/2010 09:43 AM daigle

Move all user images into the dev image directory. Remove all but the MetacatAdministratorsGuide from the user dir.

5311 04/14/2010 11:31 AM daigle

Merge 1.9.2 changes back into the trunk

5304 04/07/2010 11:51 PM Matt Jones

Updated to use new name of dataone service API module.

5302 04/06/2010 06:03 PM Matt Jones

Adding commons-io jar for the IOUtils utilities for stream manipulation.

5301 04/06/2010 05:58 PM Matt Jones

Modified ResourceHandler to return error codes in XML format for the get() method.

5299 04/02/2010 06:54 PM Matt Jones

Modifications to metacat rest service to use the new DataONE CrudService for
get() operation. Minor issue with permissions errors propagating up the
stack, but otherwise this is the first implementation of a full DataONE

5298 04/02/2010 11:29 AM Matt Jones

Modified readFromMetacat() to pass most exceptions up the call stack, which
allows creation of new entry points for calling reads. Still need to
continue factoring out the HTTPServletResponse that is passed in in order to
make entrypoints that are not servlet based possible. Problem now is in...

5297 04/01/2010 04:30 PM Matt Jones

Excluding the Maven ant tasks jar from the metacat war distribution because
it is not needed (its only used to build dataone-service at build time, and
is unused at runtime), and it conflicts with jar files checked in for Spring
as part of the geoserver install. Also updated dataone interface...

5295 03/24/2010 12:41 AM Matt Jones

Modified the build.xml to include a new task for building the dataone
service api package, which generates a jar file that is put into lib. This
task depends on maven being installed in maven.home, and depends on the
DataONE service_api being checed out in a sibling directory to the build....

5294 03/23/2010 08:37 PM Matt Jones

Updated the build to properly locate the servlet jar depending on which
version of tomcat is being used, tomcat5 or tomcat6.

5293 03/23/2010 01:13 PM ben leinfelder

when looking up group membership, skip referrals that have errors

5292 03/23/2010 12:56 PM ben leinfelder

skip referrals that have errors (connection timeout, host down, etc)

5291 03/22/2010 08:55 PM Matt Jones

Refactored putObject method to separate the create() and update() portions in order to match the method signatures needed for DataONE.

5287 03/18/2010 04:02 AM Matt Jones

Modified ResourceHandler.deleteObject() to take a globally unique id (guid)
as input rather than a metacat-conformant docid. The guid is translated
into a metacat docid which is then used in the handleDelete() call. So now
Metacat supports use of arbitrary identifiers for delete operations, but...

5286 03/18/2010 03:11 AM Matt Jones

Added support to ResourceHandler to allow the putObject method to use
arbitrary guid strings as input. These strings are examined, and if they
match the Metacat docid format (, they are used directly. If
the id is a string in another format, a new localId is generated based on...

5285 03/18/2010 03:06 AM Matt Jones

Adding a new property to be used as an identifier prefix by default.

5284 03/17/2010 11:27 PM Matt Jones

Updated MetacatRestClientTest so that the tests are actually calling fail()
when errors occur, and fixed all sixteen tests so that they run successfully
and can be run from any client (i.e., they don't depend on particular
documents being present in Metacat). The 'restfiles' directory can probably ...

5283 03/17/2010 11:22 PM Matt Jones

Fixed bug in getNextRevision() where "error" documents were not being
detected properly before searching for the next identifier.

5282 03/17/2010 06:54 PM Matt Jones

Added initial support for arbitrary string identifiers in metacat (referred to as a guid). The new identifier table is used to map arbitrary string identifiers to Metacat's current docid format (referred to as the localId). Added a new IdentifierManager class to manage this table, adding new mappings as objects are added to the system. Modified the MetacatTest service to utilize this mapping table to look up a localId from a guid. IdentiferManagerTest is working with these guids now, as is the MetacatTest service get() method, but other parts of the system are unaware of them (e.g., create, update, delete operations are unaware, and no mapping is created when new documents are created). As a consequence, the MetacatRestClientTest is not working (although it also had lots of hardcoded dependencies that need to be fixed as well).

5277 03/16/2010 02:12 AM Matt Jones

Added copyright, license, and class documentation.