Metacat

In InsertORETest: Set the format ID of the metadata object to an EML formatId so that it gets indexed correctly.

Add a test class that inserts an ORE with PROV relationships

use mock CN for testing metacat implementations

remove unused tests

add support for v2 DataONE API.

take advantage of the ezidclient for multi-threaded/asynchronous DOI registration. This will be most useful for doing large batch updates and not so much for the one-at-a-time publish actions but works in either context. https://projects.ecoinformatics.org/ecoinfo/issues/6440

correct the ORE lookup query syntax and add junit assertion to check that it continues to function as expected. https://projects.ecoinformatics.org/ecoinfo/issues/6529

Fixed compile error that an ioexception should be caught.

Reviewed code for all uses of FileInputStream, checking to see if the method should be closing the stream, and if so, closing it in the method as well as in the finally clause to ensure we don't leak file descriptors.

test that d1 node admin is allowed all permissions. https://projects.ecoinformatics.org/ecoinfo/issues/6086

test for configured target url template on metadata using the default #view url. https://projects.ecoinformatics.org/ecoinfo/issues/6092

default to non-https when testing localhost. If the developer has a hostname configured with https, it will correctly use this configured baseUrl, otherwise it will just use http://localhost.

MN.getPackage() - test with ORE that includes 2 data files and a "metadata" file (still should be using EML for that test). https://projects.ecoinformatics.org/ecoinfo/issues/6026

First pass at MN.getPackage() implementation using Bagit library from LOC. https://projects.ecoinformatics.org/ecoinfo/issues/6026

add method for publishing existing object (usually assumed to be scimeta) with a DOI. https://projects.ecoinformatics.org/ecoinfo/issues/6014

correct regex for whitespace in D1 identifier.

Add code to test title for the query result.

Rewrite some methods, so the query result can be processed many times.

Removed the commented out text cases and add a test for archvied document.

Call setting certificate location to be the test one after getting the MN baseurl.
The method to getting MN baseurl somehow calls CN and it set the certificate location to be /var/metacat/certs/METACAT1.pem.

Use the MNode to query the server when we use certificates to set up the session.

Add the code to test the user with a distrusted certificate.

Add tests to test group and rightsholder.

Change the delete to archive.

Add a test for testing access control for the solr query.

use maven to manage most jar dependencies in Metacat.
Exceptions include: LSID, Datamamager (EML),

lookup the title for EML files when registering DOIs.
lookup the creator from DataONE CN (if available).
add EML-based test. http://bugzilla.ecoinformatics.org/show_bug.cgi?id=5513

include the create test in the suite

Correctly mint and register DOIs in teh MN API implementation. Add tests to exercise minting and creating. http://bugzilla.ecoinformatics.org/show_bug.cgi?id=5513

return from test when we encounter the NotImplemented exception for CN.search()

CN.search() id not implemented by metacat -- making that explicit and also testing for it.

In migrating to Hazelcast 2.4.x, replace deprecated methods.

use CN session when testing getLogRecords() and getOperationStatistics() becuase they are now protecting "sensitive" information

include testSynchronizationFailed() and call as the CN subject so that it is authorized.

use MN (self) as the Session.subject so that the MN.delete() call is successful.

comment out testDelete because it requires acting as the MN
comment out testSynchronizationFailed because it requires acting as the CN

uncomment the MN tests (I bet this was an oversight during local testing)

change ordering of getLogRecords() parameter -- pidFilter is in the middle now

upgrade to latest RC in libclient and common jars -- includes updated getLogRecords and new mn.generateIdentifier method

Add testIsEquivIdentityAuthorized() to ensure that [MN|CN].isAuthorized() is authorizing equivalent identities correctly. Note: Using TypeMarshaller.marshalTypeToOutputStream(type, System.out) to serialize an object seems to jack up output to stdout - not sure why.

Update the MNodeServiceTest to test the validity of the node document returned by getCapabilities() by parsing it with the TypeMarshaller.

use RC-1 Dataone jars

remove method: assertRelation
https://redmine.dataone.org/issues/2158

Use a Date with resolution to milliseconds.

update tests to comply with these chenages:
new jars with many changes -- including new CN methods: ping, describe, listChecksumAlgorithm. Removed MN.setAccessPolicy. Refactored CN.setOwner() to CN.setRightsHolder().

for test to compile, provide BaseException param for setReplicationStatus. I used a NotAuthorized instance.

fix tests:
-insert default objectFormatList from d1_common (includes schemaLocation now)
-calculate checksum for the system metadata using the ChecksumUtil in d1_common

catch all possible exceptions

act as a registered CN when calling CN methods -- create(), for example, is restricted to only be callable by a node of type CN.

when comparing D1 Subject objects, use the equals() method not direct string comparison
https://redmine.dataone.org/issues/2050

upgrade to 1.0.1-SNAPSHOT DataONE jars

MockCNode.getSystemMetadata() no longer throws InvalidRequest.

remove catch blocks for unthrown exceptions

Add a test for systemMetadataChanged. This should be fleshed out more so that the test uses a CN certificate.

check object format id values since they are not Comparable objects

make MNodeServiceTest pass JUnit testing

Update CNodeService test to include serialVersion in it's calls as appropriate.

restore -- apparently this was used with reflection in a test...

MN.setAccessPolicy() is deprecated, commenting out the test.

removing non-junit file from the test area

load hazelcast test files from the classpath rather than from rob's personal directory.

SystemMetadataManager's functionality is handled by IdentifierManager. Removing it and it's test.

MetadataTypeRegister is now replaced by ObjectFormatService. Removing it and it's test.

move the DataONE 1.0.0-SNAPSHOT

add User-Agent logging to support D1 requirements

update D1 jars to include recent SubjectList -> SubjectInfo refactoring and the SUBJECT_PUBLIC constant

use an actual data object (bytes of "test") when generating system metadata so that the checksum is a valid checksum

test relationship assertion using obsoletes

move bulk of the Hazelcast code into HazelcastService from CNodeService so that it is centrall located - easier to manage and configure

cleaned up mock tests on hzObjectPathMap. split out code for mocking a datastore into MockObjectPathMap.

initialize Hazelcast from the custom configuration when initializing the Metacat service.

exercise the shared hazelecast system metadata map and custom loader/store by inserting normally and also directly into the map. both mechanisms allow up to read the same system metadata (only tested on single local instance)

test hzSystemMetadata Map and custom loader

copied default hazelcast configuration from the jar into hazelcast.test.properties.xml, to get instances to talk to each other.

configuring hazelcast tests

further refactoring and start of unit tests for hazelcast elements

return the test Identifier so other tests can piggyback

Update test for getReplicationStatus to reflect API change.

changes for schema update (d1_common)

Update tests to use the DataONE 0.6.4 schema and types.

latest D1 jars - changes include:
updateSystemMetadata() impl for CN
new identifier methods (generate is its own method)
removal of the resourceMap pointer from system metadata

refactor Constants

refactor Constants and ServiceTypeUtil

use new "v1" types from DataONE

remove CrudService -- replaced by MNodeService and CNodeService

reset object input stream (testGet)
check for reserveIdentifier NotImplemented (expected)

Return the new pid (not the obsoleted pid) on update(), and set the correct system metadata.

include Mock version of looking up the base url for our own node - for testReplicate().
still expecting a failure during MN.replicate() since we are trying to add the replica to the same MN from which it came.

allow alternative CNode implementations (subclasses) to be returned when D1Client.getCN() is called. The alternative is given in the Settings configuration via the D1Client.cnClassName property.
MockCNode in Metacat is an example of such an alternative and is used when Metacat requires methods of a CN be present for unit testing.

Test that the obsoletes and derivedFrom system metadata fields were set correctly.

use objectFormatIdentifier for listObjects()
remove provisional system metadata indicator - Metacat will not implement reserveIdentifier()

add test for synchronization failed -- TODO: verify that the log record made it in the logs

provisional replicate() implementation -- does not check if the session's subject is "allowed" to do this.
the test also requires 2 servers -- right now it attempts to replicate with itself which will fail because of duplicate IDs

provisional version of getOperationStatistics() -- not clear if we are meant to aggregate by hour or by day

include test for replicate() method -- still fails as not implemented

allow null objects (use default checksum)

wire-up the getCapabilities() and getOperationStatistics() methods for when they are actually implemented (tests fail now)

test listObjects()

include MNAuthorization tests

refactor to use common superclass D1NodeServiceTest for shared methods