Activity
From 08/13/2011 to 09/11/2011
09/11/2011
- 06:41 PM Revision 6411 (metacat): Add stub methods in CNodeService that implement the Hazelcast EntryListener interface: entryAdded(), entryRemoved(), entryUpdated(), and entryEvicted(). Add a listener to the hzSystemMetadata map so the CNodeService can respond to those events and create appropriate CNReplicationTask objects for distributed execution across the CN cluster. Again, stubs only so far.
- 06:27 PM Revision 6410 (metacat): Minor cleanup - tabs to spaces.
- 06:26 PM Revision 6409 (metacat): Enable CNodeService to access 1) the hzNodes map defined in the DataONE process cluster by becoming a Hazelcast client (hzClient) to that cluster and 2) the hzSystemMetadata map defined in the DataONE storage cluster by becoming a member to that cluster (using direct Hazelcast calls). Added fields for maintaining the DataONE cluster properties.
- 06:16 PM Revision 6408 (metacat): Add properties for strings used to connect to the DataONE storage and process Hazelcast clusters. The storage cluster is defined in the hazelcast.xml config file, and we list the names of the systemMetadataMap and the tasksIdNamespace in order to connect to these structures. When creating CNReplicationTask objects, use the task id generator to get a unique task id.
- 06:12 PM Revision 6407 (metacat): Add in the Hazelcast Id generation namespace and an IdGenerator instance for task ids. Hazelcast will produce cluster-wide unique ids for the "task-ids" namespace, to be used when creating CNreplicationTask objects.
- 05:29 PM Revision 6406 (metacat): Add the hazelcast client jar so Metacat can connect to the DataONE storage cluster that initializes the hzNodes shared node map and other structures as needed.
- 03:28 PM Revision 6405 (metacat): Add a CNReplicationTask class that will be submitted to the CN storage cluster when there are changes to the object store involving system metadata, science metadata, and resource maps. When a new entry is added to the hzSystemMetadata map, a new data, science metadata, or resource map was added to the VO, and all CN cluster members need to be updated with the object and it's system metadata. This task is executed on each CN to replicate the information. If the event is an update to an existing system metadata entry, it may only involve a change to system metadata, or may involve a change to science metadata as well. The task will return with the PID of the object replicated, be it a sysmeta, scimeta, or resource object. Locking of the PID will be handled by the task.
- 12:24 PM Revision 6404 (metacat): Update test for getReplicationStatus to reflect API change.
- 12:22 PM Revision 6403 (metacat): Newest version of the D1 0.6.4 common jar.
- 12:20 PM Revision 6402 (metacat): Catch D1nodeService up to the DataONE 0.6.4 schema where there is no ObjectFormat.isScienceMetadata() method, but rather ObjectFormat.getFormatType() where type is currently one of 'DATA, 'METADATA', or 'RESOURCE'.
- 12:12 PM Revision 6401 (metacat): Modify HazelcastService to read configuration information from an on-disk file (not from a jar file). Added init() to start up the service (was calling doRefresh() before. We still need to decide if this is a refreshable service.
- 12:10 PM Revision 6400 (metacat): Add the dataone.hazelcast.configFilePath property to be used when MetacatServlet becomes a Hazelcast cluster member using HazelcastService. TODO: what are the consequences of restarting the service via doRefresh()? It's set to false for now.
09/08/2011
- 02:23 PM Revision 6399 (metacat): move HazelcastService to D1 package
- 07:27 AM Revision 6398 (metacat): Adding a HazelcastService for Metacat to enable Metacat as a Hazelcast cluster member in DataONE. This will require the hazelcast.xml configuration file used for the DataONE cluster to be on the Metacat classpath.
09/07/2011
- 05:16 PM Revision 6397 (metacat): changes for schema update (d1_common)
- 02:22 PM Revision 6396 (metacat): do not parse from last slash ("/") to the end when processing the request uri - otherwise things like format ids (text/csv) will be handled incorrectly.
- https://redmine.dataone.org/issues/1773
09/06/2011
- 02:33 PM Revision 6395 (metacat): added HazelCast MapStore and MapLoader implementation for SystemMetadata
- 11:55 AM Revision 6394 (metacat): use InvalidRequest when the PID is not found. https://redmine.dataone.org/issues/1768
09/02/2011
- 02:21 PM Revision 6393 (metacat): remove unused dataone properties
- 02:13 PM Revision 6392 (metacat): use 0.6.4 for node capabilities
- 01:57 PM Revision 6391 (metacat): use Permission.REPLICATE not EXECUTE
- 01:41 PM Revision 6390 (metacat): check with the CN if replication is allowed for the object in question for getReplica()
- 12:45 PM Revision 6389 (metacat): add getReplica() implementation. same as get() but with different logging. seems silly, but maybe I missed something important that distinguishes this method.
08/31/2011
- 03:20 PM Revision 6388 (metacat): Rolling back inadvertent commit on test.properties. Doh.
- 03:18 PM Revision 6387 (metacat): Incomplete - task : Getting started with your first Spring web application development project
- 02:39 PM Revision 6386 (metacat): Update MetacatPopulator to use the DataONE 0.6.4 schema and types.
- 02:37 PM Revision 6385 (metacat): Update tests to use the DataONE 0.6.4 schema and types.
- 02:36 PM Revision 6384 (metacat): Update classes to use the DataONE 0.6.4 schema and types. Major changes involve using BigInteger vs long in SystemMetadata.size, and using ObjectFormatIdentifier rather than Object format.
- 02:33 PM Revision 6383 (metacat): Update DataONE jar files to 0.6.4. Updated classes to follow.
Also available in: Atom