Project

General

Profile

Activity

From 08/13/2011 to 09/11/2011

09/11/2011

06:41 PM Revision 6411 (metacat): Add stub methods in CNodeService that implement the Hazelcast EntryListener interface: entryAdded(), entryRemoved(), entryUpdated(), and entryEvicted(). Add a listener to the hzSystemMetadata map so the CNodeService can respond to those events and create appropriate CNReplicationTask objects for distributed execution across the CN cluster. Again, stubs only so far.
Chris Jones
06:27 PM Revision 6410 (metacat): Minor cleanup - tabs to spaces.
Chris Jones
06:26 PM Revision 6409 (metacat): Enable CNodeService to access 1) the hzNodes map defined in the DataONE process cluster by becoming a Hazelcast client (hzClient) to that cluster and 2) the hzSystemMetadata map defined in the DataONE storage cluster by becoming a member to that cluster (using direct Hazelcast calls). Added fields for maintaining the DataONE cluster properties.
Chris Jones
06:16 PM Revision 6408 (metacat): Add properties for strings used to connect to the DataONE storage and process Hazelcast clusters. The storage cluster is defined in the hazelcast.xml config file, and we list the names of the systemMetadataMap and the tasksIdNamespace in order to connect to these structures. When creating CNReplicationTask objects, use the task id generator to get a unique task id.
Chris Jones
06:12 PM Revision 6407 (metacat): Add in the Hazelcast Id generation namespace and an IdGenerator instance for task ids. Hazelcast will produce cluster-wide unique ids for the "task-ids" namespace, to be used when creating CNreplicationTask objects.
Chris Jones
05:29 PM Revision 6406 (metacat): Add the hazelcast client jar so Metacat can connect to the DataONE storage cluster that initializes the hzNodes shared node map and other structures as needed.
Chris Jones
03:28 PM Revision 6405 (metacat): Add a CNReplicationTask class that will be submitted to the CN storage cluster when there are changes to the object store involving system metadata, science metadata, and resource maps. When a new entry is added to the hzSystemMetadata map, a new data, science metadata, or resource map was added to the VO, and all CN cluster members need to be updated with the object and it's system metadata. This task is executed on each CN to replicate the information. If the event is an update to an existing system metadata entry, it may only involve a change to system metadata, or may involve a change to science metadata as well. The task will return with the PID of the object replicated, be it a sysmeta, scimeta, or resource object. Locking of the PID will be handled by the task.
Chris Jones
12:24 PM Revision 6404 (metacat): Update test for getReplicationStatus to reflect API change.
Chris Jones
12:22 PM Revision 6403 (metacat): Newest version of the D1 0.6.4 common jar.
Chris Jones
12:20 PM Revision 6402 (metacat): Catch D1nodeService up to the DataONE 0.6.4 schema where there is no ObjectFormat.isScienceMetadata() method, but rather ObjectFormat.getFormatType() where type is currently one of 'DATA, 'METADATA', or 'RESOURCE'.
Chris Jones
12:12 PM Revision 6401 (metacat): Modify HazelcastService to read configuration information from an on-disk file (not from a jar file). Added init() to start up the service (was calling doRefresh() before. We still need to decide if this is a refreshable service.
Chris Jones
12:10 PM Revision 6400 (metacat): Add the dataone.hazelcast.configFilePath property to be used when MetacatServlet becomes a Hazelcast cluster member using HazelcastService. TODO: what are the consequences of restarting the service via doRefresh()? It's set to false for now.
Chris Jones

09/08/2011

02:23 PM Revision 6399 (metacat): move HazelcastService to D1 package
ben leinfelder
07:27 AM Revision 6398 (metacat): Adding a HazelcastService for Metacat to enable Metacat as a Hazelcast cluster member in DataONE. This will require the hazelcast.xml configuration file used for the DataONE cluster to be on the Metacat classpath.
Chris Jones

09/07/2011

05:16 PM Revision 6397 (metacat): changes for schema update (d1_common)
ben leinfelder
02:22 PM Revision 6396 (metacat): do not parse from last slash ("/") to the end when processing the request uri - otherwise things like format ids (text/csv) will be handled incorrectly.
https://redmine.dataone.org/issues/1773 ben leinfelder

09/06/2011

02:33 PM Revision 6395 (metacat): added HazelCast MapStore and MapLoader implementation for SystemMetadata
ben leinfelder
11:55 AM Revision 6394 (metacat): use InvalidRequest when the PID is not found. https://redmine.dataone.org/issues/1768
ben leinfelder

09/02/2011

02:21 PM Revision 6393 (metacat): remove unused dataone properties
ben leinfelder
02:13 PM Revision 6392 (metacat): use 0.6.4 for node capabilities
ben leinfelder
01:57 PM Revision 6391 (metacat): use Permission.REPLICATE not EXECUTE
ben leinfelder
01:41 PM Revision 6390 (metacat): check with the CN if replication is allowed for the object in question for getReplica()
ben leinfelder
12:45 PM Revision 6389 (metacat): add getReplica() implementation. same as get() but with different logging. seems silly, but maybe I missed something important that distinguishes this method.
ben leinfelder

08/31/2011

03:20 PM Revision 6388 (metacat): Rolling back inadvertent commit on test.properties. Doh.
Chris Jones
03:18 PM Revision 6387 (metacat): Incomplete - task : Getting started with your first Spring web application development project
Chris Jones
02:39 PM Revision 6386 (metacat): Update MetacatPopulator to use the DataONE 0.6.4 schema and types.
Chris Jones
02:37 PM Revision 6385 (metacat): Update tests to use the DataONE 0.6.4 schema and types.
Chris Jones
02:36 PM Revision 6384 (metacat): Update classes to use the DataONE 0.6.4 schema and types. Major changes involve using BigInteger vs long in SystemMetadata.size, and using ObjectFormatIdentifier rather than Object format.
Chris Jones
02:33 PM Revision 6383 (metacat): Update DataONE jar files to 0.6.4. Updated classes to follow.
Chris Jones
 

Also available in: Atom