Project

General

Profile

ben leinfelder's activity

From 08/29/2011 to 09/27/2011

09/26/2011

10:59 PM Metacat Revision 6525 (metacat): set date uploaded and date system metadata updated date to current time when calling MN.create() and MN.update()
ben leinfelder
02:46 PM Metacat Revision 6524 (metacat): updated d1_common jar (unknown changes)
ben leinfelder
02:45 PM Metacat Revision 6523 (metacat): use rfc2253 format when extracting certificate subject
ben leinfelder
12:07 PM Metacat Revision 6522 (metacat): do not allow system metadata to have obsoletes or obsoletedBy fields when calling the create() method -- these are only allowed for updates so that we do not subvert object versioning by [un]knowingly submitting system metadata that directs one id to another.
ben leinfelder
11:59 AM Metacat Revision 6521 (metacat): set the originating member node on update()
ben leinfelder
11:53 AM Metacat Revision 6520 (metacat): set the originating member node on create()
ben leinfelder
11:52 AM Metacat Revision 6519 (metacat): -use whatever object format id is stored in the DB
-only set originating node and authoritative node if we have non-null values for them ben leinfelder
11:10 AM Metacat Revision 6518 (metacat): set sysmeta submitter based on the subject given in the certificate
ben leinfelder
10:48 AM Metacat Revision 6517 (metacat): for default Metacat installation we turn off multicast and only enable localhost communication.
ben leinfelder
09:42 AM Metacat Revision 6516 (metacat): skip Objects that have null format ids are invalid checksums
ben leinfelder

09/23/2011

10:18 PM Metacat Revision 6515 (metacat): MN.setAccess() is a PUT
ben leinfelder
09:54 PM Metacat Revision 6514 (metacat): correctly handle incoming "accessPolicy" parameters for the setAccess() method
ben leinfelder
08:46 PM Metacat Revision 6513 (metacat): swap the parameters for update: existing pid should be first, and then newPid
ben leinfelder
01:44 PM Metacat Revision 6511 (metacat): do not require ID reservation before create() or update()
ben leinfelder
01:39 PM Metacat Revision 6510 (metacat): use "action" parameter instead of "permission"
ben leinfelder
01:38 PM Metacat Revision 6509 (metacat): use "action" parameter instead of "permission"
ben leinfelder

09/22/2011

03:57 PM Metacat Revision 6508 (metacat): catch datapackage parsing errors as before
ben leinfelder
03:30 PM Metacat Revision 6507 (metacat): include checksum algorithm when setting describe
https://redmine.dataone.org/issues/1799 ben leinfelder
03:30 PM Metacat Revision 6506 (metacat): check for null session before logging sync failed
https://redmine.dataone.org/issues/1798 ben leinfelder
02:22 PM Metacat Revision 6504 (metacat): use an actual data object (bytes of "test") when generating system metadata so that the checksum is a valid checksum
ben leinfelder
02:02 PM Metacat Revision 6503 (metacat): use Settings augmentation to customize the D1Client.CN_URL when used in a Metacat deployment.
ben leinfelder
02:01 PM Metacat Revision 6502 (metacat): correctly implement MN.describe
https://redmine.dataone.org/issues/1799 ben leinfelder
01:40 PM Metacat Revision 6501 (metacat): return Node not NodeList for getCapabilities
https://redmine.dataone.org/issues/1800 ben leinfelder
10:12 AM Metacat Revision 6496 (metacat): return null instead of throwing an exception when pid is not found in store
ben leinfelder
10:12 AM Metacat Revision 6495 (metacat): log errors on create() and registerSM
ben leinfelder
10:11 AM Metacat Revision 6494 (metacat): more stringent NP checking when saving replication policy
ben leinfelder

09/21/2011

05:45 PM Metacat Revision 6490 (metacat): comment out resynch() method until errors are resolved
ben leinfelder
05:25 PM Metacat Revision 6489 (metacat): use default hazelcast config when not configured to use an external one
ben leinfelder
05:24 PM Metacat Revision 6487 (metacat): comment out the external hazelcast config location for default building
ben leinfelder
05:24 PM Metacat Revision 6486 (metacat): include default hazelcast.xml in the war build
ben leinfelder

09/20/2011

02:32 PM Metacat Revision 6474 (metacat): newer d1 jars -- contains CN.isNodeAuthorized() method
ben leinfelder
02:12 PM Metacat Revision 6473 (metacat): explicitly require java 1.6
ben leinfelder
02:11 PM Metacat Revision 6472 (metacat): collect "message" param from multipart request for MN.synchronizationFailed method
ben leinfelder
11:55 AM Metacat Revision 6469 (metacat): use d1_common_java's date serialization utility for parsing parameters
ben leinfelder
10:48 AM Metacat Revision 6468 (metacat): catch runtime exceptions that arise from hazelcast storage errors in the system metadata map
ben leinfelder

09/19/2011

03:39 PM Metacat Revision 6460 (metacat): only include 0.6.4 schemas for D1. Will also need to update this when we release whatever v1 ends up being.
ben leinfelder
03:26 PM Metacat Revision 6459 (metacat): lookup latest system metadata update date for use in synchronizing CN-CN when an offline nodes comes back online
ben leinfelder
11:48 AM Metacat Revision 6457 (metacat): rework this to be MN->MN replication. Should be fleshed out more.
ben leinfelder
11:43 AM Metacat Revision 6456 (metacat): throw RuntimeExceptions when store() methods throw declared exceptions -- we want callers to put() to be alerted if there are errors.
ben leinfelder
10:18 AM Metacat Revision 6455 (metacat): move CNReplicationTask to the hazelcast package
ben leinfelder

09/16/2011

05:05 PM Metacat Revision 6454 (metacat): do not throw exception when checking for system metadata - boolean return is good.
use ReplicationStatus.valueOf() instead of convert() ben leinfelder
05:04 PM Metacat Revision 6453 (metacat): implicit success for setting accessPolicy - trust that the MapStore persists the updated system metadata
ben leinfelder
05:03 PM Metacat Revision 6452 (metacat): test relationship assertion using obsoletes
ben leinfelder
04:42 PM Metacat Revision 6451 (metacat): check if system metadata exists rather than just the id mapping (before creating the entry)
ben leinfelder
04:01 PM Metacat Revision 6450 (metacat): treat access rules atomically - do not group them together otherwise the intent is subverted
ben leinfelder
03:23 PM Metacat Revision 6449 (metacat): only "save" to the shared system metadata map - not directly to the table store.
ben leinfelder
03:17 PM Metacat Revision 6448 (metacat): do not send <systemMetadata> with the <docInfo> replication information - this is handled by the Hazelcast shared map
ben leinfelder
03:07 PM Metacat Revision 6447 (metacat): rely on Hazelcast to store the SystemMetadata locally for the node. Entry event listeners store the shared system metadata on their local node when alerted. TODO: remove old replication code that included system metadata xml when replicating scimeta and data
ben leinfelder
02:24 PM Metacat Revision 6446 (metacat): move bulk of the Hazelcast code into HazelcastService from CNodeService so that it is centrall located - easier to manage and configure
ben leinfelder
01:13 PM Metacat Revision 6445 (metacat): verify that the sysmeta checksum value matches the computed checksum value when calling create()
https://redmine.dataone.org/issues/1795 ben leinfelder
01:08 PM Metacat Revision 6444 (metacat): include sysmeta for uploaded BIN data that comes through the legacy Metacat servlet API
ben leinfelder
10:51 AM Metacat Revision 6443 (metacat): check for null pointers when adding system metadata/creating records during cn.create()
ben leinfelder

09/15/2011

01:57 PM Metacat Revision 6441 (metacat): allow urls with "v1" in them
ben leinfelder
12:59 PM Metacat Revision 6439 (metacat): remove unused/old D1 SCHEMA downloads and build tasks
ben leinfelder
12:58 PM Metacat Revision 6438 (metacat): remove unused/old D1 SCHEMA downloads and build tasks
ben leinfelder
12:57 PM Metacat Revision 6437 (metacat): initialize Hazelcast from the custom configuration when initializing the Metacat service.
ben leinfelder
12:56 PM Metacat Revision 6436 (metacat): use shared hazelcast properties location on the CN
ben leinfelder
10:40 AM Metacat Revision 6435 (metacat): handle entryAdded and entryUpdated the same - update the entry if it exists, otherwise create it
ben leinfelder
10:38 AM Metacat Revision 6434 (metacat): handle entryAdded (to hzSystemMetadata) to store sysmeta to local store when it is not already present
ben leinfelder
10:37 AM Metacat Revision 6433 (metacat): make isScienceMetadata() method public/static to be called throughout Metacat
ben leinfelder
10:01 AM Metacat Revision 6432 (metacat): only create ObjectFormatId when we actually have the parameter (downstream we rely on it being null or not when constructing the query)
ben leinfelder

09/14/2011

05:33 PM Metacat Revision 6431 (metacat): exercise the shared hazelecast system metadata map and custom loader/store by inserting normally and also directly into the map. both mechanisms allow up to read the same system metadata (only tested on single local instance)
ben leinfelder
05:30 PM Metacat Revision 6430 (metacat): add code to handle new entry when it is not on the local member of the sysmeta cluster
ben leinfelder
04:15 PM Metacat Revision 6429 (metacat): clean up imports - randome quicktime package had been included
ben leinfelder
03:18 PM Metacat Revision 6428 (metacat): test hzSystemMetadata Map and custom loader
ben leinfelder
03:17 PM Metacat Revision 6427 (metacat): comment out processCluster connections that use hzClient until that is finalized
ben leinfelder
03:16 PM Metacat Revision 6426 (metacat): use HashMap, HashSet instead of the Tree* classes that require Identifier objects implement Comparable
ben leinfelder
12:07 PM Metacat Revision 6423 (metacat): do not add obsoletes and obsoletedBy elements if their values are null (jibx chokes on the emptiness)
ben leinfelder
11:30 AM Metacat Revision 6422 (metacat): use both guid and docid when creating access row - then either mechanism can be used when retrieving the access rules
ben leinfelder
11:30 AM Metacat Revision 6421 (metacat): check for null session before looking at subject
ben leinfelder

09/13/2011

04:13 PM Metacat Revision 6419 (metacat): use pending replication task queue to check if node is authorized for replication. moved from old ReplicationService code
ben leinfelder
03:44 PM Metacat Revision 6418 (metacat): save system metadata and/or science metadata and/or ORE objects to the local CN if needed.
ben leinfelder

09/12/2011

09:34 AM Metacat Revision 6413 (metacat): return the test Identifier so other tests can piggyback
ben leinfelder
09:32 AM Metacat Revision 6412 (metacat): check session != null before checking authorization
ben leinfelder

09/08/2011

02:23 PM Metacat Revision 6399 (metacat): move HazelcastService to D1 package
ben leinfelder

09/07/2011

05:16 PM Metacat Revision 6397 (metacat): changes for schema update (d1_common)
ben leinfelder
02:22 PM Metacat Revision 6396 (metacat): do not parse from last slash ("/") to the end when processing the request uri - otherwise things like format ids (text/csv) will be handled incorrectly.
https://redmine.dataone.org/issues/1773 ben leinfelder

09/06/2011

02:33 PM Metacat Revision 6395 (metacat): added HazelCast MapStore and MapLoader implementation for SystemMetadata
ben leinfelder
11:55 AM Metacat Revision 6394 (metacat): use InvalidRequest when the PID is not found. https://redmine.dataone.org/issues/1768
ben leinfelder

09/02/2011

02:21 PM Metacat Revision 6393 (metacat): remove unused dataone properties
ben leinfelder
02:13 PM Metacat Revision 6392 (metacat): use 0.6.4 for node capabilities
ben leinfelder
01:57 PM Metacat Revision 6391 (metacat): use Permission.REPLICATE not EXECUTE
ben leinfelder
01:41 PM Metacat Revision 6390 (metacat): check with the CN if replication is allowed for the object in question for getReplica()
ben leinfelder
12:45 PM Metacat Revision 6389 (metacat): add getReplica() implementation. same as get() but with different logging. seems silly, but maybe I missed something important that distinguishes this method.
ben leinfelder
 

Also available in: Atom