Project

General

Profile

Activity

From 04/05/2012 to 05/04/2012

05/04/2012

04:29 PM Bug #5518: Track down the performance issue of metacat query.
Yeah. Kepler issues a query for different metadata type because the ecogrid could handle only one return doctype. I b... Jing Tao
03:26 PM Bug #5518: Track down the performance issue of metacat query.
Running the same query (well, with "Insect" (not plural) so the results were not cached) with 50 threads makes this p... ben leinfelder
02:43 PM Bug #5518: Track down the performance issue of metacat query.
I wrote a small test that issues the same Metacat query to a given server with parallel threads (25 for this example)... ben leinfelder
02:50 PM Revision 7167 (metacat): test for running concurrent Metacat queries to mimic Kepler data search.
http://bugzilla.ecoinformatics.org/show_bug.cgi?id=5518 ben leinfelder

05/02/2012

04:21 PM Revision 7166 (metacat): check if person's equivalentIdentity list is null before processing recursively
https://redmine.dataone.org/issues/2689 ben leinfelder
03:59 PM Revision 7165 (metacat): D1 common lib AuthUtils update
ben leinfelder
03:47 PM Bug #5518: Track down the performance issue of metacat query.
There seems to be renewed concern that this is not resolved.
During the Kepler/sensor workshop Matt reported query pe...
ben leinfelder
09:11 AM Revision 7164 (metacat): include testSynchronizationFailed() and call as the CN subject so that it is authorized.
ben leinfelder
09:06 AM Revision 7163 (metacat): use MN (self) as the Session.subject so that the MN.delete() call is successful.
ben leinfelder
08:58 AM Revision 7162 (metacat): handle authorization for delete() differently for CN vs MN.
On the CN, only the CN (or tbd admin user) can call it.
On the MN, both the CN (or admin user) and the _same_ MN can ...
ben leinfelder

05/01/2012

02:55 PM Revision 7161 (metacat): comment out testDelete because it requires acting as the MN
comment out testSynchronizationFailed because it requires acting as the CN ben leinfelder
02:49 PM Revision 7160 (metacat): uncomment the MN tests (I bet this was an oversight during local testing)
ben leinfelder
02:48 PM Revision 7159 (metacat): add Session-less archive() method
ben leinfelder
11:59 AM Revision 7158 (metacat): jars with CN/MN.archive() libclient implementations
ben leinfelder
11:14 AM Revision 7157 (metacat): only admin users can call MN/CN.delete(). This is limited to any CN and only the MN that is calling itself
ben leinfelder
10:47 AM Revision 7156 (metacat): update the sysmeta data modified when setting archived=true
https://redmine.dataone.org/issues/882 ben leinfelder
10:26 AM Revision 7155 (metacat): handle CN.archive() rest call: PUT /archive/{pid}
https://redmine.dataone.org/issues/2678 ben leinfelder
10:25 AM Revision 7154 (metacat): correct log about 'archive' being called
ben leinfelder
10:15 AM Revision 7153 (metacat): handle 'archive' rest calls
https://redmine.dataone.org/issues/2678 ben leinfelder
10:15 AM Revision 7152 (metacat): updated d1 jars
ben leinfelder
09:18 AM Revision 7151 (metacat): [optionally] do not archive the xml_documents and xml_nodes to *_revisions when 'deleting' a document. This will effectively guarantee that the document/data cannot be retrieved after delete.
NOTE: D1 system metadata will persist (for now) so that the ID cannot be reused with the DataONE API but Metacat call... ben leinfelder

04/30/2012

04:03 PM Revision 7150 (metacat): optionally remove the document/data file from the filesystem completely when 'deleting' it.
https://redmine.dataone.org/issues/2677 ben leinfelder
03:42 PM Revision 7149 (metacat): newer d1 jars that include shared AuthUtilsmethod for isAuthorized() consistency
https://redmine.dataone.org/issues/2661 ben leinfelder
03:35 PM Revision 7148 (metacat): implement MN and CN.archive() method -- really just the existing delete() methods.
https://redmine.dataone.org/issues/2674
https://redmine.dataone.org/issues/2675
ben leinfelder
03:05 PM Revision 7147 (metacat): call MN.delete() for each replica when CN.delete() is called
https://redmine.dataone.org/issues/2676 ben leinfelder
02:20 PM Revision 7146 (metacat): defer to AuthUtils for flattening out the equivIdent subject list.
https://redmine.dataone.org/issues/2661 ben leinfelder

04/27/2012

10:24 AM Revision 7145 (metacat): check normal access control rules for getSystemMetadata before deferring to MN replica information that may grant MNs additional access to the SM.
https://redmine.dataone.org/issues/2656 ben leinfelder

04/25/2012

03:33 PM Revision 7144 (metacat): include Session-less interface methods and updated jars that define them.
ben leinfelder

04/24/2012

10:42 AM Revision 7143 (metacat): use a shared ExecutorService for replicate() calls.
https://redmine.dataone.org/issues/2623 ben leinfelder

04/19/2012

02:04 PM Revision 7142 (metacat): remove extraneous pid and permission parameters from isAdminAuthorized() method and make public so that it can be called in other locations - namely before our asynchronous replicate() implementation on the MN.
ben leinfelder
01:50 PM Revision 7141 (metacat): check for empty null (missing) node.subjectList. This should probably be a required element in the D1 schema, but it appears not. (ORNL entry was missing subjects in cn-dev environment)
ben leinfelder
11:57 AM Revision 7140 (metacat): just use the e.getMessage() as e.getCause() may be null (seeing NPE when testing via the MN IT tester)
ben leinfelder

04/18/2012

04:04 PM Revision 7139 (metacat): check for empty null (missing) node.subjectList. This should probably be a required element in the D1 schema, but it appears not. (ORNL entry was missing subjects in cn-dev environment)
ben leinfelder

04/17/2012

04:02 PM Revision 7138 (metacat): added 2.0.0 targeted bugs to the release notes and fleshed out other major enhancements in the list
ben leinfelder
03:15 PM Revision 7137 (metacat): no not record EML access rules that use the "denyFirst" permOrder.
https://redmine.dataone.org/issues/2614 ben leinfelder
09:20 AM Revision 7136 (metacat): needed to initialize the nodeList that stores matching nodes (by subject) -- this was the source of a NPE when we had a matching node subject.
ben leinfelder

04/16/2012

05:38 PM Revision 7135 (metacat): do not create docid-guid mapping unless we are supposed to write access rules for the data to the dbase
https://redmine.dataone.org/issues/2572 ben leinfelder

04/13/2012

04:40 PM Revision 7134 (metacat): As Ben suggested, don't compare to the node list if there are no replicas listed. This reduces the number of calls to listNodes() on the CN.
Chris Jones
04:32 PM Revision 7133 (metacat): Minor logging change in throwing ServiceFailure when Hazelcast throws a RuntimeException.
Chris Jones
04:07 PM Revision 7132 (metacat): Modify getSystemMetadata() to allow nodes that are listed as replicas to access the system metadata. Use the Session.Subject to find a list of nodes from the CN that match the subject, and compare those node ids to the listed replica node ids. Add listNodesBySubject() helper method to do so.
Chris Jones
07:54 AM Revision 7131 (metacat): release notes for 2.0.0
ben leinfelder

04/12/2012

04:28 PM Revision 7130 (metacat): correct typo for "dataone.mn.services.enabled" property on the admin screen checkbox
ben leinfelder

04/10/2012

10:42 AM Revision 7129 (metacat): save backup properties before attempting node registration/update so that we don't "forget" the user input
ben leinfelder

04/09/2012

03:18 PM Revision 7128 (metacat): add a parameter for optionally writing EML-embedded access control rules to the Metacat DB.
https://redmine.dataone.org/issues/2584
https://redmine.dataone.org/issues/2583
ben leinfelder

04/06/2012

04:22 PM Revision 7127 (metacat): added comments and logging about https://redmine.dataone.org/issues/2572
ben leinfelder
03:01 PM Revision 7126 (metacat): generalize the exception handling because our actions are the same no matter what the specific error is during create - we just notify the CN that the replicate call failed
ben leinfelder
02:58 PM Revision 7125 (metacat): catch general Exception that may be thrown during MN.replicate() when creating the object locally. There are a few records that keep slipping off our radar with no explanation as to why they remain in "REQUESTED" status.
ben leinfelder
01:53 PM Revision 7124 (metacat): do not download data at this point
ben leinfelder
01:53 PM Revision 7123 (metacat): catch errors for each localid we are processing so that they do do prevent other ids from having ORE content generated
ben leinfelder
01:52 PM Revision 7122 (metacat): additional debug logging for tracking down MN replication errors
ben leinfelder
01:35 PM Revision 7121 (metacat): only 2.1.0 EML docs for ORE generation right now...
ben leinfelder

04/05/2012

04:28 PM Revision 7120 (metacat): band-aid for CN-CN replication permOrder issue when access control is embedded in EML and the system metadata is replicated before the EML. we just log the inconsistency and allow the insert to succeed
https://redmine.dataone.org/issues/2583 ben leinfelder
03:05 PM Revision 7119 (metacat): It looks like jk.conf and workers.properties were moved in the scripts dir: update the install docs accordingly.
Chris Jones
02:56 PM Revision 7118 (metacat): Fixed a minor typo in the tomcat config section.
Chris Jones
 

Also available in: Atom