From 04/05/2012 to 05/04/2012


04:29 PM Bug #5518: Track down the performance issue of metacat query.
Yeah. Kepler issues a query for different metadata type because the ecogrid could handle only one return doctype. I b... Jing Tao
03:26 PM Bug #5518: Track down the performance issue of metacat query.
Running the same query (well, with "Insect" (not plural) so the results were not cached) with 50 threads makes this p... ben leinfelder
02:43 PM Bug #5518: Track down the performance issue of metacat query.
I wrote a small test that issues the same Metacat query to a given server with parallel threads (25 for this example)... ben leinfelder
02:50 PM Revision 7167 (metacat): test for running concurrent Metacat queries to mimic Kepler data search. ben leinfelder


04:21 PM Revision 7166 (metacat): check if person's equivalentIdentity list is null before processing recursively ben leinfelder
03:59 PM Revision 7165 (metacat): D1 common lib AuthUtils update
ben leinfelder
03:47 PM Bug #5518: Track down the performance issue of metacat query.
There seems to be renewed concern that this is not resolved.
During the Kepler/sensor workshop Matt reported query pe...
ben leinfelder
09:11 AM Revision 7164 (metacat): include testSynchronizationFailed() and call as the CN subject so that it is authorized.
ben leinfelder
09:06 AM Revision 7163 (metacat): use MN (self) as the Session.subject so that the MN.delete() call is successful.
ben leinfelder
08:58 AM Revision 7162 (metacat): handle authorization for delete() differently for CN vs MN.
On the CN, only the CN (or tbd admin user) can call it.
On the MN, both the CN (or admin user) and the _same_ MN can ...
ben leinfelder


02:55 PM Revision 7161 (metacat): comment out testDelete because it requires acting as the MN
comment out testSynchronizationFailed because it requires acting as the CN ben leinfelder
02:49 PM Revision 7160 (metacat): uncomment the MN tests (I bet this was an oversight during local testing)
ben leinfelder
02:48 PM Revision 7159 (metacat): add Session-less archive() method
ben leinfelder
11:59 AM Revision 7158 (metacat): jars with CN/MN.archive() libclient implementations
ben leinfelder
11:14 AM Revision 7157 (metacat): only admin users can call MN/CN.delete(). This is limited to any CN and only the MN that is calling itself
ben leinfelder
10:47 AM Revision 7156 (metacat): update the sysmeta data modified when setting archived=true ben leinfelder
10:26 AM Revision 7155 (metacat): handle CN.archive() rest call: PUT /archive/{pid} ben leinfelder
10:25 AM Revision 7154 (metacat): correct log about 'archive' being called
ben leinfelder
10:15 AM Revision 7153 (metacat): handle 'archive' rest calls ben leinfelder
10:15 AM Revision 7152 (metacat): updated d1 jars
ben leinfelder
09:18 AM Revision 7151 (metacat): [optionally] do not archive the xml_documents and xml_nodes to *_revisions when 'deleting' a document. This will effectively guarantee that the document/data cannot be retrieved after delete.
NOTE: D1 system metadata will persist (for now) so that the ID cannot be reused with the DataONE API but Metacat call... ben leinfelder


04:03 PM Revision 7150 (metacat): optionally remove the document/data file from the filesystem completely when 'deleting' it. ben leinfelder
03:42 PM Revision 7149 (metacat): newer d1 jars that include shared AuthUtilsmethod for isAuthorized() consistency ben leinfelder
03:35 PM Revision 7148 (metacat): implement MN and CN.archive() method -- really just the existing delete() methods.
ben leinfelder
03:05 PM Revision 7147 (metacat): call MN.delete() for each replica when CN.delete() is called ben leinfelder
02:20 PM Revision 7146 (metacat): defer to AuthUtils for flattening out the equivIdent subject list. ben leinfelder


10:24 AM Revision 7145 (metacat): check normal access control rules for getSystemMetadata before deferring to MN replica information that may grant MNs additional access to the SM. ben leinfelder


03:33 PM Revision 7144 (metacat): include Session-less interface methods and updated jars that define them.
ben leinfelder


10:42 AM Revision 7143 (metacat): use a shared ExecutorService for replicate() calls. ben leinfelder


02:04 PM Revision 7142 (metacat): remove extraneous pid and permission parameters from isAdminAuthorized() method and make public so that it can be called in other locations - namely before our asynchronous replicate() implementation on the MN.
ben leinfelder
01:50 PM Revision 7141 (metacat): check for empty null (missing) node.subjectList. This should probably be a required element in the D1 schema, but it appears not. (ORNL entry was missing subjects in cn-dev environment)
ben leinfelder
11:57 AM Revision 7140 (metacat): just use the e.getMessage() as e.getCause() may be null (seeing NPE when testing via the MN IT tester)
ben leinfelder


04:04 PM Revision 7139 (metacat): check for empty null (missing) node.subjectList. This should probably be a required element in the D1 schema, but it appears not. (ORNL entry was missing subjects in cn-dev environment)
ben leinfelder


04:02 PM Revision 7138 (metacat): added 2.0.0 targeted bugs to the release notes and fleshed out other major enhancements in the list
ben leinfelder
03:15 PM Revision 7137 (metacat): no not record EML access rules that use the "denyFirst" permOrder. ben leinfelder
09:20 AM Revision 7136 (metacat): needed to initialize the nodeList that stores matching nodes (by subject) -- this was the source of a NPE when we had a matching node subject.
ben leinfelder


05:38 PM Revision 7135 (metacat): do not create docid-guid mapping unless we are supposed to write access rules for the data to the dbase ben leinfelder


04:40 PM Revision 7134 (metacat): As Ben suggested, don't compare to the node list if there are no replicas listed. This reduces the number of calls to listNodes() on the CN.
Chris Jones
04:32 PM Revision 7133 (metacat): Minor logging change in throwing ServiceFailure when Hazelcast throws a RuntimeException.
Chris Jones
04:07 PM Revision 7132 (metacat): Modify getSystemMetadata() to allow nodes that are listed as replicas to access the system metadata. Use the Session.Subject to find a list of nodes from the CN that match the subject, and compare those node ids to the listed replica node ids. Add listNodesBySubject() helper method to do so.
Chris Jones
07:54 AM Revision 7131 (metacat): release notes for 2.0.0
ben leinfelder


04:28 PM Revision 7130 (metacat): correct typo for "" property on the admin screen checkbox
ben leinfelder


10:42 AM Revision 7129 (metacat): save backup properties before attempting node registration/update so that we don't "forget" the user input
ben leinfelder


03:18 PM Revision 7128 (metacat): add a parameter for optionally writing EML-embedded access control rules to the Metacat DB.
ben leinfelder


04:22 PM Revision 7127 (metacat): added comments and logging about
ben leinfelder
03:01 PM Revision 7126 (metacat): generalize the exception handling because our actions are the same no matter what the specific error is during create - we just notify the CN that the replicate call failed
ben leinfelder
02:58 PM Revision 7125 (metacat): catch general Exception that may be thrown during MN.replicate() when creating the object locally. There are a few records that keep slipping off our radar with no explanation as to why they remain in "REQUESTED" status.
ben leinfelder
01:53 PM Revision 7124 (metacat): do not download data at this point
ben leinfelder
01:53 PM Revision 7123 (metacat): catch errors for each localid we are processing so that they do do prevent other ids from having ORE content generated
ben leinfelder
01:52 PM Revision 7122 (metacat): additional debug logging for tracking down MN replication errors
ben leinfelder
01:35 PM Revision 7121 (metacat): only 2.1.0 EML docs for ORE generation right now...
ben leinfelder


04:28 PM Revision 7120 (metacat): band-aid for CN-CN replication permOrder issue when access control is embedded in EML and the system metadata is replicated before the EML. we just log the inconsistency and allow the insert to succeed ben leinfelder
03:05 PM Revision 7119 (metacat): It looks like jk.conf and were moved in the scripts dir: update the install docs accordingly.
Chris Jones
02:56 PM Revision 7118 (metacat): Fixed a minor typo in the tomcat config section.
Chris Jones

Also available in: Atom