Project

General

Profile

Activity

From 01/22/2014 to 02/20/2014

02/20/2014

04:16 PM Revision 8628 (metacat): example of how we can look up pid (guid) given a metacat docid.
ben leinfelder
03:53 PM Revision 8627 (metacat): Changed some of the font and stlyes of the metacat docs for easier reading and fixed a big where the metacat admin "configure" buttons were not working
Lauren Walker
01:57 PM Revision 8626 (metacat): remove sensorML from the catalog since we don't actually ship it (yet?)
ben leinfelder
01:37 PM Revision 8625 (metacat): add test for invalid dryad content -- should be rejected because it is not schema valid.
ben leinfelder
12:42 PM Revision 8624 (metacat): clean up dryad test doc - only use D1 api. https://projects.ecoinformatics.org/ecoinfo/issues/6419
ben leinfelder
12:25 PM Revision 8623 (metacat): add generated diagrams for stats proposal -- seems to be our practice for other documentation pages.
ben leinfelder
10:35 AM Revision 8622 (metacat): test for inserting dryad instance doc. https://projects.ecoinformatics.org/ecoinfo/issues/6419
ben leinfelder

02/19/2014

05:04 PM Revision 8621 (metacat): add test to check sync of access policies of data object referenced in EML 2.0.1 docs
Peter Slaughter
04:43 PM Revision 8620 (metacat): initial basic test of inserting dryad metadata. NOTE: uses metacat api, not dataone api. https://projects.ecoinformatics.org/ecoinfo/issues/6419
ben leinfelder
03:30 PM Revision 8619 (metacat): do not delete the lib/schema directory on fullclean now that we actually have content in there in SVN. https://projects.ecoinformatics.org/ecoinfo/issues/6419
ben leinfelder
02:52 PM Revision 8618 (metacat): Add an example Dryad Metadata Profile instance document to test inserts of this schema type.
Chris Jones
02:35 PM Revision 8617 (metacat): Add in Darwin Core schema support into xml_catalog, and insert it on upgrade as well. The schemas are cached in lib/schema/dwc, and Matt and Ben noted that the tdwg_basetypes.xsd and tdwg_dwctypes.xsd are part of the same namespace, but are xs:include'd rather than imported via namespace.
Chris Jones
02:14 PM Revision 8616 (metacat): In lieu of pulling schemas from URL endpoints for dataONE, Darwin core, and Dryad, we're caching them in Metacat so we have stable copies. Remove the ant targets used to pull them.
Chris Jones
02:11 PM Revision 8615 (metacat): Add the three Darwin Core schemas required by the Dryad Metadata Profile (via imports).
Chris Jones
12:54 PM Revision 8614 (metacat): include a few tests for isEqual method. https://projects.ecoinformatics.org/ecoinfo/issues/6407
ben leinfelder
08:49 AM Revision 8613 (metacat): Add cached versions of the DataONE, Dryad, Dublin core, and Darwin Core schemas to Metacat. Remove schemaLocation attributes so that we rely on the local catalog and don't use (potentially changing) URL endpoints.
Chris Jones

02/18/2014

04:50 PM Revision 8612 (metacat): Use client.MetacatClient instance for all metacat api calls
Peter Slaughter
02:49 PM Revision 8611 (metacat): Test syncing of access policies when updated with legacy metacat api
Peter Slaughter
02:48 PM Revision 8610 (metacat): Change isEqual to private so it can be used by test suite
Peter Slaughter
02:25 PM Feature #6285 (Resolved): Handle EML singleDateTime field in SOLR index
I'm happy with this as an interim solution until we implement something that can effectively query multiple ranges or... ben leinfelder

02/17/2014

07:16 AM Feature #6419 (Closed): Add Dryad and DataONE schemas to Metacat catalog
Added these schemas into lib/schema via ant tasks, and added them to the xml_catalog table during installation/upgrade. Chris Jones
07:11 AM Revision 8609 (metacat): Add DataONE, Dublin Core, and Dryad schemas during the 2.4.0 upgrade, and be sure to remove the appropriate entries before inserting to avoid duplicate rows.
Chris Jones
06:53 AM Revision 8608 (metacat): Add schema support for the DataONE, dublin Core, and Dryad schemas. Schemas get downloaded into lib/schema priior to jar and dist targets, and get loaded into xml_catalog on installation.
Chris Jones

02/14/2014

03:43 PM Revision 8607 (metacat): move the postgres changes to the oracle version -- update note about not attempting to restore because no Oracle MNs exist.
ben leinfelder
03:20 PM Revision 8606 (metacat): do not include "sm" alias in the SET clause.
ben leinfelder
03:19 PM Revision 8605 (metacat): allow statements starting with 'WITH'
ben leinfelder
02:56 PM Revision 8604 (metacat): comment out the select statements so they do not run during real upgrade.
ben leinfelder
11:59 AM Feature #6285: Handle EML singleDateTime field in SOLR index
Removed the extra bean definitions and combined the single and range of dates into the existing beginDate and endDate... ben leinfelder
10:46 AM Feature #6285 (In Progress): Handle EML singleDateTime field in SOLR index
ben leinfelder
11:49 AM Revision 8603 (metacat): use rangeOfDates | singleDateTime to populate the beginDate and endDate index fields. https://projects.ecoinformatics.org/ecoinfo/issues/6285
ben leinfelder
11:23 AM Feature #6419 (Closed): Add Dryad and DataONE schemas to Metacat catalog
Rather than rely on xsi:schemaLocation being accessible and valid, we should incorporate released schemas from DataON... ben leinfelder
11:15 AM Bug #6306 (Works For Me): During the upgrading metacat to 2.3.0, a user can see a message saying the index schema was changed even though he didn't
Not really sure what was happening, but not really able to replicate reliably. ben leinfelder
09:46 AM Revision 8602 (metacat): switch to ezid 1.0.0 release and pull from dev-testing.dataone.org Maven repo.
ben leinfelder

02/13/2014

03:12 PM Revision 8601 (metacat): loosen the restriction on which archive flags we set to false -- if we have an obsoleted_by value then it need not be marked as archived.
ben leinfelder
02:44 PM Revision 8600 (metacat): add [partial] upgrade to the oracle script -- does not look for any records that the CN deleted because there are no Oracle-backed MNs at this time.
ben leinfelder
02:25 PM Feature #6417: Call MN.archive() when SM.archive=true in MN.systemMetadataChanged()
In general this sounds good, but won't calling MN.archive() result in other side effects (like other changes to syste... Matt Jones
02:11 PM Feature #6417: Call MN.archive() when SM.archive=true in MN.systemMetadataChanged()
I added a comment in the code for where this could be done, but the actual method call is commented out. ben leinfelder
02:01 PM Feature #6417 (Closed): Call MN.archive() when SM.archive=true in MN.systemMetadataChanged()
We decided the CN should not call MN.archive() when it harvests SM from nodes and tries to inform other replicas abou... ben leinfelder
02:08 PM Revision 8599 (metacat): add comment (and commented out code) for possibly inspecting the /dirtySysMeta call for archive=true flag. https://projects.ecoinformatics.org/ecoinfo/issues/6417
ben leinfelder
01:02 PM Revision 8598 (metacat): use '/var/metacat/users/password.xml' as the default password file path to: a) indicate it is for managing users and b) that it uses XML serialization. https://projects.ecoinformatics.org/ecoinfo/issues/6320
ben leinfelder
12:58 PM Revision 8597 (metacat): add a link to the authentication interface page so users can more easily find information on how to add users to the auth file.
ben leinfelder
12:04 PM Bug #6306 (In Progress): During the upgrading metacat to 2.3.0, a user can see a message saying the index schema was changed even though he didn't
I included the md5 for the latest version of the schema we are shipping (customized in metacat-common).
Sounds lik...
ben leinfelder
12:01 PM Revision 8596 (metacat): only index event information for known events. https://projects.ecoinformatics.org/ecoinfo/issues/6346
ben leinfelder
11:12 AM Revision 8595 (metacat): call getDescription on cn.setaccesspolicy service failure
Peter Slaughter

02/12/2014

02:41 PM Feature #6415 (Closed): Make all objects publicly readable on MN.publish()
Now making all objects in the published package publicly readable. ben leinfelder
01:56 PM Revision 8594 (metacat): make all objects in a package publicly readable when published. https://projects.ecoinformatics.org/ecoinfo/issues/6415
ben leinfelder
09:12 AM Feature #6414 (Closed): Reject an insert or update/upload if the docid has white spaces in metacat api
We added the code in the handleUpload, handleInsertOrUpdate and handleMultiPartInsertAction methods to enforce there ... Jing Tao

02/11/2014

02:19 PM Revision 8593 (metacat): Add the code to check if the docid contains the whitespaces in the handleInsertOrUpdate, handleUpload and handleInsertMultipartInsertAction methods.
Jing Tao
02:15 PM Revision 8592 (metacat)
Peter Slaughter
01:44 PM Feature #6415 (In Progress): Make all objects publicly readable on MN.publish()
Changed in the repo -- needs testing. ben leinfelder
10:25 AM Feature #6415 (Closed): Make all objects publicly readable on MN.publish()
Feb 11th, 2014
matt: I think it should be made public, including data, but as Jing indicated, we should give them fa...
ben leinfelder
01:43 PM Revision 8591 (metacat): make all package contents publicly readable when publishing with a DOI. https://projects.ecoinformatics.org/ecoinfo/issues/6415
ben leinfelder
01:29 PM Revision 8590 (metacat): Run syncAll in a single thread so admin config UI doesn't freeze
Peter Slaughter
11:05 AM Revision 8589 (metacat): Change CnodeService.archive() to no longer broadcast MN.archive() calls to all of the replica MNs of a pid, but rather broadcast MN.systemMetadataChanged().
Chris Jones
10:34 AM Feature #6416 (In Progress): Do not allow restrictive access control change to content with a DOI
ben leinfelder

02/10/2014

05:02 PM Feature #6414 (Closed): Reject an insert or update/upload if the docid has white spaces in metacat api
I have a task to handle white spaces in the pids in the dataone production environment:
https://redmine.dataone.org/...
Jing Tao
04:17 PM Revision 8588 (metacat): allow utf-8 user first/last names to be used in responses for: login, logout, validatesession, getprincipals.
ben leinfelder
03:38 PM Revision 8587 (metacat): minor formatting error
Peter Slaughter
03:33 PM Revision 8586 (metacat): Design document for the new Metacat statistics service
Peter Slaughter
11:52 AM Revision 8585 (metacat): Couple modifications:
-use "pid" throughout so as not to confuse docids and pids
-ensure any failures in the set do not prevent synching fo...
ben leinfelder

02/07/2014

04:41 PM Revision 8584 (metacat): use the metacatUI 1.4.5 that includes default metacat theme and context
ben leinfelder
04:17 PM Bug #6320 (Closed): Create a file-base authentication mechanism as the default method
Made AuthFile the default in metacat.properties. ben leinfelder
04:01 PM Revision 8583 (metacat): use AuthFile by default. https://projects.ecoinformatics.org/ecoinfo/issues/6320
ben leinfelder
03:52 PM Bug #6403 (Closed): Command-line user management does not handle hashed passwords
Tested this on my localhost and it works with single quotes. ben leinfelder
03:12 PM Revision 8582 (metacat): swap git command order to avoid merge conflict messages.
ben leinfelder
02:41 PM Bug #6401 (Closed): Add the documentation about the file-based the authentication
Looks good now. ben leinfelder
02:40 PM Feature #6402 (Closed): Rebrand identity service
Now has logos and such.... ben leinfelder
02:20 PM Revision 8581 (metacat): adjust whitespace for consistency
ben leinfelder
02:20 PM Revision 8580 (metacat): include ID field as a minimum for indexing additional fields.
ben leinfelder
12:44 PM Task #6298 (Resolved): Call CN.setAccessPolicy() whenever access control rules are updated in Metacat
EML200SaxHandler updated to sync access policies of data pids if access rules updated in <additionalMetadata> Peter Slaughter
12:40 PM Revision 8579 (metacat): sync pids of <distribution><online> data objects with CN when their access rules change in EML 2.0.* <additionalMetadata>
Peter Slaughter
09:20 AM Revision 8578 (metacat): restrict the archived=false update to revisions that still have current entries in the xml_documents table.
ben leinfelder

02/06/2014

05:36 PM Revision 8577 (metacat): tested the restore insertions - adjusted for FK constraints. I was able to delete a document locally, then restore it, then update the document with a new revision as expected.
ben leinfelder
03:03 PM Revision 8576 (metacat): use 'with' query to find the most recent revision of an object that was archived. still want more feedback on the criteria.
ben leinfelder
02:42 PM Revision 8575 (metacat): Modified the usage.
Jing Tao
11:56 AM Revision 8574 (metacat): continue to work on the criteria for selecting documents to restore.
expanded the criteria for setting archived=false to include any revision that was already obsoleted_by somethign else. ben leinfelder
08:25 AM Revision 8573 (metacat): Minor edits on the new AuthFile features.
ben leinfelder

02/05/2014

06:03 PM Task #6298 (In Progress): Call CN.setAccessPolicy() whenever access control rules are updated in Metacat
I like the approach in EML210SAXHandler for synching the data pids after the transaction has been committed. I think ... ben leinfelder
02:18 PM Revision 8572 (metacat): correct syntax - add more criteria for selecting documents.
ben leinfelder
02:12 PM Revision 8571 (metacat): Add the AOOS as part of the label of the unaffiliated account.
Jing Tao
02:02 PM Revision 8569 (metacat): Add the documentation for the password file authentication.
Jing Tao
02:01 PM Revision 8568 (metacat): Add the configuration for the password file authentication.
Jing Tao
02:00 PM Revision 8567 (metacat): Move the authentication part forward a little bit.
Jing Tao
01:55 PM Revision 8566 (metacat): do not set sm.archived=true when generating system metadata for objects that come in via the old Metacat API.
ben leinfelder
01:50 PM Revision 8565 (metacat): draft of fix for erroneously archived documents - first discovered by LTER - but also applicable to other Metacat MNs that still use the Metacat API as of Jan 2014 CN changes.
ben leinfelder
01:24 PM Revision 8564 (metacat): Modify the usage message.
Jing Tao
09:43 AM Revision 8563 (metacat): Use a DN name for the group in the usage message printout.
Jing Tao

02/04/2014

06:33 PM Revision 8562 (metacat): Add the screenshots for the password file authentication and ldap authentication.
Jing Tao
02:55 PM Task #6407 (Closed): Add syncing test to metacat test suite
Peter Slaughter
02:35 PM Task #6299 (Resolved): Incorporate synch script as Metacat utility or upgrade routine
All pids for an auth MN can have their access policies checked and sync'd by clicking the 'Sync Access Policies' but... Peter Slaughter
02:29 PM Task #6297 (Resolved): Create MN->CN sync script
Peter Slaughter
02:28 PM Task #6298 (Resolved): Call CN.setAccessPolicy() whenever access control rules are updated in Metacat
Peter Slaughter
02:25 PM Revision 8561 (metacat): Fixed bug where sync'ing not working when CN had more access rules than MN
Peter Slaughter
02:24 PM Revision 8560 (metacat): Sync access policy between MN -> CN when access rules are updated in EML 2.1+ for data object
Peter Slaughter

02/03/2014

04:35 PM Revision 8559 (metacat): Add a method to test an alias account in the ldap server.
Jing Tao
04:20 PM Bug #6405 (Resolved): Unable to authenticate with UCNRS referral account
The issue was not in the authentication. It was in the method getUserInfo. In the getUserInfo method, it used a filte... Jing Tao
12:11 PM Bug #6405 (Resolved): Unable to authenticate with UCNRS referral account
Running the JUnit test:... ben leinfelder
04:00 PM Revision 8557 (metacat): Added a footer to the identity management config pages
Lauren Walker
03:35 PM Revision 8556 (metacat): Remove code to add the organzation in the search filter. This is not necessary since we use the dn as the search base. The code was not actually used but caused some problem.
Jing Tao
02:56 PM Revision 8555 (metacat): use v2.4.0 for documentation and upgrade scripts.
ben leinfelder
02:53 PM Revision 8554 (metacat): correctly include stacktrace for error debugging.
ben leinfelder
02:52 PM Revision 8553 (metacat): can only log events with a valid localId.
ben leinfelder
02:51 PM Revision 8552 (metacat): return null if there is no existing SolrDoc for the given pid.
ben leinfelder
09:30 AM Revision 8551 (metacat): Use the default metacatui theme to replace the skin name.
Jing Tao
09:27 AM Revision 8550 (metacat): use https for the new EZID api url.
ben leinfelder

01/31/2014

03:18 PM Bug #6322: Ensure lock is obtained prior to calls to Hazelcast IMap.put()
It seems to me that we should protect against this by creating a wrapper function rather than calling hz.put() direct... Matt Jones
02:19 PM Bug #6322: Ensure lock is obtained prior to calls to Hazelcast IMap.put()
I see quite a few hzSystemMetadata.put() calls without locks. And there are some comments like this:... ben leinfelder
03:09 PM Revision 8549 (metacat): Add a note to let users know where to run the script.
Jing Tao
02:54 PM Bug #6403: Command-line user management does not handle hashed passwords
I added note to let user know that the hashed password should be surround by single quotes. Jing Tao
02:43 PM Bug #6403 (In Progress): Command-line user management does not handle hashed passwords
ben leinfelder
02:42 PM Bug #6403: Command-line user management does not handle hashed passwords
I confirmed that the script doesn't like the "$" as a part of the argument. It will work if we remove the dollar sign... ben leinfelder
02:42 PM Bug #6403: Command-line user management does not handle hashed passwords
I dug around and found that the shell script decoded the bcrypt hash code. If the input (argument) is $2a$04$csilPspP... ben leinfelder
02:39 PM Bug #6403 (Closed): Command-line user management does not handle hashed passwords
From original ticket in the identity service redmine instance (https://projects.nceas.ucsb.edu/nceas/issues/862):
...
ben leinfelder
02:49 PM Revision 8548 (metacat): Add a note to let user know he/she should use single quotes to surround the hashed password.
Jing Tao
02:48 PM Bug #6306: During the upgrading metacat to 2.3.0, a user can see a message saying the index schema was changed even though he didn't
Reminder: for 2.4.0, I changed the schema.xml to use a copy from the metacat-index project. I need to add this hash t... ben leinfelder
02:46 PM Bug #6401: Add the documentation about the file-based the authentication
Jing will add to the existing section in configuration.rst and also authinterface.rst. Then I'll go over it. We shoul... ben leinfelder
11:09 AM Bug #6401 (Closed): Add the documentation about the file-based the authentication
In the next release, metacat will use the file-based the authentication as the default authentication mechanism. We n... Jing Tao
02:35 PM Revision 8547 (metacat): edit some of the user management phrases. use UTF-8 for all returned XML. https://projects.ecoinformatics.org/ecoinfo/issues/6320
ben leinfelder
11:55 AM Feature #6402 (Closed): Rebrand identity service
Include logos of KNB, DataONE, Kepler and GoA Lauren Walker
10:43 AM Feature #6285 (Closed): Handle EML singleDateTime field in SOLR index
Added the application-context fiels for all eml versions to our local metcat-index project with the new singleDateTim... ben leinfelder
10:41 AM Revision 8545 (metacat): index singleDateTime value into both begin and end date fields in solr. https://projects.ecoinformatics.org/ecoinfo/issues/6285
ben leinfelder
10:34 AM Feature #6346 (Resolved): Make # READ events available in SOLR index
Note that this uses our own copy of the solr schema.xml instead of the version offered by the DataONE library. I thin... ben leinfelder

01/30/2014

10:59 PM Story #6276: Update to use new EZID API URL
Ben -- I think we need to send a notice about this out to metacat-dev, both making it clear that this feature is now ... Matt Jones
01:26 PM Story #6276 (Resolved): Update to use new EZID API URL
updated the metacat.properties. new URL seems to be active already, but will wait until after 2/2/2014 to use it in K... ben leinfelder
03:13 PM Revision 8543 (metacat): Add the code to dispaly the label for the organization selection.
Jing Tao
02:48 PM Revision 8541 (metacat): Read the organization label and name from a hash.
Jing Tao
02:47 PM Revision 8540 (metacat): Use an array of a hash to keep the orgName/orgLabel pair.
Jing Tao
01:25 PM Revision 8539 (metacat): use the updated EZID base URL. Should be active after Feb 2nd, 2014. https://projects.ecoinformatics.org/ecoinfo/issues/6276
ben leinfelder
01:19 PM Feature #6305 (Resolved): Disable ecogrid links in rendered EML
When the metadata renders, now removing the ecogrid link hrefs so that people don't click on them and get bad respons... ben leinfelder
12:21 PM Story #6296 (In Progress): authMN SM.accessPolicy out of synch with CN and replicaMN
This is in progress - Peter and I have been discussing different ways access control policies can be updated on the M... ben leinfelder
11:31 AM Revision 8538 (metacat): Add the label property for the organization.
Jing Tao
08:34 AM Bug #6398 (Resolved): Obsoleted metadata objects are being returned from Solr
The (long-running) action=reindex did resolve this issue, but I wish we knew why it happened. Will have to keep our e... ben leinfelder
08:12 AM Bug #6320: Create a file-base authentication mechanism as the default method
Hi, ben: I noticed the issue as well and put it on the bug:
https://projects.nceas.ucsb.edu/nceas/issues/862
I ...
Jing Tao

01/29/2014

04:26 PM Bug #6320 (In Progress): Create a file-base authentication mechanism as the default method
I'm testing this and having a little problem with the utility class that takes the password and writes it to the auth... ben leinfelder
03:06 PM Bug #6398: Obsoleted metadata objects are being returned from Solr
Noticed that multiple revisions of the same object were being returned in the solr results.
We tried running action=...
ben leinfelder
01:41 PM Revision 8537 (metacat): uncomment the original tests now that the "field" test is working.
ben leinfelder
01:35 PM Revision 8536 (metacat): use explicit accessor for clientViewBean sessionid since the taglib was resulting in a blank page.
ben leinfelder

01/27/2014

12:46 PM Bug #6398 (Resolved): Obsoleted metadata objects are being returned from Solr
Even when the query specifies to not return objects with the obsoletedBy field.
Example id:
nrs.875.1
It looks...
Lauren Walker

01/24/2014

06:56 PM Revision 8535 (metacat): Fixed a bug that AuthFile constructor didn't read the new value of the password file path from the metacat.properties.
Jing Tao
05:17 PM Revision 8534 (metacat): Add the code to handle a runtime exception.
Jing Tao
04:32 PM Revision 8533 (metacat): Add the code to hide/display the file/ldap section base on the selection of the auth class.
Jing Tao
04:29 PM Revision 8532 (metacat): Add code to persist the properties in the group 3.
Jing Tao
08:26 AM Story #6276 (In Progress): Update to use new EZID API URL
All,
EZID's domain name change is scheduled for our regularly scheduled maintenance window on Sunday night, Februa...
ben leinfelder

01/23/2014

10:26 PM Revision 8531 (metacat): Add the icon-plus-sign and icon-minus-sign.
Jing Tao
05:20 PM Revision 8530 (metacat): If the user doesn't exist in the password file, the auth configuration will give an error.
Jing Tao
04:37 PM Revision 8529 (metacat): Add the code to constructor default user management url.
Jing Tao
04:36 PM Revision 8528 (metacat): Add a property to store the default user management page.
Jing Tao
02:37 PM Revision 8527 (metacat): Add a default page to handle the user management for the filed-based authentication.
Jing Tao
09:29 AM Revision 8526 (metacat): Use the userManagementurl to replace the ldapweb.cgi.
Jing Tao

01/22/2014

05:34 PM Revision 8525 (metacat): Add a variable to store the user management url.
Jing Tao
05:33 PM Revision 8524 (metacat): Add a method to get the user management url.
Jing Tao
04:34 PM Revision 8523 (metacat): Use the userManagementUrl to replace the ldapweb.cgi url.
Jing Tao
04:32 PM Revision 8522 (metacat): Pass the userManagementUrl to templates.
Jing Tao
03:35 PM Revision 8521 (metacat): Add the documentation for the property user management url.
Jing Tao
03:34 PM Revision 8520 (metacat): Add a new property for the user management url.
Jing Tao
03:33 PM Revision 8519 (metacat): Add a new config for the user-management-url.
Jing Tao
11:46 AM Revision 8518 (metacat): Add the code to set the stored value be selected in the option list.
Jing Tao
 

Also available in: Atom