Activity
From 01/23/2014 to 02/21/2014
02/21/2014
- 03:36 PM Story #6296 (Closed): authMN SM.accessPolicy out of synch with CN and replicaMN
- 03:35 PM Task #6407 (Closed): Add syncing test to metacat test suite
- Added tests for synchronizing MN and CN access policies for single objects and eml-described data objects.
- 03:33 PM Revision 8644 (metacat): add note about archive correction
- 03:12 PM Revision 8642 (metacat): merge recent upgrade changes from 2.4 branch
- 01:13 PM Revision 8636 (metacat): use UI 1.4 branch pre 2.4 branch
- 11:35 AM Revision 8635 (metacat): uncomment other tests in suite.
- 11:20 AM Revision 8634 (metacat): look up guid when done setting access by docid so we can sync and refresh accesspolicy on MN and CN.
- 10:50 AM Revision 8633 (metacat): additional logging for set access
- 10:35 AM Revision 8632 (metacat): add a few more checks while debugging test
- 10:04 AM Revision 8631 (metacat): Use D1client for communication with CN (for integration test)
- 09:05 AM Revision 8630 (metacat): get guid from online id for call to SyncAccessPolicy
- 09:02 AM Revision 8629 (metacat): setAccessAction: get guid from passed in id for calls to SyncAccessPolicy, HazelcastService.refreshSystemMetadataEntry
02/20/2014
- 04:16 PM Revision 8628 (metacat): example of how we can look up pid (guid) given a metacat docid.
- 03:53 PM Revision 8627 (metacat): Changed some of the font and stlyes of the metacat docs for easier reading and fixed a big where the metacat admin "configure" buttons were not working
- 01:57 PM Revision 8626 (metacat): remove sensorML from the catalog since we don't actually ship it (yet?)
- 01:37 PM Revision 8625 (metacat): add test for invalid dryad content -- should be rejected because it is not schema valid.
- 12:42 PM Revision 8624 (metacat): clean up dryad test doc - only use D1 api. https://projects.ecoinformatics.org/ecoinfo/issues/6419
- 12:25 PM Revision 8623 (metacat): add generated diagrams for stats proposal -- seems to be our practice for other documentation pages.
- 10:35 AM Revision 8622 (metacat): test for inserting dryad instance doc. https://projects.ecoinformatics.org/ecoinfo/issues/6419
02/19/2014
- 05:04 PM Revision 8621 (metacat): add test to check sync of access policies of data object referenced in EML 2.0.1 docs
- 04:43 PM Revision 8620 (metacat): initial basic test of inserting dryad metadata. NOTE: uses metacat api, not dataone api. https://projects.ecoinformatics.org/ecoinfo/issues/6419
- 03:30 PM Revision 8619 (metacat): do not delete the lib/schema directory on fullclean now that we actually have content in there in SVN. https://projects.ecoinformatics.org/ecoinfo/issues/6419
- 02:52 PM Revision 8618 (metacat): Add an example Dryad Metadata Profile instance document to test inserts of this schema type.
- 02:35 PM Revision 8617 (metacat): Add in Darwin Core schema support into xml_catalog, and insert it on upgrade as well. The schemas are cached in lib/schema/dwc, and Matt and Ben noted that the tdwg_basetypes.xsd and tdwg_dwctypes.xsd are part of the same namespace, but are xs:include'd rather than imported via namespace.
- 02:14 PM Revision 8616 (metacat): In lieu of pulling schemas from URL endpoints for dataONE, Darwin core, and Dryad, we're caching them in Metacat so we have stable copies. Remove the ant targets used to pull them.
- 02:11 PM Revision 8615 (metacat): Add the three Darwin Core schemas required by the Dryad Metadata Profile (via imports).
- 12:54 PM Revision 8614 (metacat): include a few tests for isEqual method. https://projects.ecoinformatics.org/ecoinfo/issues/6407
- 08:49 AM Revision 8613 (metacat): Add cached versions of the DataONE, Dryad, Dublin core, and Darwin Core schemas to Metacat. Remove schemaLocation attributes so that we rely on the local catalog and don't use (potentially changing) URL endpoints.
02/18/2014
- 04:50 PM Revision 8612 (metacat): Use client.MetacatClient instance for all metacat api calls
- 02:49 PM Revision 8611 (metacat): Test syncing of access policies when updated with legacy metacat api
- 02:48 PM Revision 8610 (metacat): Change isEqual to private so it can be used by test suite
- 02:25 PM Feature #6285 (Resolved): Handle EML singleDateTime field in SOLR index
- I'm happy with this as an interim solution until we implement something that can effectively query multiple ranges or...
02/17/2014
- 07:16 AM Feature #6419 (Closed): Add Dryad and DataONE schemas to Metacat catalog
- Added these schemas into lib/schema via ant tasks, and added them to the xml_catalog table during installation/upgrade.
- 07:11 AM Revision 8609 (metacat): Add DataONE, Dublin Core, and Dryad schemas during the 2.4.0 upgrade, and be sure to remove the appropriate entries before inserting to avoid duplicate rows.
- 06:53 AM Revision 8608 (metacat): Add schema support for the DataONE, dublin Core, and Dryad schemas. Schemas get downloaded into lib/schema priior to jar and dist targets, and get loaded into xml_catalog on installation.
02/14/2014
- 03:43 PM Revision 8607 (metacat): move the postgres changes to the oracle version -- update note about not attempting to restore because no Oracle MNs exist.
- 03:20 PM Revision 8606 (metacat): do not include "sm" alias in the SET clause.
- 03:19 PM Revision 8605 (metacat): allow statements starting with 'WITH'
- 02:56 PM Revision 8604 (metacat): comment out the select statements so they do not run during real upgrade.
- 11:59 AM Feature #6285: Handle EML singleDateTime field in SOLR index
- Removed the extra bean definitions and combined the single and range of dates into the existing beginDate and endDate...
- 10:46 AM Feature #6285 (In Progress): Handle EML singleDateTime field in SOLR index
- 11:49 AM Revision 8603 (metacat): use rangeOfDates | singleDateTime to populate the beginDate and endDate index fields. https://projects.ecoinformatics.org/ecoinfo/issues/6285
- 11:23 AM Feature #6419 (Closed): Add Dryad and DataONE schemas to Metacat catalog
- Rather than rely on xsi:schemaLocation being accessible and valid, we should incorporate released schemas from DataON...
- 11:15 AM Bug #6306 (Works For Me): During the upgrading metacat to 2.3.0, a user can see a message saying the index schema was changed even though he didn't
- Not really sure what was happening, but not really able to replicate reliably.
- 09:46 AM Revision 8602 (metacat): switch to ezid 1.0.0 release and pull from dev-testing.dataone.org Maven repo.
02/13/2014
- 03:12 PM Revision 8601 (metacat): loosen the restriction on which archive flags we set to false -- if we have an obsoleted_by value then it need not be marked as archived.
- 02:44 PM Revision 8600 (metacat): add [partial] upgrade to the oracle script -- does not look for any records that the CN deleted because there are no Oracle-backed MNs at this time.
- 02:25 PM Feature #6417: Call MN.archive() when SM.archive=true in MN.systemMetadataChanged()
- In general this sounds good, but won't calling MN.archive() result in other side effects (like other changes to syste...
- 02:11 PM Feature #6417: Call MN.archive() when SM.archive=true in MN.systemMetadataChanged()
- I added a comment in the code for where this could be done, but the actual method call is commented out.
- 02:01 PM Feature #6417 (Closed): Call MN.archive() when SM.archive=true in MN.systemMetadataChanged()
- We decided the CN should not call MN.archive() when it harvests SM from nodes and tries to inform other replicas abou...
- 02:08 PM Revision 8599 (metacat): add comment (and commented out code) for possibly inspecting the /dirtySysMeta call for archive=true flag. https://projects.ecoinformatics.org/ecoinfo/issues/6417
- 01:02 PM Revision 8598 (metacat): use '/var/metacat/users/password.xml' as the default password file path to: a) indicate it is for managing users and b) that it uses XML serialization. https://projects.ecoinformatics.org/ecoinfo/issues/6320
- 12:58 PM Revision 8597 (metacat): add a link to the authentication interface page so users can more easily find information on how to add users to the auth file.
- 12:04 PM Bug #6306 (In Progress): During the upgrading metacat to 2.3.0, a user can see a message saying the index schema was changed even though he didn't
- I included the md5 for the latest version of the schema we are shipping (customized in metacat-common).
Sounds lik... - 12:01 PM Revision 8596 (metacat): only index event information for known events. https://projects.ecoinformatics.org/ecoinfo/issues/6346
- 11:12 AM Revision 8595 (metacat): call getDescription on cn.setaccesspolicy service failure
02/12/2014
- 02:41 PM Feature #6415 (Closed): Make all objects publicly readable on MN.publish()
- Now making all objects in the published package publicly readable.
- 01:56 PM Revision 8594 (metacat): make all objects in a package publicly readable when published. https://projects.ecoinformatics.org/ecoinfo/issues/6415
- 09:12 AM Feature #6414 (Closed): Reject an insert or update/upload if the docid has white spaces in metacat api
- We added the code in the handleUpload, handleInsertOrUpdate and handleMultiPartInsertAction methods to enforce there ...
02/11/2014
- 02:19 PM Revision 8593 (metacat): Add the code to check if the docid contains the whitespaces in the handleInsertOrUpdate, handleUpload and handleInsertMultipartInsertAction methods.
- 02:15 PM Revision 8592 (metacat)
- 01:44 PM Feature #6415 (In Progress): Make all objects publicly readable on MN.publish()
- Changed in the repo -- needs testing.
- 10:25 AM Feature #6415 (Closed): Make all objects publicly readable on MN.publish()
- Feb 11th, 2014
matt: I think it should be made public, including data, but as Jing indicated, we should give them fa... - 01:43 PM Revision 8591 (metacat): make all package contents publicly readable when publishing with a DOI. https://projects.ecoinformatics.org/ecoinfo/issues/6415
- 01:29 PM Revision 8590 (metacat): Run syncAll in a single thread so admin config UI doesn't freeze
- 11:05 AM Revision 8589 (metacat): Change CnodeService.archive() to no longer broadcast MN.archive() calls to all of the replica MNs of a pid, but rather broadcast MN.systemMetadataChanged().
- 10:34 AM Feature #6416 (In Progress): Do not allow restrictive access control change to content with a DOI
02/10/2014
- 05:02 PM Feature #6414 (Closed): Reject an insert or update/upload if the docid has white spaces in metacat api
- I have a task to handle white spaces in the pids in the dataone production environment:
https://redmine.dataone.org/... - 04:17 PM Revision 8588 (metacat): allow utf-8 user first/last names to be used in responses for: login, logout, validatesession, getprincipals.
- 03:38 PM Revision 8587 (metacat): minor formatting error
- 03:33 PM Revision 8586 (metacat): Design document for the new Metacat statistics service
- 11:52 AM Revision 8585 (metacat): Couple modifications:
- -use "pid" throughout so as not to confuse docids and pids
-ensure any failures in the set do not prevent synching fo...
02/07/2014
- 04:41 PM Revision 8584 (metacat): use the metacatUI 1.4.5 that includes default metacat theme and context
- 04:17 PM Bug #6320 (Closed): Create a file-base authentication mechanism as the default method
- Made AuthFile the default in metacat.properties.
- 04:01 PM Revision 8583 (metacat): use AuthFile by default. https://projects.ecoinformatics.org/ecoinfo/issues/6320
- 03:52 PM Bug #6403 (Closed): Command-line user management does not handle hashed passwords
- Tested this on my localhost and it works with single quotes.
- 03:12 PM Revision 8582 (metacat): swap git command order to avoid merge conflict messages.
- 02:41 PM Bug #6401 (Closed): Add the documentation about the file-based the authentication
- Looks good now.
- 02:40 PM Feature #6402 (Closed): Rebrand identity service
- Now has logos and such....
- 02:20 PM Revision 8581 (metacat): adjust whitespace for consistency
- 02:20 PM Revision 8580 (metacat): include ID field as a minimum for indexing additional fields.
- 12:44 PM Task #6298 (Resolved): Call CN.setAccessPolicy() whenever access control rules are updated in Metacat
- EML200SaxHandler updated to sync access policies of data pids if access rules updated in <additionalMetadata>
- 12:40 PM Revision 8579 (metacat): sync pids of <distribution><online> data objects with CN when their access rules change in EML 2.0.* <additionalMetadata>
- 09:20 AM Revision 8578 (metacat): restrict the archived=false update to revisions that still have current entries in the xml_documents table.
02/06/2014
- 05:36 PM Revision 8577 (metacat): tested the restore insertions - adjusted for FK constraints. I was able to delete a document locally, then restore it, then update the document with a new revision as expected.
- 03:03 PM Revision 8576 (metacat): use 'with' query to find the most recent revision of an object that was archived. still want more feedback on the criteria.
- 02:42 PM Revision 8575 (metacat): Modified the usage.
- 11:56 AM Revision 8574 (metacat): continue to work on the criteria for selecting documents to restore.
- expanded the criteria for setting archived=false to include any revision that was already obsoleted_by somethign else.
- 08:25 AM Revision 8573 (metacat): Minor edits on the new AuthFile features.
02/05/2014
- 06:03 PM Task #6298 (In Progress): Call CN.setAccessPolicy() whenever access control rules are updated in Metacat
- I like the approach in EML210SAXHandler for synching the data pids after the transaction has been committed. I think ...
- 02:18 PM Revision 8572 (metacat): correct syntax - add more criteria for selecting documents.
- 02:12 PM Revision 8571 (metacat): Add the AOOS as part of the label of the unaffiliated account.
- 02:02 PM Revision 8569 (metacat): Add the documentation for the password file authentication.
- 02:01 PM Revision 8568 (metacat): Add the configuration for the password file authentication.
- 02:00 PM Revision 8567 (metacat): Move the authentication part forward a little bit.
- 01:55 PM Revision 8566 (metacat): do not set sm.archived=true when generating system metadata for objects that come in via the old Metacat API.
- 01:50 PM Revision 8565 (metacat): draft of fix for erroneously archived documents - first discovered by LTER - but also applicable to other Metacat MNs that still use the Metacat API as of Jan 2014 CN changes.
- 01:24 PM Revision 8564 (metacat): Modify the usage message.
- 09:43 AM Revision 8563 (metacat): Use a DN name for the group in the usage message printout.
02/04/2014
- 06:33 PM Revision 8562 (metacat): Add the screenshots for the password file authentication and ldap authentication.
- 02:55 PM Task #6407 (Closed): Add syncing test to metacat test suite
- 02:35 PM Task #6299 (Resolved): Incorporate synch script as Metacat utility or upgrade routine
- All pids for an auth MN can have their access policies checked and sync'd by clicking the 'Sync Access Policies' but...
- 02:29 PM Task #6297 (Resolved): Create MN->CN sync script
- 02:28 PM Task #6298 (Resolved): Call CN.setAccessPolicy() whenever access control rules are updated in Metacat
- 02:25 PM Revision 8561 (metacat): Fixed bug where sync'ing not working when CN had more access rules than MN
- 02:24 PM Revision 8560 (metacat): Sync access policy between MN -> CN when access rules are updated in EML 2.1+ for data object
02/03/2014
- 04:35 PM Revision 8559 (metacat): Add a method to test an alias account in the ldap server.
- 04:20 PM Bug #6405 (Resolved): Unable to authenticate with UCNRS referral account
- The issue was not in the authentication. It was in the method getUserInfo. In the getUserInfo method, it used a filte...
- 12:11 PM Bug #6405 (Resolved): Unable to authenticate with UCNRS referral account
- Running the JUnit test:...
- 04:00 PM Revision 8557 (metacat): Added a footer to the identity management config pages
- 03:35 PM Revision 8556 (metacat): Remove code to add the organzation in the search filter. This is not necessary since we use the dn as the search base. The code was not actually used but caused some problem.
- 02:56 PM Revision 8555 (metacat): use v2.4.0 for documentation and upgrade scripts.
- 02:53 PM Revision 8554 (metacat): correctly include stacktrace for error debugging.
- 02:52 PM Revision 8553 (metacat): can only log events with a valid localId.
- 02:51 PM Revision 8552 (metacat): return null if there is no existing SolrDoc for the given pid.
- 09:30 AM Revision 8551 (metacat): Use the default metacatui theme to replace the skin name.
- 09:27 AM Revision 8550 (metacat): use https for the new EZID api url.
01/31/2014
- 03:18 PM Bug #6322: Ensure lock is obtained prior to calls to Hazelcast IMap.put()
- It seems to me that we should protect against this by creating a wrapper function rather than calling hz.put() direct...
- 02:19 PM Bug #6322: Ensure lock is obtained prior to calls to Hazelcast IMap.put()
- I see quite a few hzSystemMetadata.put() calls without locks. And there are some comments like this:...
- 03:09 PM Revision 8549 (metacat): Add a note to let users know where to run the script.
- 02:54 PM Bug #6403: Command-line user management does not handle hashed passwords
- I added note to let user know that the hashed password should be surround by single quotes.
- 02:43 PM Bug #6403 (In Progress): Command-line user management does not handle hashed passwords
- 02:42 PM Bug #6403: Command-line user management does not handle hashed passwords
- I confirmed that the script doesn't like the "$" as a part of the argument. It will work if we remove the dollar sign...
- 02:42 PM Bug #6403: Command-line user management does not handle hashed passwords
- I dug around and found that the shell script decoded the bcrypt hash code. If the input (argument) is $2a$04$csilPspP...
- 02:39 PM Bug #6403 (Closed): Command-line user management does not handle hashed passwords
- From original ticket in the identity service redmine instance (https://projects.nceas.ucsb.edu/nceas/issues/862):
... - 02:49 PM Revision 8548 (metacat): Add a note to let user know he/she should use single quotes to surround the hashed password.
- 02:48 PM Bug #6306: During the upgrading metacat to 2.3.0, a user can see a message saying the index schema was changed even though he didn't
- Reminder: for 2.4.0, I changed the schema.xml to use a copy from the metacat-index project. I need to add this hash t...
- 02:46 PM Bug #6401: Add the documentation about the file-based the authentication
- Jing will add to the existing section in configuration.rst and also authinterface.rst. Then I'll go over it. We shoul...
- 11:09 AM Bug #6401 (Closed): Add the documentation about the file-based the authentication
- In the next release, metacat will use the file-based the authentication as the default authentication mechanism. We n...
- 02:35 PM Revision 8547 (metacat): edit some of the user management phrases. use UTF-8 for all returned XML. https://projects.ecoinformatics.org/ecoinfo/issues/6320
- 11:55 AM Feature #6402 (Closed): Rebrand identity service
- Include logos of KNB, DataONE, Kepler and GoA
- 10:43 AM Feature #6285 (Closed): Handle EML singleDateTime field in SOLR index
- Added the application-context fiels for all eml versions to our local metcat-index project with the new singleDateTim...
- 10:41 AM Revision 8545 (metacat): index singleDateTime value into both begin and end date fields in solr. https://projects.ecoinformatics.org/ecoinfo/issues/6285
- 10:34 AM Feature #6346 (Resolved): Make # READ events available in SOLR index
- Note that this uses our own copy of the solr schema.xml instead of the version offered by the DataONE library. I thin...
01/30/2014
- 10:59 PM Story #6276: Update to use new EZID API URL
- Ben -- I think we need to send a notice about this out to metacat-dev, both making it clear that this feature is now ...
- 01:26 PM Story #6276 (Resolved): Update to use new EZID API URL
- updated the metacat.properties. new URL seems to be active already, but will wait until after 2/2/2014 to use it in K...
- 03:13 PM Revision 8543 (metacat): Add the code to dispaly the label for the organization selection.
- 02:48 PM Revision 8541 (metacat): Read the organization label and name from a hash.
- 02:47 PM Revision 8540 (metacat): Use an array of a hash to keep the orgName/orgLabel pair.
- 01:25 PM Revision 8539 (metacat): use the updated EZID base URL. Should be active after Feb 2nd, 2014. https://projects.ecoinformatics.org/ecoinfo/issues/6276
- 01:19 PM Feature #6305 (Resolved): Disable ecogrid links in rendered EML
- When the metadata renders, now removing the ecogrid link hrefs so that people don't click on them and get bad respons...
- 12:21 PM Story #6296 (In Progress): authMN SM.accessPolicy out of synch with CN and replicaMN
- This is in progress - Peter and I have been discussing different ways access control policies can be updated on the M...
- 11:31 AM Revision 8538 (metacat): Add the label property for the organization.
- 08:34 AM Bug #6398 (Resolved): Obsoleted metadata objects are being returned from Solr
- The (long-running) action=reindex did resolve this issue, but I wish we knew why it happened. Will have to keep our e...
- 08:12 AM Bug #6320: Create a file-base authentication mechanism as the default method
- Hi, ben: I noticed the issue as well and put it on the bug:
https://projects.nceas.ucsb.edu/nceas/issues/862
I ...
01/29/2014
- 04:26 PM Bug #6320 (In Progress): Create a file-base authentication mechanism as the default method
- I'm testing this and having a little problem with the utility class that takes the password and writes it to the auth...
- 03:06 PM Bug #6398: Obsoleted metadata objects are being returned from Solr
- Noticed that multiple revisions of the same object were being returned in the solr results.
We tried running action=... - 01:41 PM Revision 8537 (metacat): uncomment the original tests now that the "field" test is working.
- 01:35 PM Revision 8536 (metacat): use explicit accessor for clientViewBean sessionid since the taglib was resulting in a blank page.
01/27/2014
- 12:46 PM Bug #6398 (Resolved): Obsoleted metadata objects are being returned from Solr
- Even when the query specifies to not return objects with the obsoletedBy field.
Example id:
nrs.875.1
It looks...
01/24/2014
- 06:56 PM Revision 8535 (metacat): Fixed a bug that AuthFile constructor didn't read the new value of the password file path from the metacat.properties.
- 05:17 PM Revision 8534 (metacat): Add the code to handle a runtime exception.
- 04:32 PM Revision 8533 (metacat): Add the code to hide/display the file/ldap section base on the selection of the auth class.
- 04:29 PM Revision 8532 (metacat): Add code to persist the properties in the group 3.
- 08:26 AM Story #6276 (In Progress): Update to use new EZID API URL
- All,
EZID's domain name change is scheduled for our regularly scheduled maintenance window on Sunday night, Februa...
01/23/2014
- 10:26 PM Revision 8531 (metacat): Add the icon-plus-sign and icon-minus-sign.
- 05:20 PM Revision 8530 (metacat): If the user doesn't exist in the password file, the auth configuration will give an error.
- 04:37 PM Revision 8529 (metacat): Add the code to constructor default user management url.
- 04:36 PM Revision 8528 (metacat): Add a property to store the default user management page.
- 02:37 PM Revision 8527 (metacat): Add a default page to handle the user management for the filed-based authentication.
- 09:29 AM Revision 8526 (metacat): Use the userManagementurl to replace the ldapweb.cgi.
Also available in: Atom