Activity
From 02/06/2014 to 03/07/2014
03/06/2014
03/05/2014
- 11:46 AM Revision 8699 (metacat): Add comments to bash script to explain its function and dependencies
- 11:34 AM Feature #6445 (New): Alter replicaPolicies.sh so that the script will iterate over pages of objects instead of updating the count in the code manually
- 11:30 AM Revision 8698 (metacat): Added a bash script to call /replicaPolicies/{pid} via the DataONE API for all objects in a MN or a list of ids.
03/04/2014
- 12:09 PM Story #6440 (Closed): Keep DOI registrations current and resolvable
- We have used a few different DOI registration approaches on the KNB:
* bulk load of all historical content (metadata... - 10:23 AM Revision 8697 (metacat): Add the test class for the pisco account.
- 10:22 AM Revision 8696 (metacat): Remove the test method for the pisco account since it maybe fails because of the fire wall issue.
- 09:48 AM Revision 8695 (metacat): Add the login test of the pisco account.
- 09:47 AM Revision 8694 (metacat): Add the pisco account.
03/03/2014
- 04:33 PM Revision 8693 (metacat): Do a more thorough check that the characteristic annotation was successfully indexed as expected (semtools)
- 03:56 PM Revision 8692 (metacat): switch to the OpenAnnotation (OA) model for annotating datapackages with measurements/characteristics (semtools)
- 03:55 PM Revision 8691 (metacat): switch to the OpenAnnotation (OA) model for annotating datapackages with measurements/characteristics (semtools)
- 03:54 PM Revision 8690 (metacat): switch to the OpenAnnotation (OA) model for annotating datapackages with measurements/characteristics (semtools)
- 03:41 PM Revision 8689 (metacat): support content from all serverLocations when summarizing entity info (semtools)
- 09:30 AM Revision 8688 (metacat): bump the poms to 2.4.2
- 07:03 AM Story #6437: Upgrade to SOLR 4 or 5
- Assigning to Peter for now -- seems he will be involved with SOLR for stats service and has already experimented with...
- 06:52 AM Story #6437 (New): Upgrade to SOLR 4 or 5
- We'd like to make use of new key features in SOLR 4:
* spatial indexing/filters
* geohash (for heatmaps/displaying ...
03/02/2014
03/01/2014
02/28/2014
- 04:39 PM Revision 8680 (metacat): Add a pisco test account.
- 04:30 PM Bug #6424 (Closed): Obsoleted objects not marked in index
- Now re-indexing the obsoleted revision[s] of any new objects that are added with update commands. Note that we do not...
- 04:08 PM Bug #6435 (Closed): Solr queries with certain URL-encoded characters are decoded twice
- Added special case for "+" so that when we use the SOLRJ parser it does not encode the intended "+" into a space.
- 02:45 PM Bug #6435 (Closed): Solr queries with certain URL-encoded characters are decoded twice
- The one character I know is a problem is + (%2B). When %2B is sent in a Solr query, Metacat seems to decode it twice ...
- 04:06 PM Revision 8678 (metacat): allow "+" in solr query syntax. https://projects.ecoinformatics.org/ecoinfo/issues/6435
- 01:53 PM Revision 8677 (metacat): Add a comment to warn the users not to change the password file path to a production one since it will be deleted.
- 01:11 PM Revision 8675 (metacat): clear test password file so subsequent runs will not fail -- tests assume blank file to begin with.
- 10:54 AM Task #6433 (Closed): Test Metacat on tomcat7
- Aaron from UW installed a Metacat instance on tomcat7 (Ubuntu 12). But a user can't log in when a Morpho connected it...
02/27/2014
02/26/2014
- 10:49 PM Revision 8670 (metacat): include read events when re-indexing obsoleted objects. https://projects.ecoinformatics.org/ecoinfo/issues/6424
- 10:45 PM Bug #6424 (In Progress): Obsoleted objects not marked in index
- When we decided to keep obsoleted objects in the index, we neglected to update their entries in the index when they w...
- 10:14 PM Bug #6427 (Resolved): Log-in form on SanPark skin doesn't work
- I dug around and found the log-in worked on Firefox but didn't work on Chrome. The issue is the Ajax.Updater didn't s...
- 11:08 AM Bug #6427: Log-in form on SanPark skin doesn't work
- But the SAEON skin works.
- 11:06 AM Bug #6427 (Resolved): Log-in form on SanPark skin doesn't work
- If you click the login button on the Sanpark skin even though input a valid user/password, the login doesn't go throu...
- 05:05 PM Revision 8668 (metacat): Change the loginForm attributes which is generated by the logout action.
- 04:19 PM Revision 8665 (metacat): Use the userManagement variable.
- 04:19 PM Revision 8664 (metacat): Set the userManagementURL property.
- 03:24 PM Revision 8662 (metacat): make the loginForm and logoutForm the onSubmit "false" and the method "post".
- 11:01 AM Bug #6426 (Resolved): Pisco accounts can't log in
- I dug around and found the issue. The problem was not the log-in itself, it was the getUserInfo method used for gethe...
- 11:01 AM Bug #6426 (Resolved): Pisco accounts can't log in
- Mike reported that he couldn't log in Metacat 2.4.0.
- 10:29 AM Revision 8659 (metacat): remove metacarta map layer -- their WMS service is no longer responding.
- 07:55 AM Revision 8656 (metacat): update to use 2.4.1 so the trunk has all artifacts for upgrades.
- 07:47 AM Revision 8655 (metacat): simple upgrade scripts for version 2.4.1
02/25/2014
- 07:46 PM Revision 8652 (metacat): In the authenticate method, if metacat can't get user info, the login still can be successful.
- 06:39 PM Revision 8651 (metacat): change a log information.
- 06:31 PM Revision 8650 (metacat): In the getALiasedName method, the referral set to ignore. Since the alias name is the local referral, we need to set it to ignore.
- 05:44 PM Revision 8649 (metacat): Change the password.
- 04:32 PM Revision 8648 (metacat): test that obsoleted objects remain indexed, but are marked as obsoleted. https://projects.ecoinformatics.org/ecoinfo/issues/6424
- 04:14 PM Revision 8647 (metacat): recursively submit obsoleted objects for indexing when instructed. https://projects.ecoinformatics.org/ecoinfo/issues/6424
- 03:59 PM Bug #6424 (Closed): Obsoleted objects not marked in index
- Looks like between 2.3.1 and 2.4.0 a lot of indexing code was commented out or removed and I believe some of it was t...
02/24/2014
02/21/2014
- 03:36 PM Story #6296 (Closed): authMN SM.accessPolicy out of synch with CN and replicaMN
- 03:35 PM Task #6407 (Closed): Add syncing test to metacat test suite
- Added tests for synchronizing MN and CN access policies for single objects and eml-described data objects.
- 03:33 PM Revision 8644 (metacat): add note about archive correction
- 03:12 PM Revision 8642 (metacat): merge recent upgrade changes from 2.4 branch
- 01:13 PM Revision 8636 (metacat): use UI 1.4 branch pre 2.4 branch
- 11:35 AM Revision 8635 (metacat): uncomment other tests in suite.
- 11:20 AM Revision 8634 (metacat): look up guid when done setting access by docid so we can sync and refresh accesspolicy on MN and CN.
- 10:50 AM Revision 8633 (metacat): additional logging for set access
- 10:35 AM Revision 8632 (metacat): add a few more checks while debugging test
- 10:04 AM Revision 8631 (metacat): Use D1client for communication with CN (for integration test)
- 09:05 AM Revision 8630 (metacat): get guid from online id for call to SyncAccessPolicy
- 09:02 AM Revision 8629 (metacat): setAccessAction: get guid from passed in id for calls to SyncAccessPolicy, HazelcastService.refreshSystemMetadataEntry
02/20/2014
- 04:16 PM Revision 8628 (metacat): example of how we can look up pid (guid) given a metacat docid.
- 03:53 PM Revision 8627 (metacat): Changed some of the font and stlyes of the metacat docs for easier reading and fixed a big where the metacat admin "configure" buttons were not working
- 01:57 PM Revision 8626 (metacat): remove sensorML from the catalog since we don't actually ship it (yet?)
- 01:37 PM Revision 8625 (metacat): add test for invalid dryad content -- should be rejected because it is not schema valid.
- 12:42 PM Revision 8624 (metacat): clean up dryad test doc - only use D1 api. https://projects.ecoinformatics.org/ecoinfo/issues/6419
- 12:25 PM Revision 8623 (metacat): add generated diagrams for stats proposal -- seems to be our practice for other documentation pages.
- 10:35 AM Revision 8622 (metacat): test for inserting dryad instance doc. https://projects.ecoinformatics.org/ecoinfo/issues/6419
02/19/2014
- 05:04 PM Revision 8621 (metacat): add test to check sync of access policies of data object referenced in EML 2.0.1 docs
- 04:43 PM Revision 8620 (metacat): initial basic test of inserting dryad metadata. NOTE: uses metacat api, not dataone api. https://projects.ecoinformatics.org/ecoinfo/issues/6419
- 03:30 PM Revision 8619 (metacat): do not delete the lib/schema directory on fullclean now that we actually have content in there in SVN. https://projects.ecoinformatics.org/ecoinfo/issues/6419
- 02:52 PM Revision 8618 (metacat): Add an example Dryad Metadata Profile instance document to test inserts of this schema type.
- 02:35 PM Revision 8617 (metacat): Add in Darwin Core schema support into xml_catalog, and insert it on upgrade as well. The schemas are cached in lib/schema/dwc, and Matt and Ben noted that the tdwg_basetypes.xsd and tdwg_dwctypes.xsd are part of the same namespace, but are xs:include'd rather than imported via namespace.
- 02:14 PM Revision 8616 (metacat): In lieu of pulling schemas from URL endpoints for dataONE, Darwin core, and Dryad, we're caching them in Metacat so we have stable copies. Remove the ant targets used to pull them.
- 02:11 PM Revision 8615 (metacat): Add the three Darwin Core schemas required by the Dryad Metadata Profile (via imports).
- 12:54 PM Revision 8614 (metacat): include a few tests for isEqual method. https://projects.ecoinformatics.org/ecoinfo/issues/6407
- 08:49 AM Revision 8613 (metacat): Add cached versions of the DataONE, Dryad, Dublin core, and Darwin Core schemas to Metacat. Remove schemaLocation attributes so that we rely on the local catalog and don't use (potentially changing) URL endpoints.
02/18/2014
- 04:50 PM Revision 8612 (metacat): Use client.MetacatClient instance for all metacat api calls
- 02:49 PM Revision 8611 (metacat): Test syncing of access policies when updated with legacy metacat api
- 02:48 PM Revision 8610 (metacat): Change isEqual to private so it can be used by test suite
- 02:25 PM Feature #6285 (Resolved): Handle EML singleDateTime field in SOLR index
- I'm happy with this as an interim solution until we implement something that can effectively query multiple ranges or...
02/17/2014
- 07:16 AM Feature #6419 (Closed): Add Dryad and DataONE schemas to Metacat catalog
- Added these schemas into lib/schema via ant tasks, and added them to the xml_catalog table during installation/upgrade.
- 07:11 AM Revision 8609 (metacat): Add DataONE, Dublin Core, and Dryad schemas during the 2.4.0 upgrade, and be sure to remove the appropriate entries before inserting to avoid duplicate rows.
- 06:53 AM Revision 8608 (metacat): Add schema support for the DataONE, dublin Core, and Dryad schemas. Schemas get downloaded into lib/schema priior to jar and dist targets, and get loaded into xml_catalog on installation.
02/14/2014
- 03:43 PM Revision 8607 (metacat): move the postgres changes to the oracle version -- update note about not attempting to restore because no Oracle MNs exist.
- 03:20 PM Revision 8606 (metacat): do not include "sm" alias in the SET clause.
- 03:19 PM Revision 8605 (metacat): allow statements starting with 'WITH'
- 02:56 PM Revision 8604 (metacat): comment out the select statements so they do not run during real upgrade.
- 11:59 AM Feature #6285: Handle EML singleDateTime field in SOLR index
- Removed the extra bean definitions and combined the single and range of dates into the existing beginDate and endDate...
- 10:46 AM Feature #6285 (In Progress): Handle EML singleDateTime field in SOLR index
- 11:49 AM Revision 8603 (metacat): use rangeOfDates | singleDateTime to populate the beginDate and endDate index fields. https://projects.ecoinformatics.org/ecoinfo/issues/6285
- 11:23 AM Feature #6419 (Closed): Add Dryad and DataONE schemas to Metacat catalog
- Rather than rely on xsi:schemaLocation being accessible and valid, we should incorporate released schemas from DataON...
- 11:15 AM Bug #6306 (Works For Me): During the upgrading metacat to 2.3.0, a user can see a message saying the index schema was changed even though he didn't
- Not really sure what was happening, but not really able to replicate reliably.
- 09:46 AM Revision 8602 (metacat): switch to ezid 1.0.0 release and pull from dev-testing.dataone.org Maven repo.
02/13/2014
- 03:12 PM Revision 8601 (metacat): loosen the restriction on which archive flags we set to false -- if we have an obsoleted_by value then it need not be marked as archived.
- 02:44 PM Revision 8600 (metacat): add [partial] upgrade to the oracle script -- does not look for any records that the CN deleted because there are no Oracle-backed MNs at this time.
- 02:25 PM Feature #6417: Call MN.archive() when SM.archive=true in MN.systemMetadataChanged()
- In general this sounds good, but won't calling MN.archive() result in other side effects (like other changes to syste...
- 02:11 PM Feature #6417: Call MN.archive() when SM.archive=true in MN.systemMetadataChanged()
- I added a comment in the code for where this could be done, but the actual method call is commented out.
- 02:01 PM Feature #6417 (Closed): Call MN.archive() when SM.archive=true in MN.systemMetadataChanged()
- We decided the CN should not call MN.archive() when it harvests SM from nodes and tries to inform other replicas abou...
- 02:08 PM Revision 8599 (metacat): add comment (and commented out code) for possibly inspecting the /dirtySysMeta call for archive=true flag. https://projects.ecoinformatics.org/ecoinfo/issues/6417
- 01:02 PM Revision 8598 (metacat): use '/var/metacat/users/password.xml' as the default password file path to: a) indicate it is for managing users and b) that it uses XML serialization. https://projects.ecoinformatics.org/ecoinfo/issues/6320
- 12:58 PM Revision 8597 (metacat): add a link to the authentication interface page so users can more easily find information on how to add users to the auth file.
- 12:04 PM Bug #6306 (In Progress): During the upgrading metacat to 2.3.0, a user can see a message saying the index schema was changed even though he didn't
- I included the md5 for the latest version of the schema we are shipping (customized in metacat-common).
Sounds lik... - 12:01 PM Revision 8596 (metacat): only index event information for known events. https://projects.ecoinformatics.org/ecoinfo/issues/6346
- 11:12 AM Revision 8595 (metacat): call getDescription on cn.setaccesspolicy service failure
02/12/2014
- 02:41 PM Feature #6415 (Closed): Make all objects publicly readable on MN.publish()
- Now making all objects in the published package publicly readable.
- 01:56 PM Revision 8594 (metacat): make all objects in a package publicly readable when published. https://projects.ecoinformatics.org/ecoinfo/issues/6415
- 09:12 AM Feature #6414 (Closed): Reject an insert or update/upload if the docid has white spaces in metacat api
- We added the code in the handleUpload, handleInsertOrUpdate and handleMultiPartInsertAction methods to enforce there ...
02/11/2014
- 02:19 PM Revision 8593 (metacat): Add the code to check if the docid contains the whitespaces in the handleInsertOrUpdate, handleUpload and handleInsertMultipartInsertAction methods.
- 02:15 PM Revision 8592 (metacat)
- 01:44 PM Feature #6415 (In Progress): Make all objects publicly readable on MN.publish()
- Changed in the repo -- needs testing.
- 10:25 AM Feature #6415 (Closed): Make all objects publicly readable on MN.publish()
- Feb 11th, 2014
matt: I think it should be made public, including data, but as Jing indicated, we should give them fa... - 01:43 PM Revision 8591 (metacat): make all package contents publicly readable when publishing with a DOI. https://projects.ecoinformatics.org/ecoinfo/issues/6415
- 01:29 PM Revision 8590 (metacat): Run syncAll in a single thread so admin config UI doesn't freeze
- 11:05 AM Revision 8589 (metacat): Change CnodeService.archive() to no longer broadcast MN.archive() calls to all of the replica MNs of a pid, but rather broadcast MN.systemMetadataChanged().
- 10:34 AM Feature #6416 (In Progress): Do not allow restrictive access control change to content with a DOI
02/10/2014
- 05:02 PM Feature #6414 (Closed): Reject an insert or update/upload if the docid has white spaces in metacat api
- I have a task to handle white spaces in the pids in the dataone production environment:
https://redmine.dataone.org/... - 04:17 PM Revision 8588 (metacat): allow utf-8 user first/last names to be used in responses for: login, logout, validatesession, getprincipals.
- 03:38 PM Revision 8587 (metacat): minor formatting error
- 03:33 PM Revision 8586 (metacat): Design document for the new Metacat statistics service
- 11:52 AM Revision 8585 (metacat): Couple modifications:
- -use "pid" throughout so as not to confuse docids and pids
-ensure any failures in the set do not prevent synching fo...
02/07/2014
- 04:41 PM Revision 8584 (metacat): use the metacatUI 1.4.5 that includes default metacat theme and context
- 04:17 PM Bug #6320 (Closed): Create a file-base authentication mechanism as the default method
- Made AuthFile the default in metacat.properties.
- 04:01 PM Revision 8583 (metacat): use AuthFile by default. https://projects.ecoinformatics.org/ecoinfo/issues/6320
- 03:52 PM Bug #6403 (Closed): Command-line user management does not handle hashed passwords
- Tested this on my localhost and it works with single quotes.
- 03:12 PM Revision 8582 (metacat): swap git command order to avoid merge conflict messages.
- 02:41 PM Bug #6401 (Closed): Add the documentation about the file-based the authentication
- Looks good now.
- 02:40 PM Feature #6402 (Closed): Rebrand identity service
- Now has logos and such....
- 02:20 PM Revision 8581 (metacat): adjust whitespace for consistency
- 02:20 PM Revision 8580 (metacat): include ID field as a minimum for indexing additional fields.
- 12:44 PM Task #6298 (Resolved): Call CN.setAccessPolicy() whenever access control rules are updated in Metacat
- EML200SaxHandler updated to sync access policies of data pids if access rules updated in <additionalMetadata>
- 12:40 PM Revision 8579 (metacat): sync pids of <distribution><online> data objects with CN when their access rules change in EML 2.0.* <additionalMetadata>
- 09:20 AM Revision 8578 (metacat): restrict the archived=false update to revisions that still have current entries in the xml_documents table.
02/06/2014
- 05:36 PM Revision 8577 (metacat): tested the restore insertions - adjusted for FK constraints. I was able to delete a document locally, then restore it, then update the document with a new revision as expected.
- 03:03 PM Revision 8576 (metacat): use 'with' query to find the most recent revision of an object that was archived. still want more feedback on the criteria.
- 02:42 PM Revision 8575 (metacat): Modified the usage.
- 11:56 AM Revision 8574 (metacat): continue to work on the criteria for selecting documents to restore.
- expanded the criteria for setting archived=false to include any revision that was already obsoleted_by somethign else.
- 08:25 AM Revision 8573 (metacat): Minor edits on the new AuthFile features.
Also available in: Atom