Activity
From 06/14/2013 to 07/13/2013
07/12/2013
- 05:59 PM Feature #6031: Add rendered metadata to Bagit package contents
- Moving to later release target so we can focus on other things first.
- 05:25 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
- Using the http solr server, the Metacat-index still indexed 337 documents which is less than 340. The 3 documents wer...
- 03:58 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
- So the number of the total documents which should be indexed is 340. I tested and got 337. And there is no error in ...
07/10/2013
- 01:12 PM Bug #6035: The system metadata table in a Metacat was messed up with the value of archived
- The archive flag need not be set to true when there is an obsoletedBy value present. Either the obsoletedBy OR the ar...
- 11:19 AM Bug #6035 (Rejected): The system metadata table in a Metacat was messed up with the value of archived
- In the mn-demo-4.test.dataone.org, I queried the systemmetadata table and got:
metacat=> select count(*) from syst... - 01:09 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
- I did couple queries and found the archived value in the systemmetadata was messed up. Please see the bug:
https://p...
07/09/2013
- 03:41 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
- After we modified the SystemMetadataEventListener class to listen to a dedicated map for indexing, I indexed the meta...
- 02:55 PM Task #5921 (Closed): Design and implement Metacat-Index module
- 02:54 PM Task #5921: Design and implement Metacat-Index module
- All sub-tasks were done. Close the feature.
- 02:52 PM Task #5923 (Closed): Discover missed documents and queue them for indexing
- We create a HazelcastEventLog class.
When a timed indexing finishes, it will set a property in a file. The file co... - 12:41 PM Task #5923 (In Progress): Discover missed documents and queue them for indexing
- This is well-underway, mostly just testing (I believe).
- 02:50 PM Bug #5812: Rework default skin[s] to use SOLR query
- TBD: actually do the same thing we did for the NCEAS skin (qformat=nceas) for the standard Metacat default skin (qfor...
- 02:48 PM Story #5811 (Closed): Redesign KNB look and feel
- See the entire MetacatUI project for details. https://projects.ecoinformatics.org/ecoinfo/projects/metacatui
- 02:46 PM Task #6005 (Closed): Incomplete solr index for the data objects if the resourcemap was indexed first
- When Metacat-index indexes a resource map document, it will check if all data objects of the resource map have been i...
- 02:45 PM Story #5940 (Closed): Support session-based Metacat authentication (for D1 services)
- 01:43 PM Story #5940 (In Progress): Support session-based Metacat authentication (for D1 services)
- 02:38 PM Task #5941 (Rejected): Add login/logout methods to DataONE MN service
- These methods don't really fit with our current model. I think it's fine to allow the "back door" (i.e., Metacat serv...
- 02:32 PM Feature #6034 (New): Simplify configuration for certificate delegation
- So we don't loose this in the shuffle - we could probably fill out some of the MyProxy configuration values based on ...
- 02:28 PM Feature #5936 (Closed): Include certificate delegation inside Metacat
- 01:41 PM Feature #5936 (In Progress): Include certificate delegation inside Metacat
- Aside from making the myProxy configuration easier, this is done. It does require a bit of administration from regist...
- 02:25 PM Bug #5395: Get unexpected result if a search was done before metacat finishes its indexing during the inserting process.
- Deferring - though we don't really have a solution for this. Only affects a deprecated mechanism (pathquery), however.
- 02:17 PM Feature #5910 (In Progress): Build index from scratch
- 02:16 PM Bug #2792 (Rejected): KNB home link needed on the Map Page
- The entire KNB site is being redone, I don't even know if we will have a full map page!
- 01:59 PM Task #5930 (Closed): Add a configuration property to turn on/off the indexing processes (SOLR indexing)
- 01:58 PM Feature #6033 (Closed): Add configuration to disable 'pathquery'
- As we move toward SOLR-based query support, pathquery will play less of a role in Metacat. We should be able to disab...
- 01:56 PM Feature #5913 (In Progress): Handle indexing errors
- Remains to be seen how quickly this queue gets populated. We dont currently have any qualifiers on the kind of error ...
- 01:53 PM Feature #5914 (Closed): Reconcile SOLR server/client versions
- Both client and server are using v3.x now. Eventually DataONE plans to update the SOLR version, so we can consider t...
- 01:46 PM Feature #5911 (In Progress): Repair index after outage
- This may even be a duplicate of related task #5923
- 01:44 PM Feature #5912 (Closed): Force indexing on individual object[s]
- There is now a Metacat servlet API action for this:...
- 12:38 PM Task #5945 (Closed): Implement reindex action for individual PID
- 12:38 PM Task #5944 (Closed): Metacat-index need an IndexEvent and IndexEventLog mechanism
- Main development on this is complete - enhancements to this can be added in other tasks.
- 09:55 AM Bug #6030 (Closed): Deleting a document causes the method itemAdded(ItemEvent<SystemMetadata> entryEvent) in the SysteMetadataEventListener class being called twice
- I used the morpho to test it and it seems that the issue was fixed.
07/08/2013
- 09:45 PM Feature #6031 (Rejected): Add rendered metadata to Bagit package contents
- 06:20 PM Bug #6030 (In Progress): Deleting a document causes the method itemAdded(ItemEvent<SystemMetadata> entryEvent) in the SysteMetadataEventListener class being called twice
- There were two calls to this - one in the D1 service implementation and another in the Metacat implementation that th...
- 05:23 PM Bug #6030 (Closed): Deleting a document causes the method itemAdded(ItemEvent<SystemMetadata> entryEvent) in the SysteMetadataEventListener class being called twice
- When we delete a document from the Metacat, the method itemAdded in the in the SysteMetadataEventListener class (Meta...
07/03/2013
- 10:15 AM Task #5945 (In Progress): Implement reindex action for individual PID
- This is in trunk now. You must be logged in as admin of Metacat in order to invoke it which makes a JUnit test diffic...
- 09:02 AM Task #5944 (In Progress): Metacat-index need an IndexEvent and IndexEventLog mechanism
- I have the hzIndexEventMap set up and persisting IndexEvent objects to postgres db now (using Metacat's connection). ...
07/02/2013
- 12:38 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
- I queried the database and got the following result. There are 4998 in the xml_documents and 0 in the xml_revisions.
... - 12:18 PM Task #5924 (Closed): Add the configuration page for the Solr server in the Metacat configuration utility
- 12:18 PM Task #5924: Add the configuration page for the Solr server in the Metacat configuration utility
- Done. Ben added to main property page.
- 11:25 AM Task #5945: Implement reindex action for individual PID
- Proposal is:
-create Metacat action "reindex" that takes an identifier.
-Metacat places the SystemMetadata for that...
06/25/2013
- 02:51 PM Task #5915 (Closed): Use MN.query(solr) in NCEAS skin
- 02:50 PM Task #5918 (Closed): Separate unit tests from integration tests
- 02:43 PM Bug #6007 (Resolved): Registry uses filename from upload form to save in temporary directory
- I deployed this in KNB today (June 25th, 2013). This was not part of an official release but is in the code for 2.1.x...
- 09:10 AM Bug #6009 (Closed): Metacat uses "metacat.output" temp files for all read() operations
- This is in trunk now.
06/24/2013
- 12:07 PM Bug #6009 (In Progress): Metacat uses "metacat.output" temp files for all read() operations
- now reading directly from the filesystem, or in the case of EML with inline-data, the partial file contents.
06/21/2013
- 09:47 PM Bug #6008 (Closed): Metacat servlet API upload() method uses user-supplied filename for temp upload
- Now using File.createTempFile() and deleting the data files when done.
- 05:32 PM Bug #6008 (Closed): Metacat servlet API upload() method uses user-supplied filename for temp upload
- This can be problematic if users simultaneously attempt to upload a data file with the same name.
- 05:35 PM Bug #6009 (Closed): Metacat uses "metacat.output" temp files for all read() operations
- The KNB has 1.3 GB of these that have accumulated since ?.
There should be two scenarios:
-stream the contents fr... - 05:02 PM Bug #6007: Registry uses filename from upload form to save in temporary directory
- I deployed the changes on dev2.nceas for testing. Feel pretty good about them - using File::Temp to manager unique up...
- 12:22 PM Bug #6007 (Resolved): Registry uses filename from upload form to save in temporary directory
- This can cause collisions when a room of 22 people all submit a datapackage with the same data file name....
The r...
06/20/2013
- 05:28 PM Bug #6006 (Closed): Metacat admin screen requires metacat-index directories
- Now skipping the template creation if metacat-index war is not deployed along with metacat.
- 04:59 PM Task #5943 (Resolved): Eliminate the unnecessary Systemmetadata event between the Metacat and Metacat-index modules.
- Switched over to the new structure for communicating index events. Seems to be working as expected.
- 10:22 AM Task #5944: Metacat-index need an IndexEvent and IndexEventLog mechanism
- Added delete() method to remove entries that we do not need to reprocess again (because they were successful, finally...
06/18/2013
- 02:54 PM Task #5943: Eliminate the unnecessary Systemmetadata event between the Metacat and Metacat-index modules.
- Proposed solution is to use a different/independent structure for SystemMetadata events that should trigger a re-inde...
- 12:35 PM Bug #6006 (Closed): Metacat admin screen requires metacat-index directories
- When configuring Metacat there is a dependency on metacat-index. This should be gracefully skipped if that webapp is ...
- 10:19 AM Task #6005 (Closed): Incomplete solr index for the data objects if the resourcemap was indexed first
- Currently the resource map should be indexed after the data objects in the resource map were indexed. If the resource...
06/17/2013
- 10:31 AM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
- Attached a log file for the indexing process.
- 10:30 AM Task #6004 (Resolved): Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
- There are more 4000 data objects in the mn-demo-4. But we only gets 422 documents indexed.
Also available in: Atom