Project

General

Profile

Activity

From 06/13/2013 to 07/12/2013

07/13/2013

05:59 PM Feature #6031: Add rendered metadata to Bagit package contents
Moving to later release target so we can focus on other things first. ben leinfelder
05:25 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
Using the http solr server, the Metacat-index still indexed 337 documents which is less than 340. The 3 documents wer... Jing Tao

07/12/2013

03:58 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
So the number of the total documents which should be indexed is 340. I tested and got 337. And there is no error in ... Jing Tao

07/10/2013

01:12 PM Bug #6035: The system metadata table in a Metacat was messed up with the value of archived
The archive flag need not be set to true when there is an obsoletedBy value present. Either the obsoletedBy OR the ar... ben leinfelder
11:19 AM Bug #6035 (Rejected): The system metadata table in a Metacat was messed up with the value of archived
In the mn-demo-4.test.dataone.org, I queried the systemmetadata table and got:
metacat=> select count(*) from syst...
Jing Tao
01:09 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
I did couple queries and found the archived value in the systemmetadata was messed up. Please see the bug:
https://p...
Jing Tao

07/09/2013

03:41 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
After we modified the SystemMetadataEventListener class to listen to a dedicated map for indexing, I indexed the meta... Jing Tao
02:55 PM Task #5921 (Closed): Design and implement Metacat-Index module
Jing Tao
02:54 PM Task #5921: Design and implement Metacat-Index module
All sub-tasks were done. Close the feature. Jing Tao
02:52 PM Task #5923 (Closed): Discover missed documents and queue them for indexing
We create a HazelcastEventLog class.
When a timed indexing finishes, it will set a property in a file. The file co...
Jing Tao
12:41 PM Task #5923 (In Progress): Discover missed documents and queue them for indexing
This is well-underway, mostly just testing (I believe). ben leinfelder
02:50 PM Bug #5812: Rework default skin[s] to use SOLR query
TBD: actually do the same thing we did for the NCEAS skin (qformat=nceas) for the standard Metacat default skin (qfor... ben leinfelder
02:48 PM Story #5811 (Closed): Redesign KNB look and feel
See the entire MetacatUI project for details. https://projects.ecoinformatics.org/ecoinfo/projects/metacatui ben leinfelder
02:46 PM Task #6005 (Closed): Incomplete solr index for the data objects if the resourcemap was indexed first
When Metacat-index indexes a resource map document, it will check if all data objects of the resource map have been i... Jing Tao
02:45 PM Story #5940 (Closed): Support session-based Metacat authentication (for D1 services)
ben leinfelder
01:43 PM Story #5940 (In Progress): Support session-based Metacat authentication (for D1 services)
ben leinfelder
02:38 PM Task #5941 (Rejected): Add login/logout methods to DataONE MN service
These methods don't really fit with our current model. I think it's fine to allow the "back door" (i.e., Metacat serv... ben leinfelder
02:32 PM Feature #6034 (New): Simplify configuration for certificate delegation
So we don't loose this in the shuffle - we could probably fill out some of the MyProxy configuration values based on ... ben leinfelder
02:28 PM Feature #5936 (Closed): Include certificate delegation inside Metacat
ben leinfelder
01:41 PM Feature #5936 (In Progress): Include certificate delegation inside Metacat
Aside from making the myProxy configuration easier, this is done. It does require a bit of administration from regist... ben leinfelder
02:25 PM Bug #5395: Get unexpected result if a search was done before metacat finishes its indexing during the inserting process.
Deferring - though we don't really have a solution for this. Only affects a deprecated mechanism (pathquery), however. ben leinfelder
02:17 PM Feature #5910 (In Progress): Build index from scratch
ben leinfelder
02:16 PM Bug #2792 (Rejected): KNB home link needed on the Map Page
The entire KNB site is being redone, I don't even know if we will have a full map page! ben leinfelder
01:59 PM Task #5930 (Closed): Add a configuration property to turn on/off the indexing processes (SOLR indexing)
ben leinfelder
01:58 PM Feature #6033 (Closed): Add configuration to disable 'pathquery'
As we move toward SOLR-based query support, pathquery will play less of a role in Metacat. We should be able to disab... ben leinfelder
01:56 PM Feature #5913 (In Progress): Handle indexing errors
Remains to be seen how quickly this queue gets populated. We dont currently have any qualifiers on the kind of error ... ben leinfelder
01:53 PM Feature #5914 (Closed): Reconcile SOLR server/client versions
Both client and server are using v3.x now. Eventually DataONE plans to update the SOLR version, so we can consider t... ben leinfelder
01:46 PM Feature #5911 (In Progress): Repair index after outage
This may even be a duplicate of related task #5923 ben leinfelder
01:44 PM Feature #5912 (Closed): Force indexing on individual object[s]
There is now a Metacat servlet API action for this:... ben leinfelder
12:38 PM Task #5945 (Closed): Implement reindex action for individual PID
ben leinfelder
12:38 PM Task #5944 (Closed): Metacat-index need an IndexEvent and IndexEventLog mechanism
Main development on this is complete - enhancements to this can be added in other tasks. ben leinfelder
09:55 AM Bug #6030 (Closed): Deleting a document causes the method itemAdded(ItemEvent<SystemMetadata> entryEvent) in the SysteMetadataEventListener class being called twice
I used the morpho to test it and it seems that the issue was fixed. Jing Tao
06:20 PM Bug #6030 (In Progress): Deleting a document causes the method itemAdded(ItemEvent<SystemMetadata> entryEvent) in the SysteMetadataEventListener class being called twice
There were two calls to this - one in the D1 service implementation and another in the Metacat implementation that th... ben leinfelder
05:23 PM Bug #6030 (Closed): Deleting a document causes the method itemAdded(ItemEvent<SystemMetadata> entryEvent) in the SysteMetadataEventListener class being called twice
When we delete a document from the Metacat, the method itemAdded in the in the SysteMetadataEventListener class (Meta... Jing Tao
09:45 PM Feature #6031 (Rejected): Add rendered metadata to Bagit package contents
ben leinfelder

07/03/2013

10:15 AM Task #5945 (In Progress): Implement reindex action for individual PID
This is in trunk now. You must be logged in as admin of Metacat in order to invoke it which makes a JUnit test diffic... ben leinfelder
09:02 AM Task #5944 (In Progress): Metacat-index need an IndexEvent and IndexEventLog mechanism
I have the hzIndexEventMap set up and persisting IndexEvent objects to postgres db now (using Metacat's connection). ... ben leinfelder

07/02/2013

12:38 PM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
I queried the database and got the following result. There are 4998 in the xml_documents and 0 in the xml_revisions.
...
Jing Tao
12:18 PM Task #5924 (Closed): Add the configuration page for the Solr server in the Metacat configuration utility
Matt Jones
12:18 PM Task #5924: Add the configuration page for the Solr server in the Metacat configuration utility
Done. Ben added to main property page. Matt Jones
11:25 AM Task #5945: Implement reindex action for individual PID
Proposal is:
-create Metacat action "reindex" that takes an identifier.
-Metacat places the SystemMetadata for that...
ben leinfelder

06/25/2013

02:51 PM Task #5915 (Closed): Use MN.query(solr) in NCEAS skin
ben leinfelder
02:50 PM Task #5918 (Closed): Separate unit tests from integration tests
ben leinfelder
02:43 PM Bug #6007 (Resolved): Registry uses filename from upload form to save in temporary directory
I deployed this in KNB today (June 25th, 2013). This was not part of an official release but is in the code for 2.1.x... ben leinfelder
09:10 AM Bug #6009 (Closed): Metacat uses "metacat.output" temp files for all read() operations
This is in trunk now. ben leinfelder

06/24/2013

12:07 PM Bug #6009 (In Progress): Metacat uses "metacat.output" temp files for all read() operations
now reading directly from the filesystem, or in the case of EML with inline-data, the partial file contents. ben leinfelder

06/22/2013

09:47 PM Bug #6008 (Closed): Metacat servlet API upload() method uses user-supplied filename for temp upload
Now using File.createTempFile() and deleting the data files when done. ben leinfelder
05:32 PM Bug #6008 (Closed): Metacat servlet API upload() method uses user-supplied filename for temp upload
This can be problematic if users simultaneously attempt to upload a data file with the same name. ben leinfelder
05:35 PM Bug #6009 (Closed): Metacat uses "metacat.output" temp files for all read() operations
The KNB has 1.3 GB of these that have accumulated since ?.
There should be two scenarios:
-stream the contents fr...
ben leinfelder
05:02 PM Bug #6007: Registry uses filename from upload form to save in temporary directory
I deployed the changes on dev2.nceas for testing. Feel pretty good about them - using File::Temp to manager unique up... ben leinfelder

06/21/2013

12:22 PM Bug #6007 (Resolved): Registry uses filename from upload form to save in temporary directory
This can cause collisions when a room of 22 people all submit a datapackage with the same data file name....
The r...
ben leinfelder
05:28 PM Bug #6006 (Closed): Metacat admin screen requires metacat-index directories
Now skipping the template creation if metacat-index war is not deployed along with metacat. ben leinfelder

06/20/2013

04:59 PM Task #5943 (Resolved): Eliminate the unnecessary Systemmetadata event between the Metacat and Metacat-index modules.
Switched over to the new structure for communicating index events. Seems to be working as expected. ben leinfelder
10:22 AM Task #5944: Metacat-index need an IndexEvent and IndexEventLog mechanism
Added delete() method to remove entries that we do not need to reprocess again (because they were successful, finally... ben leinfelder

06/18/2013

02:54 PM Task #5943: Eliminate the unnecessary Systemmetadata event between the Metacat and Metacat-index modules.
Proposed solution is to use a different/independent structure for SystemMetadata events that should trigger a re-inde... ben leinfelder
12:35 PM Bug #6006 (Closed): Metacat admin screen requires metacat-index directories
When configuring Metacat there is a dependency on metacat-index. This should be gracefully skipped if that webapp is ... ben leinfelder
10:19 AM Task #6005 (Closed): Incomplete solr index for the data objects if the resourcemap was indexed first
Currently the resource map should be indexed after the data objects in the resource map were indexed. If the resource... Jing Tao

06/17/2013

10:31 AM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
Attached a log file for the indexing process. Jing Tao
10:30 AM Task #6004 (Resolved): Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
There are more 4000 data objects in the mn-demo-4. But we only gets 422 documents indexed. Jing Tao

06/14/2013

05:39 PM Bug #6003 (Closed): The "war" target in the metacat will build the metacat-index.war
We added the target which build metacat-index.war as the dependency of the "war" target. Jing Tao
05:37 PM Bug #6003 (Closed): The "war" target in the metacat will build the metacat-index.war
The "war" target in the metacat doesn't build the metacat-index.war in the dist directory. It only builds knb.war and... Jing Tao
05:35 PM Task #5930: Add a configuration property to turn on/off the indexing processes (SOLR indexing)
If we removed the "solr" from the engine list, metacat-index will not build index anymore. And the solr query will be... Jing Tao
 

Also available in: Atom