Metacat: Issueshttps://projects.ecoinformatics.org/ecoinfo/https://projects.ecoinformatics.org/ecoinfo/ecoinfo/favicon.ico?14691340362013-07-10T18:19:02ZEcoinformatics Redmine
Redmine Bug #6035 (Rejected): The system metadata table in a Metacat was messed up with the value of arch...https://projects.ecoinformatics.org/ecoinfo/issues/60352013-07-10T18:19:02ZJing Taotao@nceas.ucsb.edu
<p>In the mn-demo-4.test.dataone.org, I queried the systemmetadata table and got:</p>
<p>metacat=> select count(*) from systemmetadata where obsoleted_by is not null and archived=false;<br /> count <br />-------<br /> 4644<br />(1 row)</p>
<p>You see, there are 4644 documents which are not archived but have the obsoleted_by value. This is a contradiction.</p>
<p>Also, the xml_documents and xml_revisions table are messed up:</p>
<p>metacat=> select count(*) from xml_documents;<br /> count <br />-------<br /> 4998<br />(1 row)</p>
<p>metacat=> select count(*) from xml_revisions;<br /> count <br />-------<br /> 0</p>
<p>We need figure out why the metacat has this funny result.</p> Bug #6030 (Closed): Deleting a document causes the method itemAdded(ItemEvent<SystemMetadata> ent...https://projects.ecoinformatics.org/ecoinfo/issues/60302013-07-09T00:23:58ZJing Taotao@nceas.ucsb.edu
<p>When we delete a document from the Metacat, the method itemAdded in the in the SysteMetadataEventListener class (Metacat-index module) will be called because the haszelcast service. However, i figure the method will be call twice even though i only delete one document. This only happens for the deleting, the inserting works fine.</p>
<p>Here is the log:</p>
<p>Jul 08, 2013 5:17:25 PM edu.ucsb.nceas.metacat.index.SystemMetadataEventListener itemAdded<br />INFO: ===================================calling SystemMetadataEventListener.itemAdded method <br />Jul 08, 2013 5:17:25 PM edu.ucsb.nceas.metacat.index.SystemMetadataEventListener itemAdded<br />INFO: ===================================adding the document urn:uuid:e54bd099-e616-4f0d-be9d-f80df0f42354</p>
<p>........</p>
<p>Jul 08, 2013 5:17:25 PM edu.ucsb.nceas.metacat.index.SystemMetadataEventListener itemAdded<br />INFO: ===================================calling SystemMetadataEventListener.itemAdded method <br />Jul 08, 2013 5:17:25 PM edu.ucsb.nceas.metacat.index.SystemMetadataEventListener itemAdded<br />INFO: ===================================adding the document urn:uuid:e54bd099-e616-4f0d-be9d-f80df0f42354</p> Bug #6009 (Closed): Metacat uses "metacat.output" temp files for all read() operationshttps://projects.ecoinformatics.org/ecoinfo/issues/60092013-06-22T00:35:17Zben leinfelderleinfelder@nceas.ucsb.edu
<p>The KNB has 1.3 GB of these that have accumulated since ?.</p>
<p>There should be two scenarios:<br />-stream the contents from the metadata file on disk<br />-recompose the metadata file from the DB records to disk (/var/metacat/documents) then stream from that location.</p> Bug #6007 (Resolved): Registry uses filename from upload form to save in temporary directoryhttps://projects.ecoinformatics.org/ecoinfo/issues/60072013-06-21T19:22:02Zben leinfelderleinfelder@nceas.ucsb.edu
<p>This can cause collisions when a room of 22 people all submit a datapackage with the same data file name....</p>
<p>The registry should ensure that filenames it uses to write in a shared directory are unique.</p> Bug #6006 (Closed): Metacat admin screen requires metacat-index directorieshttps://projects.ecoinformatics.org/ecoinfo/issues/60062013-06-18T19:35:40Zben leinfelderleinfelder@nceas.ucsb.edu
<p>When configuring Metacat there is a dependency on metacat-index. This should be gracefully skipped if that webapp is not deployed. I believe it comes up when the solr-home directory is initialized.<br />This happens for CNs deploying Metacat in DataONE.</p> Task #6005 (Closed): Incomplete solr index for the data objects if the resourcemap was indexed firsthttps://projects.ecoinformatics.org/ecoinfo/issues/60052013-06-18T17:19:35ZJing Taotao@nceas.ucsb.edu
<p>Currently the resource map should be indexed after the data objects in the resource map were indexed. If the resource map was indexed first, then the solr index for the data objects will be incomplete.</p> Task #6004 (Resolved): Figure out why there are only 422 documents indexed in mn-demo-4.test.data...https://projects.ecoinformatics.org/ecoinfo/issues/60042013-06-17T17:30:49ZJing Taotao@nceas.ucsb.edu
<p>There are more 4000 data objects in the mn-demo-4. But we only gets 422 documents indexed.</p> Bug #5997 (Closed): Restrict KNB trusted CAshttps://projects.ecoinformatics.org/ecoinfo/issues/59972013-06-05T18:00:12Zben leinfelderleinfelder@nceas.ucsb.edu
<p>Instead of trusting all commercial CAs, the KNB Member Node should only trust the DataONE and CILogon certificate authorities.</p>
<p>To see a list of all them that are (currently) trusted:<br /><pre>openssl s_client -connect knb.ecoinformatics.org:443</pre></p> Task #5945 (Closed): Implement reindex action for individual PIDhttps://projects.ecoinformatics.org/ecoinfo/issues/59452013-05-24T23:38:32ZJing Taotao@nceas.ucsb.edu
<p>We may need issue a command to metacat-index to regenerate index for all missed ids or just regenerate one for a specified id.</p>
<p>If we add the servlet API to the metacat-index, we need to have authentication mechanism here. This is not what we want. We may add the API to the metacat. But we need to find a way to pass the information from metacat to metacat-index who really build the solr index.</p> Task #5944 (Closed): Metacat-index need an IndexEvent and IndexEventLog mechanismhttps://projects.ecoinformatics.org/ecoinfo/issues/59442013-05-24T23:31:05ZJing Taotao@nceas.ucsb.edu
<p>We need the IndexEvent and IndexEventLog to handle the events in building the solr index. For example, a failure event.</p>
<p>The classes can be:</p>
<p>IndexEvent<br />IndexEventResult<br />IndexEventLog : write(IndexEvent), List<IndexEvent> IndexEventLog.getEvents(pid, type, ...)</p>
<p>The IndexEvent can have those fields:<br />type<br />date<br />pid<br />description</p> Task #5943 (Resolved): Eliminate the unnecessary Systemmetadata event between the Metacat and Met...https://projects.ecoinformatics.org/ecoinfo/issues/59432013-05-24T23:24:11ZJing Taotao@nceas.ucsb.edu
<p>Currently we split metacat and metacat-index web apps. The communication between them is the Systemmetadata entry event and listener. Metadata generate a entry event and Metacat-index handle the event as a listener.</p>
<p>The entry event can be created even though there is no system metadata change. It maybe cause to rebuild the index.</p> Task #5942 (Closed): Handle sessionid (cookie from login method) in D1 REST servicehttps://projects.ecoinformatics.org/ecoinfo/issues/59422013-05-24T00:22:35Zben leinfelderleinfelder@nceas.ucsb.edu
<p>If there is no client certificate on the request or in the portal delegation store, then we should look for a valid sessionid and use the associated user for the rest of the request.</p> Task #5921 (Closed): Design and implement Metacat-Index modulehttps://projects.ecoinformatics.org/ecoinfo/issues/59212013-04-25T17:58:38ZJing Taotao@nceas.ucsb.edu
<p>We decided we would use as much the code of the d1_cn_index_processor as possible. The d1_cn_index_processor uses Spring module, but we don't want Metacat use it. So we decided we would use a separate module to build solr index for metacat. This module will be a sub directory in Metacat SVN repository. Metacat building process will build this module as well. The module will be deployed to web apps as a new context named Metacat-index.</p> Feature #5810 (Closed): Implement SOLR-based searchhttps://projects.ecoinformatics.org/ecoinfo/issues/58102013-01-24T20:26:43Zben leinfelderleinfelder@nceas.ucsb.edu
<p>This will be an implementation of the DataONE MNQuery() methods.</p> Bug #3816 (Closed): Export action doesn't create complete packagehttps://projects.ecoinformatics.org/ecoinfo/issues/38162009-02-10T02:02:05ZShaun Walbridgewalbridge@nceas.ucsb.edu
<p>When using the export action, two bugs are noticeable:</p>
<p>1. Documents with associated data tables have files with the data table names included, but no data contained within:</p>
<p><a class="external" href="http://knb.ecoinformatics.org/knb/metacat?action=export&qformat=nceas&docid=nceas.912.8">http://knb.ecoinformatics.org/knb/metacat?action=export&qformat=nceas&docid=nceas.912.8</a></p>
<p>2. The resulting files are named after the docid and not based on our sensible naming logic (e.g. mbauer.5 instead of nceas.912.8-mbauer.5.2-Benicia_CABE-107-1.txt). Check with Jim / Rick as to their preference. Probably in the context of the package, the metadata docid is superfluous, and the docid-filename form is correct (mbauer.5.2-Benicia_CABE-107.1.txt).</p>