Metacat: Issueshttps://projects.ecoinformatics.org/ecoinfo/https://projects.ecoinformatics.org/ecoinfo/ecoinfo/favicon.ico?14691340362013-07-10T18:19:02ZEcoinformatics Redmine
Redmine Bug #6035 (Rejected): The system metadata table in a Metacat was messed up with the value of arch...https://projects.ecoinformatics.org/ecoinfo/issues/60352013-07-10T18:19:02ZJing Taotao@nceas.ucsb.edu
<p>In the mn-demo-4.test.dataone.org, I queried the systemmetadata table and got:</p>
<p>metacat=> select count(*) from systemmetadata where obsoleted_by is not null and archived=false;<br /> count <br />-------<br /> 4644<br />(1 row)</p>
<p>You see, there are 4644 documents which are not archived but have the obsoleted_by value. This is a contradiction.</p>
<p>Also, the xml_documents and xml_revisions table are messed up:</p>
<p>metacat=> select count(*) from xml_documents;<br /> count <br />-------<br /> 4998<br />(1 row)</p>
<p>metacat=> select count(*) from xml_revisions;<br /> count <br />-------<br /> 0</p>
<p>We need figure out why the metacat has this funny result.</p> Bug #6030 (Closed): Deleting a document causes the method itemAdded(ItemEvent<SystemMetadata> ent...https://projects.ecoinformatics.org/ecoinfo/issues/60302013-07-09T00:23:58ZJing Taotao@nceas.ucsb.edu
<p>When we delete a document from the Metacat, the method itemAdded in the in the SysteMetadataEventListener class (Metacat-index module) will be called because the haszelcast service. However, i figure the method will be call twice even though i only delete one document. This only happens for the deleting, the inserting works fine.</p>
<p>Here is the log:</p>
<p>Jul 08, 2013 5:17:25 PM edu.ucsb.nceas.metacat.index.SystemMetadataEventListener itemAdded<br />INFO: ===================================calling SystemMetadataEventListener.itemAdded method <br />Jul 08, 2013 5:17:25 PM edu.ucsb.nceas.metacat.index.SystemMetadataEventListener itemAdded<br />INFO: ===================================adding the document urn:uuid:e54bd099-e616-4f0d-be9d-f80df0f42354</p>
<p>........</p>
<p>Jul 08, 2013 5:17:25 PM edu.ucsb.nceas.metacat.index.SystemMetadataEventListener itemAdded<br />INFO: ===================================calling SystemMetadataEventListener.itemAdded method <br />Jul 08, 2013 5:17:25 PM edu.ucsb.nceas.metacat.index.SystemMetadataEventListener itemAdded<br />INFO: ===================================adding the document urn:uuid:e54bd099-e616-4f0d-be9d-f80df0f42354</p> Bug #6009 (Closed): Metacat uses "metacat.output" temp files for all read() operationshttps://projects.ecoinformatics.org/ecoinfo/issues/60092013-06-22T00:35:17Zben leinfelderleinfelder@nceas.ucsb.edu
<p>The KNB has 1.3 GB of these that have accumulated since ?.</p>
<p>There should be two scenarios:<br />-stream the contents from the metadata file on disk<br />-recompose the metadata file from the DB records to disk (/var/metacat/documents) then stream from that location.</p> Bug #6007 (Resolved): Registry uses filename from upload form to save in temporary directoryhttps://projects.ecoinformatics.org/ecoinfo/issues/60072013-06-21T19:22:02Zben leinfelderleinfelder@nceas.ucsb.edu
<p>This can cause collisions when a room of 22 people all submit a datapackage with the same data file name....</p>
<p>The registry should ensure that filenames it uses to write in a shared directory are unique.</p> Bug #6006 (Closed): Metacat admin screen requires metacat-index directorieshttps://projects.ecoinformatics.org/ecoinfo/issues/60062013-06-18T19:35:40Zben leinfelderleinfelder@nceas.ucsb.edu
<p>When configuring Metacat there is a dependency on metacat-index. This should be gracefully skipped if that webapp is not deployed. I believe it comes up when the solr-home directory is initialized.<br />This happens for CNs deploying Metacat in DataONE.</p> Task #6005 (Closed): Incomplete solr index for the data objects if the resourcemap was indexed firsthttps://projects.ecoinformatics.org/ecoinfo/issues/60052013-06-18T17:19:35ZJing Taotao@nceas.ucsb.edu
<p>Currently the resource map should be indexed after the data objects in the resource map were indexed. If the resource map was indexed first, then the solr index for the data objects will be incomplete.</p> Task #6004 (Resolved): Figure out why there are only 422 documents indexed in mn-demo-4.test.data...https://projects.ecoinformatics.org/ecoinfo/issues/60042013-06-17T17:30:49ZJing Taotao@nceas.ucsb.edu
<p>There are more 4000 data objects in the mn-demo-4. But we only gets 422 documents indexed.</p> Bug #5997 (Closed): Restrict KNB trusted CAshttps://projects.ecoinformatics.org/ecoinfo/issues/59972013-06-05T18:00:12Zben leinfelderleinfelder@nceas.ucsb.edu
<p>Instead of trusting all commercial CAs, the KNB Member Node should only trust the DataONE and CILogon certificate authorities.</p>
<p>To see a list of all them that are (currently) trusted:<br /><pre>openssl s_client -connect knb.ecoinformatics.org:443</pre></p> Task #5945 (Closed): Implement reindex action for individual PIDhttps://projects.ecoinformatics.org/ecoinfo/issues/59452013-05-24T23:38:32ZJing Taotao@nceas.ucsb.edu
<p>We may need issue a command to metacat-index to regenerate index for all missed ids or just regenerate one for a specified id.</p>
<p>If we add the servlet API to the metacat-index, we need to have authentication mechanism here. This is not what we want. We may add the API to the metacat. But we need to find a way to pass the information from metacat to metacat-index who really build the solr index.</p> Task #5944 (Closed): Metacat-index need an IndexEvent and IndexEventLog mechanismhttps://projects.ecoinformatics.org/ecoinfo/issues/59442013-05-24T23:31:05ZJing Taotao@nceas.ucsb.edu
<p>We need the IndexEvent and IndexEventLog to handle the events in building the solr index. For example, a failure event.</p>
<p>The classes can be:</p>
<p>IndexEvent<br />IndexEventResult<br />IndexEventLog : write(IndexEvent), List<IndexEvent> IndexEventLog.getEvents(pid, type, ...)</p>
<p>The IndexEvent can have those fields:<br />type<br />date<br />pid<br />description</p> Task #5943 (Resolved): Eliminate the unnecessary Systemmetadata event between the Metacat and Met...https://projects.ecoinformatics.org/ecoinfo/issues/59432013-05-24T23:24:11ZJing Taotao@nceas.ucsb.edu
<p>Currently we split metacat and metacat-index web apps. The communication between them is the Systemmetadata entry event and listener. Metadata generate a entry event and Metacat-index handle the event as a listener.</p>
<p>The entry event can be created even though there is no system metadata change. It maybe cause to rebuild the index.</p> Task #5942 (Closed): Handle sessionid (cookie from login method) in D1 REST servicehttps://projects.ecoinformatics.org/ecoinfo/issues/59422013-05-24T00:22:35Zben leinfelderleinfelder@nceas.ucsb.edu
<p>If there is no client certificate on the request or in the portal delegation store, then we should look for a valid sessionid and use the associated user for the rest of the request.</p> Task #5941 (Rejected): Add login/logout methods to DataONE MN servicehttps://projects.ecoinformatics.org/ecoinfo/issues/59412013-05-24T00:19:17Zben leinfelderleinfelder@nceas.ucsb.edu
<p>These will use the existing functionality of Metacat servlet's action=login/logout.</p> Story #5940 (Closed): Support session-based Metacat authentication (for D1 services)https://projects.ecoinformatics.org/ecoinfo/issues/59402013-05-24T00:17:36Zben leinfelderleinfelder@nceas.ucsb.edu
<p>We want to be able to deploy Metacat without relying on DataONE, CILogon, ECP, or even client certificates.</p>
<p>Idea is that the Metacat/DataONE servlets will continue to look for the sessionid that is set with a successful login action and use that identity if no client certificate of delegated certificate is found on the request.</p> Feature #5939 (Closed): Create view service that can render metadata documents at REST URLhttps://projects.ecoinformatics.org/ecoinfo/issues/59392013-05-23T23:44:25ZMatt Jonesjones@nceas.ucsb.edu
<p>We need a 'landing page' for metadata views that can be referenced as REST URLs and that show an HTML'ised version of an object using its PID. A service might have a REST url of the form:</p>
<p><del><a class="external" href="https://metacat.someplace.org/knb/d1/mn/v1/view/{pid">https://metacat.someplace.org/knb/d1/mn/v1/view/{pid</a>}</del><br /><a class="external" href="https://data.somplace.org/metacat/d1/mn/v1/views/{format}/{pid">https://data.somplace.org/metacat/d1/mn/v1/views/{format}/{pid</a>}</p>
<p>where {pid} is the permenant identifier for the metadata document. Such a URL landing page would prbably deliver an HTML version of the metadata. An optional ?format=knb parameter might be used to control which CSS file is linked into the page, or maybe we just omit the CSS altogether and assume we are delivering just an HTML fragment to a client? Needs more discussion.</p>
<p>This service would be used in several places, including the landing page URL for the new backbone based UI, and as the URL that is written into sitemaps that are published to google and elsewhere for search engines to index.</p>