Metacat: Issueshttps://projects.ecoinformatics.org/ecoinfo/https://projects.ecoinformatics.org/ecoinfo/ecoinfo/favicon.ico?14691340362016-09-15T04:21:50ZEcoinformatics Redmine
Redmine Feature #7101 (Resolved): Metacat-index picks up the changes in log4j.properteis without restarti...https://projects.ecoinformatics.org/ecoinfo/issues/71012016-09-15T04:21:50ZJing Taotao@nceas.ucsb.edu
<p>Metacat can pick up the changes in log4j.properteis without restarting tomcat. However, Metacat-index can't. This is a good feature for production Metacat since it can decrease the down time.</p> Bug #7100 (Resolved): Metacat Replication doesn't happen if an object is created by MN.create or ...https://projects.ecoinformatics.org/ecoinfo/issues/71002016-09-12T22:47:32ZJing Taotao@nceas.ucsb.edu
<p>I set up the replication between my local host and mn-demo.</p>
<p>In a test case, if an object is created by Metacat API, the replication will happen. However if the object is created by MN.create or CN.create, the force replication will not happen.</p> Feature #7098 (Resolved): Add the feature to support the noNamespaceSchemaLocation attribute in ...https://projects.ecoinformatics.org/ecoinfo/issues/70982016-08-30T20:57:57ZJing Taotao@nceas.ucsb.edu
<p>Currently, Metacat caches the schemas with the combination keys of namespaces plus format ids. It set the property of "http://apache.org/xml/properties/schema/external-schemaLocation" to the sax parser for the schema validation. This doesn't work for the noNamespaceSchemaLocation since the schema in the attribute can't have a target namespace:<br />The noNamespaceSchemaLocation attribute references an XML Schema document that does not have a target namespace.<br />(please see <a class="external" href="https://msdn.microsoft.com/en-us/library/ms256139(v=vs.110).aspx">https://msdn.microsoft.com/en-us/library/ms256139(v=vs.110).aspx</a>)</p>
<p>The parser should be set by the property "http://apache.org/xml/properties/schema/external-noNamespaceSchemaLocation"</p> Feature #7097 (Resolved): Provide clear messages to clients if the namespaces/formatids of the sc...https://projects.ecoinformatics.org/ecoinfo/issues/70972016-08-30T20:48:54ZJing Taotao@nceas.ucsb.edu
<p>I believe currently the message for schema not found depends on the sax parser exception. It is not clear, we need improve the message.</p> Feature #7096 (Resolved): Disable the feature of downloading external schemas for unregistered na...https://projects.ecoinformatics.org/ecoinfo/issues/70962016-08-30T20:41:11ZJing Taotao@nceas.ucsb.edu
<p>Currently, Metacat will download the schemas during the metadata object inserting if it finds the namespaces is not found in the local cache system. In order to use the same schemas to validate xml objects, we need to disable the feature. <br />If the schemas of the object can't be found locally, Metacat will reject the documents (throw an exception). However, we need to provide those features for users:<br />1. A clear message to specify that the schema is not registered and contact Metacat operators.<br />2. A new admin page for Metacat operators to register schemas with/without namespaces.</p> Bug #7090 (Resolved): Change a Metacat member node's synchronization value on the admin page does...https://projects.ecoinformatics.org/ecoinfo/issues/70902016-08-24T00:06:32ZJing Taotao@nceas.ucsb.edu
<p><a class="external" href="https://redmine.dataone.org/issues/7861">https://redmine.dataone.org/issues/7861</a></p> Task #7087 (Closed): Remove the support of Oracle on documentationhttps://projects.ecoinformatics.org/ecoinfo/issues/70872016-08-17T22:19:29ZJing Taotao@nceas.ucsb.edu
<p>We dropped the support of oracle on 2.7.0. But we didn't remove it from documentation.</p> Bug #7086 (Resolved): External links in the registry should open in new tabhttps://projects.ecoinformatics.org/ecoinfo/issues/70862016-08-17T20:53:41ZLauren Walkerwalker@nceas.ucsb.eduBug #7084 (Closed): Metacat creates an Invalid Content-Disposition value for some filenameshttps://projects.ecoinformatics.org/ecoinfo/issues/70842016-08-10T23:35:10ZChris Jonescjones@nceas.ucsb.edu
<p>Related to <a class="issue tracker-1 status-3 priority-5 priority-highest closed" title="Bug: need to set filename for download files (Resolved)" href="https://projects.ecoinformatics.org/ecoinfo/issues/2566">#2566</a>, Metacat is now creating <code>Content-Disposition</code> HTTP headers with filenames either found in an objects' SystemMetadata, or constructing one from the identifier in it's absence. We've run into a minor issue when the stated filename in the SystemMetadata contains commas. For example, with:</p>
<p><a class="external" href="https://arcticdata.io/metacat/d1/mn/v2/meta/urn%3Auuid%3Ac043a14e-fce4-4e1b-8cc8-1649fe00f45f">https://arcticdata.io/metacat/d1/mn/v2/meta/urn%3Auuid%3Ac043a14e-fce4-4e1b-8cc8-1649fe00f45f</a></p>
<p>notice that the filename has commas. So, visiting:</p>
<p><a class="external" href="https://arcticdata.io/metacat/d1/mn/v2/object/urn%3Auuid%3Ac043a14e-fce4-4e1b-8cc8-1649fe00f45f">https://arcticdata.io/metacat/d1/mn/v2/object/urn%3Auuid%3Ac043a14e-fce4-4e1b-8cc8-1649fe00f45f</a></p>
<p>gives a <code>ERR_RESPONSE_HEADERS_MULTIPLE_CONTENT_DISPOSITION</code> in Chrome 52 on Mac. With FF on Mac, the file gets downloaded, but with the wrong name. It is truncated with a name of just 'Modeled '. Either way, I think the solution is to replace commas with underscores for filenames when setting the <code>Content-Disposition</code> header. I tried to figure out what was 'allowed'. <a href="https://tools.ietf.org/html/rfc2616#section-15.5" class="external">RFC 2616</a> says the <code>Content-Dispostion</code> header <code>filename-parm</code> is a 'quoted-string'. So, perhaps instead of doing character replacements, we just quote all filenames prior to building the header.</p> Bug #7083 (Closed): Metadata/data objects which have obsoletedBy field ignore the resource map in...https://projects.ecoinformatics.org/ecoinfo/issues/70832016-08-08T21:17:39ZJing Taotao@nceas.ucsb.edu
<p>Hi Bryce:</p>
<p>I looked at the index of the 16 objects and found 5 of them don't have the value of resource_map_urn:uuid:2e3c8c4c-e606-4710-b321-8edc4d506b0a at the resourceMap element:</p>
<p>urn%3Auuid%3A0f64673d-d270-411f-a5ed-98351d3d9450<br />urn%3Auuid%3A12c0ab6a-5eb3-43de-a16c-e71acaeb9817<br />urn%3Auuid%3A45ee065f-746e-4780-872b-d98cabeb0ad7<br />urn%3Auuid%3Aae90efa8-3cf5-4ff9-9637-c7be28b06541<br />urn%3Auuid%3Accebed0b-6bdb-4853-ba2a-6e88321ea4d5</p>
<p>So this is the reason you only get 11 documents when you query this resource map value.</p>
<p>And all of the five objects have the field "obsoletedBy" and the other 11 object don't have the field.</p>
<p>The reason why I looked at the field "obsoletedBy" is I recently found that there was a bug in the d1_cn_index_processor component - when you index a resource map, the component in the resource map will ignore the resource map if it has the "obsoletedBy" field. So this issue sounds like the reflection of this bug.</p>
<p>I will look at the metacat index code to make sure.</p>
<p>Thanks,</p>
<p>Jing</p>
<p>On 8/8/16 12:13 PM, Bryce Mecum wrote:</p>
<blockquote>
<p>So @scng got a hold of me to ask about strange behavior where there package table on two dataset pages are not showing the right number of files. This is a write up of what she told me and what I found so that someone else, <a class="user active" href="https://projects.ecoinformatics.org/ecoinfo/users/293">Jessica Couture</a> or <a class="user active" href="https://projects.ecoinformatics.org/ecoinfo/users/8">Chris Jones</a> can see about addressing it. This is a blocker on Bill Simpson's ticket RT12930.</p>
<p>This applies to two packages:</p>
<p>O-Buoy 8 (needs link)<br />O-Buoy 15</p>
<p>These two packages were recently updated to make them editable (adding otherEntity elements to the EML) by @scng using the R package.</p>
<p>If you look at O-Buoy 15, you'll see ten data objects in the package. However, the R @scng wrote intended to add 15 data objects to the package. If you look at the resource map, resource_map_urn:uuid:2e3c8c4c-e606-4710-b321-8edc4d506b0a, you'll see it aggregates+documents 16 PIDs (metadata + 15 data):</p>
<p>Here's an invalid and abridged section from the resource map, converted to Turtle format before pasting here:<br />...<br />ore:aggregates <<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A0f64673d-d270-411f-a5ed-98351d3d9450">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A0f64673d-d270-411f-a5ed-98351d3d9450</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A12c0ab6a-5eb3-43de-a16c-e71acaeb9817">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A12c0ab6a-5eb3-43de-a16c-e71acaeb9817</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A1584c53e-3d5c-4b70-9bf6-1033de8e2fd1">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A1584c53e-3d5c-4b70-9bf6-1033de8e2fd1</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A1c2d1c50-4d79-4fe5-b650-024e63818336">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A1c2d1c50-4d79-4fe5-b650-024e63818336</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A2e3c8c4c-e606-4710-b321-8edc4d506b0a">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A2e3c8c4c-e606-4710-b321-8edc4d506b0a</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A30a3a76c-c965-4594-8cfd-c652d46ebbe5">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A30a3a76c-c965-4594-8cfd-c652d46ebbe5</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A40d6e8e4-83eb-4579-8b00-90bf28282769">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A40d6e8e4-83eb-4579-8b00-90bf28282769</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A45ee065f-746e-4780-872b-d98cabeb0ad7">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A45ee065f-746e-4780-872b-d98cabeb0ad7</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A4eb92d77-19f4-4a3a-8468-4022926ea4e2">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A4eb92d77-19f4-4a3a-8468-4022926ea4e2</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A6d57e765-32a0-4a3e-ba12-5e681f92b7e5">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A6d57e765-32a0-4a3e-ba12-5e681f92b7e5</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A73926857-7d7c-4a6e-bce3-1556bd98df01">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A73926857-7d7c-4a6e-bce3-1556bd98df01</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A770eb22d-88bb-4c6f-9016-283f4ff7a518">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A770eb22d-88bb-4c6f-9016-283f4ff7a518</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A8539eac4-21f5-4a3a-8c0a-5ad7249cf38c">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3A8539eac4-21f5-4a3a-8c0a-5ad7249cf38c</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3Aae90efa8-3cf5-4ff9-9637-c7be28b06541">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3Aae90efa8-3cf5-4ff9-9637-c7be28b06541</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3Accebed0b-6bdb-4853-ba2a-6e88321ea4d5">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3Accebed0b-6bdb-4853-ba2a-6e88321ea4d5</a>><br /><<a class="external" href="https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3Ad54c9d42-99ce-415b-ac7c-a2b3498eb7af">https://cn.dataone.org/cn/v2/resolve/urn%3Auuid%3Ad54c9d42-99ce-415b-ac7c-a2b3498eb7af</a>> ;<br />...</p>
<p>So it looks like the Resource Map is correct which makes sense because it was generated using the R package.</p>
<p>The package view uses the Solr query resourceMap:{RESOURCE_MAP} to fill in the table. If you run this query you see the 11 objects, not 16. This explains the table view not showing all the files.</p>
<p>If you look at the documents section of the metadata object's Solr doc, you'll see the 16 objects it documents (itself + 15 data objects.</p>
<p>So what's going on here? Am I wrong to think that it's just the index that is showing the wrong information?</p>
<p>I have forced a reindex with no change<br />I have not checked the arctica logs for any errors</p>
</blockquote> Bug #7081 (Resolved): All links on the registry page should open up in a new tabhttps://projects.ecoinformatics.org/ecoinfo/issues/70812016-08-08T18:47:45ZLauren Walkerwalker@nceas.ucsb.edu
<p>We got feedback from a user recently who clicked on the CC license lnk in the registry, so the registry form was wiped after leaving the page. Make sure all links open in a new tab.</p> Support #7076 (Closed): Migrate metacat build to use EML git repohttps://projects.ecoinformatics.org/ecoinfo/issues/70762016-07-28T02:50:38ZMatt Jonesjones@nceas.ucsb.edu
<p>The EML source repository migrated to <a class="external" href="https://github.com/NCEAS/eml">https://github.com/NCEAS/eml</a> . Modify the Metacat build.xml to use git accordingly.</p> Bug #7063 (Closed): Legacy Metacat "shortcut" url does not work if revision is omittedhttps://projects.ecoinformatics.org/ecoinfo/issues/70632016-07-25T18:39:29Zben leinfelderleinfelder@nceas.ucsb.edu
<p>There was an NCEAS help ticket where the UI appeared but was not able to render the data. Looks like our handling of the shortcut URLs assumes full accession number (scope.docid.rev). We should handle cases where it is just scope.docid.</p>