Consider giving the user special feedback when viewing data packages with many (>1000) files
When you visit a data package with more than 1000 files, there is no indication that the "Files in this dataset' listing is truncated.
It might be nice to let the user know that the list is truncated. See:
The above data package has ~3000 files and only 1000 show up. A side-effect of the truncation is that the metadata object isn't returned in the Solr query that populates the page so it appears that this data package doesn't have metadata.
- Increasing the limit value on the Solr query. This is probably a bad idea.
- Consider detecting the truncation by comparing the number of results returned and and limit Metacat UI sets on that query and, if they're equal, suggest to the user that their data table might be truncated and could be missing files.
- Consider detecting the truncation for sure with another query to Solr and querying specifically for the metadata object so truncation doesn't affect whether the metadata object shows up in the table or not
Not a breaking issue since Arctica won't have packages with more than 100 files.