Activity
From 05/21/2013 to 06/19/2013
06/18/2013
- 02:59 PM Revision 7809 (metacat): do not create solr-home if there is no template to compy into that directory (need to be able to create it later if/when someone decides to use and deploy metacat-index). https://projects.ecoinformatics.org/ecoinfo/issues/6006
- 02:54 PM Task #5943: Eliminate the unnecessary Systemmetadata event between the Metacat and Metacat-index modules.
- Proposed solution is to use a different/independent structure for SystemMetadata events that should trigger a re-inde...
- 01:54 PM Revision 7808 (metacat): do not attempt to copy solr-home template from metacat-index webapp if it does not exist. This would be in cases where metacat-index is not deployed. https://projects.ecoinformatics.org/ecoinfo/issues/6006
- 12:35 PM Bug #6006 (Closed): Metacat admin screen requires metacat-index directories
- When configuring Metacat there is a dependency on metacat-index. This should be gracefully skipped if that webapp is ...
- 10:19 AM Task #6005 (Closed): Incomplete solr index for the data objects if the resourcemap was indexed first
- Currently the resource map should be indexed after the data objects in the resource map were indexed. If the resource...
06/17/2013
- 05:07 PM Revision 7807 (metacat): Add code to implment set and get the last processed date.
- 04:28 PM Revision 7806 (metacat): It will make the index only for those objects which were modified after the marked time.
- 01:50 PM Revision 7805 (metacat): Add set and get the lastprocessedDate in the IndexEventLog.
- Remove the code to write the successful event.
- 10:31 AM Task #6004: Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
- Attached a log file for the indexing process.
- 10:30 AM Task #6004 (Resolved): Figure out why there are only 422 documents indexed in mn-demo-4.test.dataone.org
- There are more 4000 data objects in the mn-demo-4. But we only gets 422 documents indexed.
06/13/2013
- 05:39 PM Bug #6003 (Closed): The "war" target in the metacat will build the metacat-index.war
- We added the target which build metacat-index.war as the dependency of the "war" target.
- 05:37 PM Bug #6003 (Closed): The "war" target in the metacat will build the metacat-index.war
- The "war" target in the metacat doesn't build the metacat-index.war in the dist directory. It only builds knb.war and...
- 05:35 PM Task #5930: Add a configuration property to turn on/off the indexing processes (SOLR indexing)
- If we removed the "solr" from the engine list, metacat-index will not build index anymore. And the solr query will be...
- 05:20 PM Revision 7804 (metacat): Add the dataone repository.
- 04:41 PM Revision 7803 (metacat): The "war" target will build the metacat-index.war as well.
06/12/2013
- 02:36 PM Revision 7802 (metacat): Log the timed index jobs.
- 02:08 PM Revision 7801 (metacat): Add the code to log the failed events.
06/11/2013
- 06:24 PM Revision 7800 (metacat): Add a temporary file log for debugging.
- 06:23 PM Revision 7799 (metacat): Use commons-io 2.4
- 03:47 PM Revision 7798 (metacat): Add a new property for the index event log class name.
06/07/2013
- 04:38 PM Revision 7797 (metacat): Add a serial number for the event.
- Add method to set events to be archived.
- 11:56 AM Feature #5936: Include certificate delegation inside Metacat
- There's now the package "edu.ucsb.nceas.metacat.portal" that does the authentication delegation. You start a request ...
- 11:22 AM Revision 7796 (metacat): Add a new class variable - isArchived for class IndexEvent.
06/06/2013
- 04:13 PM Revision 7795 (metacat): Update the documentation about those classes.
- 03:48 PM Bug #5997 (Closed): Restrict KNB trusted CAs
- Commented out the line that includes all CAs in /etc/ssl/certs and reloaded Apache. Now we are down to the short list...
- 03:17 PM Revision 7794 (metacat): Add a event and eventlog for the index.
06/05/2013
- 03:03 PM Revision 7793 (metacat): Use the identifier set to get the list of ids in the member node.
- 02:20 PM Revision 7792 (metacat): The returned ISet should be Identifier.
- 01:50 PM Revision 7791 (metacat): Add code to test getIdentifierSet method.
- 01:50 PM Revision 7790 (metacat): Add method to get identifier set.
- 11:02 AM Bug #5997: Restrict KNB trusted CAs
- We should be able to simply use the DataONE chain file that we have installed already:...
- 11:00 AM Bug #5997 (Closed): Restrict KNB trusted CAs
- Instead of trusting all commercial CAs, the KNB Member Node should only trust the DataONE and CILogon certificate aut...
06/04/2013
- 02:49 PM Revision 7789 (metacat): Add a new property to specify the interval of a Timer to run the thread generating solr index.
- 02:47 PM Revision 7788 (metacat): Set up a Timer to run the regenerating solr index task periodically.
06/03/2013
- 05:36 PM Task #5922 (Closed): Modify the solr index configuration for the resource map
- We rewrote the ResourceMapSubprocessor class which now uses the SolrServer.
- 05:22 PM Task #5937 (Closed): The solr indexes of the data file contains obsoleted ids for the resourcemap and documentBy element after updating a data package
- Add code to modify the "documents", "resourceMap" and "documentedBy" element in the solr doc when archive happens.
- 04:35 PM Revision 7787 (metacat): Use the ";" as the seperator to replace "," in the resource name spaces.
05/31/2013
- 03:29 PM Revision 7786 (metacat): Add code to handle delete data package information when delete a pid in the solr index.
- 02:05 PM Revision 7785 (metacat): Add two static methods to get the SystemMetadata and data object InputStream for the specified id.
05/28/2013
- 05:19 PM Revision 7784 (metacat): Change the code since the ApplicationController's constructor was changed.
- 05:18 PM Revision 7783 (metacat): Add code to check if the metacat.properties is available.
- 01:21 PM Revision 7782 (metacat): If solr is not enabled, it would not be running.
- 01:20 PM Revision 7781 (metacat): Solr will be enabled if it is in the db.enabledEngines.
- 01:18 PM Revision 7780 (metacat): Use ";" to separate db.enabledEngines.
05/24/2013
- 06:16 PM Task #5994 (New): Create REST API for accessing statistics
- For objects, users, packages, nodes, etc.
- 06:15 PM Task #5993 (New): Summarize and index statistics for fast access
- 06:15 PM Task #5992 (New): Track citations
- Or interface with Impact Story
- 06:14 PM Task #5991 (New): Track views
- 06:14 PM Task #5990 (New): Track downloads
- 06:14 PM Feature #5989 (In Progress): Track data download, view and citation statistics
- Currently the only usage stats we have in Metacat are the raw logs. This new service would provide several statistic...
- 04:47 PM Revision 7779 (metacat): Use the ";" as the seperator for properties.
- 04:38 PM Task #5945 (Closed): Implement reindex action for individual PID
- We may need issue a command to metacat-index to regenerate index for all missed ids or just regenerate one for a spec...
- 04:31 PM Task #5944 (Closed): Metacat-index need an IndexEvent and IndexEventLog mechanism
- We need the IndexEvent and IndexEventLog to handle the events in building the solr index. For example, a failure even...
- 04:24 PM Task #5943 (Resolved): Eliminate the unnecessary Systemmetadata event between the Metacat and Metacat-index modules.
- Currently we split metacat and metacat-index web apps. The communication between them is the Systemmetadata entry eve...
- 04:12 PM Task #5926 (Resolved): Metacat-index doesn't build solr index during a Metadata inserting document
- It turned out that the solr doc was generated. However, the building index and querying index use different EmbeddedS...
- 04:05 PM Task #5927 (Resolved): Implements listing the query engines and fields for the solr query engine
- We add a new class - MetacatSolrEngineDescriptionHandler to handle the request. It works on both http solr server and...
- 04:03 PM Task #5822 (Resolved): Enforce access control for SOLR-based search implementation
- 04:02 PM Task #5904 (Resolved): Design mechanism to enforce access policy
- We append a filter query to enforce the access rules.
- 04:01 PM Task #5905 (Resolved): Implement access control filter
- Add junit test to test the public, specified user and group users readable documents. Also it tests a use with untru...
- 03:58 PM Task #5820 (Resolved): Incorporate DataONE indexing
- Create metacat-index web apps to avoid the spring in the metacat. We also create the metacat-common to share code bet...
- 03:57 PM Task #5819 (Resolved): MN query for SOLR
- The query and query description is done.
- 03:56 PM Task #5906 (Resolved): Implement MetacatSolrIndex class
- We added two classes MetacatSolrIndex and MetacatSolrEngineDescriptionHandler. This two classes handle the query and ...
- 03:07 PM Task #5942 (Closed): Handle sessionid (cookie from login method) in D1 REST service
- This is now in D1ResourceHandler in Metacat trunk
- 10:20 AM Revision 7778 (metacat): do not require PortalCertificateManager be configured. Fix NPE because session was not created when using old sessionid-based authentication. https://projects.ecoinformatics.org/ecoinfo/issues/5942
- 12:09 AM Revision 7777 (metacat): change the waiting time to 10 seconds and attempts to 600 for the hazelcast.
05/23/2013
- 11:57 PM Revision 7776 (metacat): Use another thread in the Servlet init method to wait hazelcast.
- 10:42 PM Revision 7775 (metacat): Make the target init depend on build-metacat-common.
- 09:59 PM Revision 7774 (metacat): Put the waiting mechanism for the hazelcast at the first place.
- 09:45 PM Revision 7773 (metacat): handle client certificates, portal certificates and jsessionid as three ways to prove you are an uthenticated user. https://projects.ecoinformatics.org/ecoinfo/issues/5942
- 06:39 PM Revision 7772 (metacat): Use some contants from the EnabledQueryEngines.
- 06:28 PM Revision 7771 (metacat): Temporarily remove the code to disable solr engine if it isn't listed in the property file.
- 05:22 PM Task #5942 (Closed): Handle sessionid (cookie from login method) in D1 REST service
- If there is no client certificate on the request or in the portal delegation store, then we should look for a valid s...
- 05:19 PM Task #5941 (Rejected): Add login/logout methods to DataONE MN service
- These will use the existing functionality of Metacat servlet's action=login/logout.
- 05:17 PM Story #5940 (Closed): Support session-based Metacat authentication (for D1 services)
- We want to be able to deploy Metacat without relying on DataONE, CILogon, ECP, or even client certificates.
Idea i... - 04:44 PM Feature #5939 (Closed): Create view service that can render metadata documents at REST URL
- We need a 'landing page' for metadata views that can be referenced as REST URLs and that show an HTML'ised version of...
- 04:41 PM Feature #5936: Include certificate delegation inside Metacat
- Here's the documentation for MyProxy that I was using to set this all up: http://grid.ncsa.illinois.edu/myproxy/oauth...
- 04:29 PM Revision 7770 (metacat): exlude /lib/maven from the war file
- 04:27 PM Revision 7769 (metacat): If the solr engine is disabled, the metacat index will do nothing.
- 01:43 PM Revision 7768 (metacat): Use the new name of a method.
- 01:42 PM Revision 7767 (metacat): Rename a method to isEnabled.
- 01:26 PM Revision 7766 (metacat): Updated documentation, and added modification date to the sitemap index file entries.
- 12:55 PM Revision 7765 (metacat): Remove unused import.
- 12:52 PM Revision 7764 (metacat): Mofdified Sitemap class to also generate the sitemap index file that is needed when more than one sitemap file is provided.
- 12:42 PM Revision 7763 (metacat): Remove the junit test for an obsoleted class.
- 12:41 PM Revision 7762 (metacat): Remove the obsoleted class.
- 12:40 PM Revision 7761 (metacat): Add a junit test class for EnabledQueryEngines.
- 12:40 PM Revision 7760 (metacat): Add a test base class.
- 12:39 PM Revision 7759 (metacat): Add a class to repsent the enabled engine list.
- 11:55 AM Revision 7758 (metacat): Change the junit version to 4.8
- 10:20 AM Revision 7757 (metacat): use ContentTypeInputStream interface (and ByteArray implementation) to specify the desired content-type of the InputStream returned by MN.query().
- 09:15 AM Revision 7756 (metacat): Add the new property dbquery.enabledEngines=pathquery,solr.
05/22/2013
- 04:44 PM Revision 7755 (metacat): load the evicted SM back into the map on a "Refresh" so that listeners hear the update. (metacat-index, for example)
- 04:18 PM Revision 7754 (metacat): set the dataone.hazelcast.location.clientconfig property to be the local config file. It will be used in the d1_cn_index_processor
- 03:50 PM Revision 7753 (metacat): use DataONE cilogon skin so that we are not prompted for certificate duration (and to make it more cohesive as a prototype using the Metacat DataONE skin
- 03:49 PM Revision 7752 (metacat): switch back to log4j statements now that I am sure certificate delegation is working.
- 03:35 PM Revision 7751 (metacat): add link to login or switch user
- 03:29 PM Revision 7750 (metacat): add simple page to show logged-in user subject DN
- 03:02 PM Revision 7749 (metacat): use System.out.println until the oa4mp logging issue is resolved.
- 11:23 AM Task #5928 (Closed): Make sure to start metacat-index web apps when the metacat web apps is start-up during the tomcat startup
- Added the mechanism to wait some time if the MNode or the Hazelcast is not ready. We also add a maximum attempt contr...
- 11:19 AM Revision 7748 (metacat): Read the waiting time and maximum attempts from the metacat.properties file.
- 10:56 AM Revision 7747 (metacat): Add the waiting time and max attempts for regenerating the index.
- 10:36 AM Revision 7746 (metacat): use filesystem store. in-memory store seems to get into deadlock with multiple environments accessing it.
- 10:34 AM Revision 7745 (metacat): add logging for portal certificate look up process.
- 10:29 AM Revision 7744 (metacat): Add some new properties for the test.
- 09:34 AM Revision 7743 (metacat): use relative path for oa4mp_client.xml (within servlet context). https://projects.ecoinformatics.org/ecoinfo/issues/5936
- 08:05 AM Revision 7742 (metacat): use in-memory storage for myproxy. at least for now.
05/21/2013
- 11:35 PM Revision 7741 (metacat): Add a property containing the list of the resource map namespaces.
- 11:33 PM Revision 7740 (metacat): Index the none-resourcemap data objects first, then the resourcemap objects.
- 11:32 PM Revision 7739 (metacat): used pk8 format private key file name
- 11:12 PM Revision 7738 (metacat): use java 1.6 compliance for compilation
- 11:05 PM Revision 7737 (metacat): first pass at integrating CILogon/MyProxy certificates in Metacat. Configuration is specific to mn-demo-4.test.dataone.org for the time being (this will cause localhost deployments to fail webapp deployment). https://projects.ecoinformatics.org/ecoinfo/issues/5936
- 11:05 PM Revision 7736 (metacat): first pass at integrating CILogon/MyProxy certificates in Metacat. Configuration is specific to mn-demo-4.test.dataone.org for the time being (this will cause localhost deployments to fail webapp deployment). https://projects.ecoinformatics.org/ecoinfo/issues/5936
- 07:35 PM Bug #5938 (Closed): sitemap format is deprecated
- Updated the namespace to use the 0.9 format. No other changes needed for validity. Committed in r7735.
- 07:34 PM Bug #5938 (Closed): sitemap format is deprecated
- The sitemap format used by Metacat has been deprecated, and should be updated to the current release (0.9) as publish...
- 07:32 PM Revision 7735 (metacat): Updated Sitemap generation to use latest version of the sitemap protocol schemas.
- 02:23 PM Revision 7734 (metacat): Try to get the metacat ids first.
- 11:29 AM Task #5937 (Closed): The solr indexes of the data file contains obsoleted ids for the resourcemap and documentBy element after updating a data package
- I used a morpho to insert a data package which includes the data file, eml file and resource map file to the metacat....
- 11:11 AM Revision 7733 (metacat): Use SolrQueryServiceController to get the ValidFieldList.
Also available in: Atom