To attempt to address performance and stability WRT Hazelcast communication, we're upgrading to the 2.x series of Hazelcast. remove the 1.9.x jar files, and add the 2.4.1-SNAPSHOT jars. Modify HazelcastService to handle the minor change in the ItemListener interface (now passes ItemEvent<Identifier> as an argument)....
use ObjectFormatInfo libclient utility to look up mimeType and filename extension during get() calls. Configurable mapping file is deployed by default to /var/metacat/dataone where it can then be augmented as needed. This location is controlled in the metacat.properties file (which is injected into the DataONE Settings values during weapp intitialization)....
include log stats for total 'read' events when rendering a package.
rework simple log stats so that there is no saxon requirement (xslt 2)
remove morpho.jar -- moved needed classes into shared utilities project. (currently building form utilities trunk -- be sure to 'ant fullclean' to get the latest utilities.jar built)
Update d1_common_java and d1_libclient_java to the newest jar files. Add methods to CNodeService to throw NotImplemented exceptions for query(), listQueryEngines(), and getQueryEngineDescription() since these API calls are handled outside of metacat.
integrate ecoinformatics login with the CIlogon identity mapping flow so that a user is directed through the process with no manual navigation needed (at least in the url bar). https://redmine.dataone.org/issues/1480
shorten the systemmetadata* table names for Oracle's 30 character limit. move version to 2.0.5. http://bugzilla.ecoinformatics.org/show_bug.cgi?id=5717
ajax-ify the call to perform identity mapping (including errors)
look up CN url for portal servlet instead of hardcoding it.
prep for 2.0.4 release
remove unused "dataonelogger"
prep for 2.0.3 release
allow SM resynch to be executed any time, not just during start up.https://redmine.dataone.org/issues/3116
include JCS jar as it is a runtime dependency for d1_libclient's object caching.
remove semtools skin as a configured skin -- will need to add that if we ever get back to deploying a semtools instance.
configurable replication client timeouthttps://redmine.dataone.org/issues/3078
include new libclient jar that uses encoded pids in the resolve URLshttps://redmine.dataone.org/issues/3035
update D1 jars in preparation for 2.0.2 release. NOTE: still need libclient jar that includes ORE changes for encoding PIDs in resolve URLs
prep for 2.0.2 release by updating the version numbers.
include dataone.ore.downloaddata as a configurable property in case MNs (like LTER) want to have the process download externally-stored data files described in an EML data package.
updated foresite (snapshot) to include dateTime serialization fix.https://redmine.dataone.org/issues/3035
use 1.0.2 d1_libclient jar (built by hudson)
update for 2.0.1 upgrade -- scripts, docs, readme
remove saxon jar (XSLT 2.0 support) with plans to re-add when we understand how to make it more lenient WRT to invalid character content in source XML
move to 1.0.2 d1_libclient jar for ORE generation change (URI for aggregation)
use correct esa email list
use production CN url as the default (instead of cn-dev)
use iframe id for the login anchor since the anchor inside the iframe does not work.http://bugzilla.ecoinformatics.org/show_bug.cgi?id=5619
remove unused replication properties (all certificate file based now)
use 1.0.1 DataONE jars
use non-snapshot D1 jars in prep for tagging/release. Still RCs
include test shoulder defaults for KNB, PISCO and LTER
use metacat.properties to specify the default checksum algorithm to use -- this way it will be easy for us to switch to whatever DataONE decrees. https://redmine.dataone.org/issues/2834
use LRU eviction policy and a small (1000) map size limit to avoid running out of memory because of a large number of system metadata objects
Set the default maximum number of database connections back to 200. After discussion, we've decided it will be better to increase the PostgreSQL limit to 300 and keep Metacat's pool size pretty big.
Change the database.maximumConnections property to 100. PostgreSQL's docs says it can handle "a few hundred", and would need to be increased from the default 100 max_connections. For DataONE optimization, we increase max_connections, however there are more processes making connections other than metacat, so I'll reduce metacat's default share.
include TRACE level debugging for specific classes we want to have performance metrics for.
new D1 jars:prevent NPEs from the object format cache when formatId.value is null. This came up during PISCO testing
default replication policy set to 0.
new d1 jars for: remove exception from method decl - was not matching the interface def and not compiling.
check if person's equivalentIdentity list is null before processing recursivelyhttps://redmine.dataone.org/issues/2689
D1 common lib AuthUtils update
jars with CN/MN.archive() libclient implementations
updated d1 jars
newer d1 jars that include shared AuthUtilsmethod for isAuthorized() consistencyhttps://redmine.dataone.org/issues/2661
include Session-less interface methods and updated jars that define them.
correct typo for "dataone.mn.services.enabled" property on the admin screen checkbox
change ordering of getLogRecords() parameter -- pidFilter is in the middle now
upgrade to latest RC in libclient and common jars -- includes updated getLogRecords and new mn.generateIdentifier method
include new jars for CN.delete() interfacehttps://redmine.dataone.org/issues/2506
throw InvalidToken when there is invalid SubjectInfo embedded in the certificatehttps://redmine.dataone.org/issues/2431
Roll back the nodeId default to blank (used to indicate registration on new installs - thanks Matt.)
Add a default nodeId in metacat.properties of 'urn:node:METACAT1' as a placeholder that needs to be changed on configuration.
Globally change the property 'dataone.memberNodeId' to 'dataone.nodeId'. This is more useful for both MNs and CNs implemented in Metacat. Also, change D1NodeService.getLogRecords() to return log entries with the actual node id rather than the IP address (looks like a cut/paste error)....
include systemmetadata and ore generation flags as "remembered" configuration values for the admin UI.
use RC-3 DataONE jars and fix compilation error that arose. https://redmine.dataone.org/issues/2351
Adding the new d1 [common|libclient] RC2 jars from the D1_COMMON_JAVA_v1.0.1-RC2 and D1_LIBCLIENT_JAVA_v1.0.1-RC2 tags in the repository.
include member node id text field now that the CN is not assigning random Ids.https://redmine.dataone.org/issues/2308
dataone configuration and registration enhancements:-include flag to disable D1 services, currently only the MN side enforces this-do not allow multiple registration attempts if we have just submitted and are awaiting Node verification by the CN.-do not allow configuration "bypass" if D1 settings have been configured previously....
Show "Update" button if this MemberNodeId is already registered with DataONE, otherwise use the "Register" label
updated d1 jars with latest libclient changes and objectformatcache use
Updated configuration documentation in admin guide for Metacat DataONE section. Changed links in configuration utility to point at the Admin guide.
Modify admin configuration to include default replication policy. Extensively revised the DataONE configuration page, including new wording for intro, improved tooltips throughout, new arrangement of sections, and other cosmetic changes.
Remove ability to edit NodeID from D1 configuration page. Fix update of contactSubject and dataone.ore.generated property name.
include flag indicating that system metadata generation has completed (useful for independent long-running thread)
Fixed a bug the a hyper-link included the username/password input fields.
use RC-2 DataONE jars -- these are built from trunk still, but include the next tag naming convention
adjust the width of the label suffix.
Adjust the column width of the search result.
upgrade to hazelcast 1.9.4.6 so that threadpools are released when not needed (http://code.google.com/p/hazelcast/issues/detail?id=765).include ant target to run a specific main class (mostly for debugging)
Add the dataone.contactSubject property to be used when getCapabilities() returns the MN node instance.
generate ORE maps only once -- and persist the flag to the main backup properties so that subsequent Metacat upgrades remember this value.
use RC-1 Dataone jars
Added DOI generation to the 2.0.0 upgrade process. To succeed, this script must be run on a fresh 2.0.0 database, or on a 1.9.5 version database, as those are the only ways to get the needed foreign keys to be marked as deferrable. The identifier conversion must be turned on by setting correct properties in metacat.properties. See the comments in GenerateGlobalIdentifiers for details. By default, conversion is set to false in the properties file. If you want to convert an instance to use DOIs, be sure to set metacat.properties up BEFORE running through the Metacat configuration and database upgrade.
comment our the Demis world map layer -- it was prompting for username/password to use the WMS
use new endpoint/method:http://mule1.dataone.org/ArchitectureDocs-current/apis/CN_APIs.html#CNReplication.deleteReplicationMetadata
use PUT /obsoletedBy/{pid} for CNCore.setObsoletedBy per our discussion today
Add the dataone.hazelcast.storageCluster.identifiersSet property that defines the name of the distributed set of unique DataONE identifiers (called 'hzIdentifiers'). This ISet can't be configured in the hazelcast.xml file (only maps and queues can).
include new methods needed for replication (in new d1 jars)https://redmine.dataone.org/issues/2203
add method: deleteReplicationMetadataremove method: assertRelationupdate the D1 jarshttps://redmine.dataone.org/issues/2187https://redmine.dataone.org/issues/2158
store D1 configuration properties in the main backup so that they persist between upgrades.
add description about what becoming a Member Node entails
remove systemmetadata replication option -- it is no longer a separate document in metacat
Upgrade to Hazelcast-1.9.4.5 to try to solve CLIENT_CONNECTION_LOST problems seen on the Coordinating Node.
format the execution time to be a date.
Use "post" to replace "get" to fix caching issue on IE.
Make the display of the schedule table fit the IE browser.
Use submitLoginFormIntoDivAndReload to replace submitLoginFormIntoDiv js function.
New D1 jars with a minor CNode.setReplicationStatus() bugfix.
The kar id will have version number.
new jars with many changes -- including new CN methods: ping, describe, listChecksumAlgorithm. Removed MN.setAccessPolicy. Refactored CN.setOwner() to CN.setRightsHolder().
Add new D1 jars with update CNreplication API changes to SetReplicationStatus().
updated D1 API -- removed Permission.REPLICATE and associated parameters
include SerialVersion in describe responsehttps://redmine.dataone.org/issues/2135NOTE: d1 jars should be replaced once all schema changes are finalized and the generate d1_common code is committed to svn
simple tests for 2-way data replicationhttp://bugzilla.ecoinformatics.org/show_bug.cgi?id=5520
redirect to the registry form following successful login - but allow an override in case we only want to render the success and stay there (ajax call from main sanparks page).
include the logging level with configuring logger (with file appender) for replication and dataonehttp://bugzilla.ecoinformatics.org/show_bug.cgi?id=5534
include "esa" context in the data registry URL.http://bugzilla.ecoinformatics.org/show_bug.cgi?id=5114