Metacat

Add the dataone create event mapping to the select clause.

map the metacat log event INSERT, upload and UPLOAD to the dataone log event "create"

remove "al" prefix from subquery since we are only querying one table and do not need to use a prefix.

merge from 2.5 branch: use subquery to do paging before joining to identifier table. https://redmine.dataone.org/issues/7491

Add more statement to debug the query performance.

In the getLog method, if the event is null, we will set it unknown.

If the event string is null, we will skip this log in the getLog method.

Add a cap to only write 512 characters of the user-agent to db.

The constrcutor of EventLogData missed the user-agent field. So the user-agent wasn't recorded.
The bug was fixed.

Add a utility method for determine if there is a delete event for a given id.

add support for v2 DataONE API.

recursively submit obsoleted objects for indexing when instructed. https://projects.ecoinformatics.org/ecoinfo/issues/6424

only index event information for known events. https://projects.ecoinformatics.org/ecoinfo/issues/6346

Unify solr indexing with an IndexTask that is added to the queue -- allows us to send more than just the systemMetadata to the indexer. Initially this is for READ event counts for each document. https://projects.ecoinformatics.org/ecoinfo/issues/6346

get total (or subtotal when non-slicing params are present) count as a separate query from the field selection query.

include Skye's suggestions about correctly limiting by D1 Event types

use RDBMS-specific features to limit the resultset for paging -- postgres and oracle have implementations. we don''t really support mssql so I skipped that one.

allow getlog action to use docid parameters that do not include revision. In these cases, the latest revision will be used.

correct the parameter/value setting in the prepared statements for retrieving log information.

make sure we have non-null values where jibx serialization expects them for LogEntry

first pass: DataONE-specific log retrieval to avoid java-based post-processing.

log records should be inclusive of fromDate parameter (>=)
https://redmine.dataone.org/issues/2471

use UTC serialization for log entries so that the timestamp, not just the date, is preserved
https://redmine.dataone.org/issues/2257

correctly set the prepared statement parameters for start and end date

http://bugzilla.ecoinformatics.org/show_bug.cgi?id=5527

add User-Agent logging to support D1 requirements

allow public access to log information when docid is given. IP and principal are not returned unless an administrator makes the request.

Create database and shared directories for database management code and shared code respectively.

Replacing MetaCatUtil.debugMessage or MetaCatUtil.logMetacat call with logMetacat (private Logger object) call

Added the EventLog functionality to the servlet as action=getlog. Valid parameters are ipAddress, principal, docid, event, start, end. All parameters can be repeated except start and end.

Partial implementation of a query facility for the access log. Need to fix problems with the date filtering, and tie this into the servlet action when completed and tested.

Interim checkin of EventLog reporting structure. Still basically incomplete but compiles.

Patched to make the date-time value insertion work under oracle. Now it
tests fine under both oracle and postgres. Still need to write an
access/query function.

Modified EventLog to eliminate the separate revision column and instead fold
that into the docid string. Log now includes read events, but need to update
the data sent there.

Modified SQL scripts to add the new access_log table. I've partially tested this under postgres but have not yet tested under oracle.

Added classes for basic event logging support. These classes write log entries to the database connection. Still to do: query the event log, write oracle sql code (postgres is done), possibly allow the log to be archived to a text file, and possibly do the dtabase writes asynchronously via a caching mechanism.