Project

General

Profile

Statistics
| Revision:

# Date Author Comment
2155 05/03/2004 03:59 PM Duane Costa

Integrate Harvester properties with build.properties and metacat.properties.
Eliminate the need for a separate harvester.properties file.
Improve email message to the site to include more summary information.

2152 04/30/2004 08:27 PM sgarg

Fixed bug# 1309. Also put a regex check on ending year and beginning year.

2151 04/30/2004 07:28 PM sgarg

Made changes to fix bug # 1365.

2149 04/30/2004 07:06 PM sgarg

Made changes to fix bug# 1303 and 1367.(Both are related)
Following variables can now be specifieD from the cfg file to control behaviour of the skin: hasKeyword, hasMethod, hasSpatial, hasTaxonomic and hasTemporal. Following two also can be used: spatialRequired and temporalRequired

2148 04/30/2004 11:09 AM sgarg

Made changes to fix bug# 1303 and 1367.(Both are related) - corresponding changes need to be made in tmpl file and testing needs to be done before bugs can be closed.

2144 04/29/2004 11:16 AM sgarg

Made changes to fix 1301. Works fine with eml2 - need to check if works with emlbeta6.

2139 04/28/2004 10:54 AM Duane Costa

Refactored a number of methods to allow for more effective JUnit testing

2138 04/26/2004 04:46 PM sgarg

Made changes to control whether a skin wants to use keywords or not. Keywords probably will be used by all skins alsways. But similar changes can be made for Geographic Coverage or Temporal COverage to control whether a particular section of the insert data template needs to be shown or not. This can be controlled from .cfg file. For example, in nceas.cfg is you define hasKeyword = false, none of the templates will show the keyword part. (Unless, you are using NCEAS skin and you try to modify a document which already has keywords.)

2137 04/26/2004 02:59 PM sgarg

Removed beta6 specific code which is no longer being used.

2136 04/26/2004 02:29 PM sgarg

Removed repetition of code. Also fixed the link to the modified file submitted from responseTemplate

2133 04/22/2004 10:35 AM Duane Costa

Changes to comments

2132 04/19/2004 01:26 PM Duane Costa

Replace Harvester dbDriver property with database property

2130 04/14/2004 06:41 PM sgarg

Added ou also to getprincipal output. So now organizationUnitName is also returned in getprincipal output.

2129 04/14/2004 05:27 PM sgarg

Made changes so that PISCO and NRS trees are also returned in getPrincipals action.

2127 04/14/2004 01:48 PM Duane Costa

Allow user to set frequency to 0 for testing purposes

2126 04/14/2004 01:48 PM Duane Costa

Modify schema location

2121 04/14/2004 11:27 AM sgarg

Fixed getprincipals output. Earlier DNs for LTER were in URL form. Now they appear in DN form.
Earlier:
ldap://knb.lternet.edu:389/DN,base
Now:
DN

Have to make changes so that PISCO and NRS also show up.

2117 04/12/2004 08:20 PM sgarg

Fixed two small bugs.

2116 04/12/2004 04:49 PM sgarg

Made changes in XML that is sent back as result of action=getprincipals. Changes are as following:

1. <authSystem> tag contains organization attribute which specifies organization name
2. <user> tag now has <organization> tag which specifies the organization name of the user. This is being generated as null for LTER as of now.

2115 04/09/2004 04:12 PM sgarg

Perl script for transfering documents from one metacat to another metacat. list_of_docids contains list of names of the documents that will be transfered.

2114 04/09/2004 10:59 AM Duane Costa

Rename url property to defaultDB

2113 04/08/2004 01:49 PM Matt Jones

Added the EventLog functionality to the servlet as action=getlog. Valid parameters are ipAddress, principal, docid, event, start, end. All parameters can be repeated except start and end.

2112 04/08/2004 09:23 AM Duane Costa

Correct minor problems with foreign keys in Harvester tables

2111 04/07/2004 02:31 AM Matt Jones

Partial implementation of a query facility for the access log. Need to fix problems with the date filtering, and tie this into the servlet action when completed and tested.

2110 04/06/2004 08:51 PM Matt Jones

Interim checkin of EventLog reporting structure. Still basically incomplete but compiles.

2109 04/06/2004 03:11 PM Duane Costa

Add three new Harvester tables

2108 04/06/2004 09:34 AM Duane Costa

Omit HARVEST_OPERATION_TABLE and store harvest operations in properties file instead

2106 04/05/2004 04:25 PM Matt Jones

Fixed the returndoctype bug in DBQuery as described in bug 1451. Now,
results are returned even if returndoctype is null, which is the
appropriate behavior.

2105 04/05/2004 09:49 AM Duane Costa

Implement sending email reports to harvest administrator and site administrator

2104 04/02/2004 06:02 PM Matt Jones

Patched to make the date-time value insertion work under oracle. Now it
tests fine under both oracle and postgres. Still need to write an
access/query function.

2102 04/02/2004 01:43 PM Matt Jones

Added additional logging calls for read, upload, insert, update, delete, and
other commands. Now need to get a reporting function working and this
bug 101 will be largely finished.

2101 04/02/2004 11:43 AM Matt Jones

Modified EventLog to eliminate the separate revision column and instead fold
that into the docid string. Log now includes read events, but need to update
the data sent there.

2099 04/02/2004 10:15 AM Matt Jones

Modified SQL scripts to add the new access_log table. I've partially tested this under postgres but have not yet tested under oracle.

2098 04/02/2004 09:13 AM Matt Jones

Reformatted code for readability and consistency.

2097 04/01/2004 10:49 PM Matt Jones

Added javadoc that was missing for the EventLogData class.

2096 04/01/2004 10:40 PM Matt Jones

Added classes for basic event logging support. These classes write log entries to the database connection. Still to do: query the event log, write oracle sql code (postgres is done), possibly allow the log to be archived to a text file, and possibly do the dtabase writes asynchronously via a caching mechanism.

2095 04/01/2004 05:24 PM sgarg

Made change in result tag that is returned in getprincipals action. Replaced userdn with username.

2094 04/01/2004 04:41 PM Matt Jones

Added GPL license text to harvester source files.

2093 04/01/2004 03:40 PM Jing Tao

Fixed a bug the text filed in path xml query maybe splited.

2092 04/01/2004 03:39 PM Jing Tao

Fixed a bug if a document already has index, but now metacat doesn't use index. If you try to delete this one, will cause error.

2091 04/01/2004 03:38 PM Jing Tao

Clean up some code.

2089 03/31/2004 05:49 PM Jing Tao

Revise the handle query and squery method, not finished yet.

2088 03/31/2004 05:48 PM Jing Tao

Add a new transform method.

2087 03/31/2004 05:47 PM Jing Tao

Add a new transferm method for string reader.

2086 03/31/2004 03:23 PM Duane Costa

Implement harvester scheduing capabilities and sending email reports to the Harvester Administrator

2085 03/31/2004 03:19 PM Duane Costa

Validate user input data in registration servlet

2084 03/31/2004 03:18 PM Duane Costa

Improve authorization logic for single file uload servlet

2083 03/31/2004 03:17 PM Duane Costa

Add delete capability to single file upload servlet

2080 03/31/2004 11:45 AM Matt Jones

Set content type properly for getversion action.

2079 03/31/2004 11:42 AM Matt Jones

Added a simple action for finding out the current metacat version. The information is pulled from the property file, so be sure to update the version in the property file before shipping a release.

2078 03/30/2004 04:05 PM Matt Jones

Fixed a bug in the new recursive SQL statements that prevented them from operating on oracle. Now they should work on both oracle and postgres.

2077 03/30/2004 01:36 PM Matt Jones

Reformatted source for readability and conformance.

2076 03/30/2004 01:35 PM Matt Jones

Excluded the update of the xml_index table in insert,update, and delete if the usexmlindex option is set to false.

2075 03/30/2004 10:09 AM Matt Jones

Reformatted DBQuery.java for readability and consistency.

2074 03/30/2004 10:02 AM Matt Jones

Changed printAttributeQuery() to no longer depend on the xml_index table. Now, if useXMLIndex is false, the method will use a recursive query on xml_nodes to match paths instead of using xml_index.

2073 03/29/2004 03:50 PM Matt Jones

Some refactoring of the printExtendedSQL()
methods to eliminate redundancy in the code and
to provide more readable documentation.

2072 03/29/2004 01:59 PM Matt Jones

Moved decision about whether to use xml_index for
query to the metacat.properties as "usexmlindex". Default
is now false. Still have some refactoring to do to remove a
few more uses of the xml_index table.

2069 03/29/2004 11:24 AM Matt Jones

Created new printExtendedSQL function that can get the extended
return fields using only xml_nodes and not xml_index. One
step closer to eliminating the dependence ofn xml_index.

2068 03/26/2004 05:40 PM Matt Jones

Created test class QuerySpecificationTest and started process of removing the xml_index from the QuerySpecification code. Reformatted some classes for readability.

2067 03/26/2004 03:25 PM Matt Jones

Removed the "getdataguide" action as it was always experimental and is no longer used in metacat or morpho.

2066 03/26/2004 02:47 PM Matt Jones

removed the 3 versions of printPackageSQL which are no longer used by metacat. This eliminates some dependency on xml_index.

2063 03/26/2004 02:36 PM Duane Costa

Implement Harvester Registration Servlet

2062 03/26/2004 02:35 PM Duane Costa

Additional scheduling logic

2061 03/25/2004 12:57 PM Duane Costa

Changes to Harvester properties

2060 03/25/2004 12:56 PM Duane Costa

Changes to log entries

2058 03/23/2004 10:26 AM sgarg

Made changes in these three files so that getPrincipal returns back more details about users and groups. Users now contain userDN, user Name and user Email. Groups now contain Group name and Group description. So some function calls which returned single string array earlier now returns multiple string arrays. AuthSession.java called one of these functions - so accordingly changes were made to fix that part of the code.

2057 03/22/2004 10:37 AM sgarg

Fixed a bug which doesn't occur everytime. The bug occurs when lastid in (cfg).lastid is not unique. i.e. there is already a document in the server which has same docid. The earlier algorithm was:

while(not unique){
get accession number;
update accession number written in document; (BUG)...

2056 03/22/2004 08:43 AM sgarg

Added extra parameters (cfg & docid) to be passed on to generic response screen.

2049 03/16/2004 06:57 PM sgarg

made changes so that organization name for the site or project is entered before
any other creater.

2045 03/15/2004 02:08 PM Jing Tao

Fixed the bug for sessionid storing, revision couldn't be zero and Ldap DN is case sensitive.

2043 03/09/2004 06:18 PM sgarg

Replaced Hash table with Vector of Vector datastructure in getting <param> from Query. This was done so that the results are represented in same order as they appeared in the document.

2042 03/09/2004 03:59 PM sgarg

fixed a bug in reloading of kewords from an eml file for edit-datapackage form.

2039 03/08/2004 06:07 PM Jing Tao

Fixed bug that version could not be zero in replication.

2038 03/06/2004 11:51 PM Matt Jones

Minor changes to allow the registry to work in the knb skin, mainly in
how to treat the 'site' field. Now it is a free-text organization
field in the KNB skin. Need to test, install this on ecoinfo and link it
into the KNB web pages.

2037 02/27/2004 03:21 PM sgarg

Added subroutine for replacing characters that might create problem in HTML.
Specifically written for "being used in any text field. This create a
problem in confirmData template, when you specify input name value pair with value
having a " in it.

2036 02/27/2004 12:49 PM Duane Costa

Additional Harvester development

2032 02/20/2004 04:45 PM sgarg

Made changes so that & and other characters dont mess up the url that is passed to metacat.

2031 02/20/2004 02:42 PM Duane Costa

Additional development of Harvester implementation

2029 02/11/2004 01:08 PM sgarg

Mixed a bug reported by Rick and Dan. The form inserted a organizationName tag with no value. This happened only in NCEAS as the tag was included from the drop down site list which doesnot exsist in NCEAS version. Hence, a empty tag was inserted in the eml document.

2028 02/10/2004 06:13 PM sgarg

Bug 1301 - changes made for a repeatable add keyword button

2024 02/10/2004 09:37 AM sgarg

Made changes to fix bug# 1326. The templateVar are now passed on to the responseTemplate also in case of error - so that it can show a link which will send all the values back to register-dataset.

2022 02/09/2004 03:10 PM Duane Costa

Harvester source files

2015 02/05/2004 04:36 PM sgarg

Did editing to support changes mentioned in bug 1295

2005 01/12/2004 06:37 PM Matt Jones

Fixed hardcoded admin account so that it works with more than just OBFS
Registry.

2003 01/12/2004 05:44 PM Matt Jones

Fixed registry bug involving a string comparison (used numeric
equality instead of string equality).

2000 01/08/2004 06:57 PM Matt Jones

Removed unneeded Net::LDAP dependency. Now all authentication occurs
indirectly through Metacat.

1999 01/08/2004 06:48 PM Matt Jones

Added skin for the UCNRS data registry based on earlier work. Minor
modifications to the templates to accomodate this. Fixed a validation
bug in the register-dataset.cgi, and removed an unnecessary Net::LDAP
login as well because the authentication is handled by metacat.

1998 01/08/2004 09:21 AM Matt Jones

Restoring AuthLdap to previous search filter. Determined that the problem was
a missing o: attribute in the UCNRS LDAP directory. Adding it in makes the old
method work. The change I had made caused some confusion about authentication
because using just uid for a filter caused too many return dn's, and it was just...

1997 01/08/2004 08:31 AM Matt Jones

Fixed validation check for samplingDescription.

1993 01/07/2004 03:13 PM Matt Jones

Changes to re-enable the nceas admindb access for the production install.

1992 01/07/2004 11:07 AM Matt Jones

Removed some debugging test code that isn't needed.

1989 01/06/2004 06:41 PM Matt Jones

Added studyExtent and samplingDescription fields to the registry to accomodate
Sandy's request for a temporalDescription field. This is a little more than
she wanted, but it was needed to satisfy EML minimum requirements.

1988 01/06/2004 06:18 PM Matt Jones

Modified LDAP authentication to support a lookup for the NRS system. If
the auth on the provided string fails as a DN, try to look up a new
DN based on the UID. If we get a match, use that DN for auth and see
if that works. This allows us to use a referral within the...

1985 12/29/2003 01:57 PM Matt Jones

Added taxonomic coverage and authority fields, and fixed a bug in reentry
with the methods fields. Now we are collecting information on all of the
additional fields Sandy requested except for a general temporal description,
which doesn't fit neatly in EML. Will need to consider how to accomodate...

1984 12/23/2003 06:22 PM Matt Jones

Added the ability to describe taxonomicCoverage to the registry. This
allows an arbitrary number of species or other taxa to be listed, and the
editing form can dynamically grow through a simple javascript approach
(also used in Methods). Need to test thoroughly, and need to test on...

1983 12/23/2003 12:15 PM Matt Jones

Added geographic description to the fields of data collected, as it is
a required field and was being improperly defaulted to an empty string in the
XML document. This is a new field for all registries.

1982 12/23/2003 11:27 AM Matt Jones

Modifications to add "Methods" collection to the data registry, and to
make the forms HTML 4.0.1 valid (in an attempt to figure out some of
the rendering and layout oddities I'm seeing).

1980 12/19/2003 04:49 PM Matt Jones

New formatting and text for the NCEAS data registry.

1979 12/19/2003 04:12 PM Matt Jones

Further changes to the registry scripts to support the NCEAS registry
with access to the project list fromthe admindb. Also, fixed a bug with
the script where creators were getting duplicated in the editing process
accidentally.

1977 12/18/2003 05:08 PM Matt Jones

Modifications that allow working group entries to be put in as creators, and
a whole bunch of re-formatting for horribly formatted code that I need to
read to finish this thing up.