Metacat

Insert and squery load tests

Three small fixes:
- 'salutation' was misspelled and wasn't picked up correctly in document modificiation
- keyword handling wasn't setting the thesaurus correctly
- check against the full list of moderators for the ACL validation

Matt's comments on Metacat Admin guide.

Enable uploads for the default KNB skin. With the improvements to infrastructure Mike's done, this should work like a charm

do not duplicate the true/false indicators for the metadata vocab/value matrix

use recordNum instead of studentId for transposed data

use "recordNum" rather than "studentId"

omit studentId values from normal resultset
strip the html tags from the qti elements for both return formats

Removed spatial coverage requirement for KNB skin

disable output escaping for CDATA html elements

split vocab/value into two columns (can easily switch back to single column)

Adding back fix for editing documents with multiple keywords, closing #3929

question choices and metadata selection controlled by a counter - can easily increase the number returned...note: probably need to make this a parameter for user or be intelligent about figuring what the widest question is (ie: does it have 5,10,20! metadata entries?)

include short answer prompts in the resultset view

include prompt for both multiple choice and short answer questions when downloading

omit the demographic data - this is not well-defined for the prototype

omit duplicate values in the for the standard metadata header section (columns for each question)

omit the metadata vocab/values from the normal header section since they will be used in the "matrix-style" header section

added more docs

add vocab name/value matrix above data rows.
currently there is only a single column for the concatenated value of the vocab name + "/" + vocab value. it's so much easier!

reduce the extra whitespace on the transpose

hide the "transpose" checkbox except when on the data cart page

use name attributes for selection entity-attributes.
note: this is still a static version of which question-level metadata is being included in the resultset

only "correct" non-null values

allow both text nodes and cdata nodes to provide content for document data package values (FIRST)

include qPrompt and qChoice
need to quote the csv so that commas in the question text do not throw it off

Now the metadata attributes show as rows above the data.
very close!
todo: special handling for thesaurus (ie NBII/Bloom) metadata fields

pivot constrained to a List of specific attributes: studentId (record number), score, response.
This is the "lower half" of the return set (data).
now: on to the metadata header rows

Update version to 1.9.1. Add nrs ldap properties to configuration.

Now doing the dataquery/download in the FIRST skin's jsp rather than embedded in the Metacat servlet.
TODO: implement the very-custom data return format agreed upon by the FIRST team

remove DataTranspose from core metacat - only used in FIRST skin for this 1.9.1 release

Include hack for UCNRS organization properties.

add LDAP base to NRS skin properties

- build up username using base if username isn't fully qualified (e.g. cn=Manager,dc=ecoinformatics,dc=org)
- additional debugging statements for changePassword

add UCNRS LDAP properties

- fix error reporting for failed password reset request
- automatically generate necessary LDAP parameters from our defaults,
included in auth.base and unaffiliated properties. This won't work for
skins such as UCNRS with a different base, which still need to be ...

- reformat header
- add debugging for getLdapEntry searches
- add 'filter' parameter for organizations

Provide improved contextUrl, provide proper URL in password reset message body

Accidentally removed ACCESS constant declaration. Restored.

Handle UtilException

Roll back replication user changes. Fix code that converts access levels to integer and to text.

Add date to log output

include pivot options for dataquery

added more to the draft.

Somehow log4j.properties is missing from head. Restoring it.

Introduce replication user. Use the fileutil writer methods instead of writing directly.

new datamanager feature!
Pivot a result set (rows to columns).
Handles simplest case:
-single id column (observation)
-single pivot column (pivot)

Beef up exception handling from file utilities. Move UtilException to MetacatUtilException to eliminate conflict with similar exception in utility package.

add date to log output

added more documentation.

Do not read or write zero length documents to/from disk

Added in-progress draft of Metacat Admin Guide.

Handle all places where ldap may be null

enclose more references to ldap and mesg in the if (ldap) statement.

made mesg var global to function.

left off ;

Do not try to use non-existant ldap object if ldap server is down.

made a few minor changes and additions.

replace eml2_0_1-style-tag with eml2-style-tag

remove unneeded ecogrid.hostname property

Use only one eml common stylesheet directory for all post 2.0.0 beta versions of eml. Point all eml versions to that directory in skin xml files.

Increase database.maximumConnections from 25 to 200

Fix registryService file locations.

made a couple corrections.

Very rough draft of Metacat Admin guide outline

Draft of Metacat overview for scientists.

Added draft of Metacat overview for scientists.

Use the EML_UTIL_0_9_0 tag

Added jing's suggested changes

include NSF grant number

Add documentation for query caching and indexing mechanisms.

found more method that should be plural

removed duplicate variable settings

fixed path for sibling access

1. changed path for doc-level access to sibling instead of child
2. renamed template "datasetaccess" to datatableaccess and changed path to distribution/access

updated templates to reflect new spelling of dateTime and methods in attributes.

Added eml 2.1.0 stylesheets for sbclter.

Create an eml 2.1.0 shared directory. Move skin specific xsl directives into sbclter directory: sbclter-eml-2.0.0.xsl and sbclter-eml-2.1.0.xsl

Add step to install Digest::SHA1

Update EML 2.1.0 schema and style (util) tags. These tags now only cover the files relative to each.

Clean perl code before building.

distribute perl autosplit.ix file with metacat. change tomcat startup script output to echos.

Add db rollback scripts

Add apache download instructions

Remove initialization of MetacatUtil.buildIndexPaths in test files. This is taken care of in the background now using SystemUtil.getIndexPaths()

update workers.properties with more standard ajp13 worker name (not used until apt-get install project)

Removed the () from the javascript length functions in the submitRequest function.

add a build property "make.perl.code" so the cgi make can be turned off in build.xml on machines without make.

Format indexPaths in metacat.properties. Remove from build.properties and build.xml. Move indexPath list getter from MetacatUtil to SystemUtil.

Replace System.out.println statements with logMetacat statements.

moved file from metacat/bin to metacat/src/scripts/bash since eclipse uses <project>/bin as a default build directory and these files will consistently get blown away locally by eclipse.

Replace System.out.println statements with logMetacat statements.

Update replication documentation and fix code so that replication log is available.

Add troubleshooting instructions for map issues with firefox 3 and safari

remove semicolon at the end of xml.useFullSchemaValidation property.

Separate the concept of a backup file location and a metacat external directory location. These can be totally different.

Fixes include:
-Overwriting existing DTDs on the filesystem if they exist and registration in the DB failed
-only registering a DTD once

Fix formatting for ecogrid testing section

Add instructions for how to test the web registry, web ldap, and ecogrid registry service.

do not include the column name when inserting into an auto-increment column