1
|
#
|
2
|
# '$RCSfile$'
|
3
|
# '$Author: leinfelder $'
|
4
|
# '$Revision: 7131 $'
|
5
|
# '$Date: 2012-04-13 07:54:54 -0700 (Fri, 13 Apr 2012) $'
|
6
|
#
|
7
|
|
8
|
Metacat: XML Metadata and Data Management System
|
9
|
------------------------------------------------
|
10
|
|
11
|
Version: 2.0.0 Release
|
12
|
|
13
|
Send feedback and bugs to: metacat-dev@ecoinformatics.org
|
14
|
http://bugzilla.ecoinformatics.org
|
15
|
|
16
|
Contributors: Matt Jones (jones@nceas.ucsb.edu)
|
17
|
Chad Berkley (berkley@nceas.ucsb.edu)
|
18
|
Jing Tao (tao@nceas.ucsb.edu)
|
19
|
Jivka Bojilova (bojilova@nceas.ucsb.edu)
|
20
|
Dan Higgins (higgins@nceas.ucsb.edu)
|
21
|
Saurabh Garg (sgarg@nceas.ucsb.edu)
|
22
|
Duane Costa (dcosta@lternet.edu)
|
23
|
Veronique Connolly (connolly@nceas.ucsb.edu)
|
24
|
John Harris (harris@nceas.ucsb.edu)
|
25
|
Callie Bowdish (bowdish@ecoinformatics.org)
|
26
|
Will Tyburczy (tyburczy@ecoinformatics.org)
|
27
|
Matthew Perry (perry@nceas.ucsb.edu)
|
28
|
Chad Burt (underbluewaters@gmail.com)
|
29
|
Ben Leinfelder (leinfelder@nceas.ucsb.edu)
|
30
|
Chris Barteau (barteau@nceas.ucsb.edu)
|
31
|
Shaun Walbridge (walbridge@nceas.ucsb.edu)
|
32
|
Michael Daigle (daigle@nceas.ucsb.edu)
|
33
|
|
34
|
Patch contributors:
|
35
|
Andrea Chadden (chadden@nceas.ucsb.edu)
|
36
|
Chris Jones (cjones@msi.ucsb.edu)
|
37
|
Johnoel Ancheta (johnoel@hawaii.edu)
|
38
|
Owen Jones (owen.jones@imperial.ac.uk)
|
39
|
|
40
|
Metacat is a flexible database storage system for XML formatted
|
41
|
documents and associated binary files. Metacat models the structure of the
|
42
|
XML document, therefore allowing storage of XML documents with arbitrary
|
43
|
schemas. Metacat supports several databases on the back-end, including Oracle,
|
44
|
PostgreSQL and SQL Server (limited). The server supports XML document
|
45
|
storage, retrieval, query, validation, and transformation (using the XSLT
|
46
|
stylesheet language). In addition, there is a mechanism for replicating the
|
47
|
database to other metacat instances for backup and load balancing purposes.
|
48
|
Metacat currently uses an LDAP database for authenticating users, but was
|
49
|
written to accomodate other authentication services as well.
|
50
|
|
51
|
Installation
|
52
|
------------
|
53
|
See the file "docs/user/metacat-<OS>-install.html" for detailed instructions
|
54
|
for your OS.
|
55
|
|
56
|
Release Notes for 2.0.0:
|
57
|
------------------------
|
58
|
This major release includes support for DataONE.
|
59
|
*The DataONE v1.0.0 Member Node service APIs are now the preferred method for communicating with Metacat
|
60
|
*The existing EcoGrid and Metacat Servlet APIs are deprecated.
|
61
|
*Bugs fixed include:
|
62
|
<bugs here>
|
63
|
|
64
|
Release Notes for 1.9.5:
|
65
|
------------------------
|
66
|
This release fixes those bugs:
|
67
|
*Metacat could not download the included schemas in an external schema file during inserting.
|
68
|
*Workflow scheduler could not work since the metadata standard of kepler kar file was changed.
|
69
|
*Earthgrid could not transform the Earthgrid query with concept "/" to the Metacat path query correctly.
|
70
|
*Document access rules are now preserved when documents are archived during the 'delete' action.
|
71
|
|
72
|
Release Notes for 1.9.4:
|
73
|
------------------------
|
74
|
This release fixes bugs in the FGDC data package upload and download interface utilized
|
75
|
by the SANParks and SAEON skins.
|
76
|
|
77
|
Release Notes for 1.9.3:
|
78
|
------------------------
|
79
|
This release fixes a harvester bug that prevented the EML harvester from processing
|
80
|
harvest lists.
|
81
|
The Kepler skin has been updated to support KarXML 2.1.
|
82
|
Ecogrid query services now support multiple namespace searches.
|
83
|
|
84
|
Release Notes for 1.9.2:
|
85
|
------------------------
|
86
|
This release primarily holds the addition of the Threshold of Potential
|
87
|
Concern workflow functionality (TPC). The following issues were addressed:
|
88
|
|
89
|
* Create a properties file for use by JUnit Tests (Bug 2994)
|
90
|
* security issue with skins (Bug 3368)
|
91
|
* reorganize classes into a more functional specific structure (Bug 3510)
|
92
|
* Add admin names as dropdown in configuration login (Bug 3729)
|
93
|
* KNB metacat replication error log file is empty (Bug 3885)
|
94
|
* Create TPC Report web browse/search pages (Bug 4165)
|
95
|
* Create archive extraction functionality (Bug 4166)
|
96
|
* Create Workflow Scheduler (Bug 4167)
|
97
|
* metacat didn't update xml_path_index table while a document was updated (Bug 4367)
|
98
|
* Enforce permissions for tpc workflow viewing and scheduling (Bug 4420)
|
99
|
* Fix cross platform TPC GUI issues (Bug 4556)
|
100
|
* TPC Sanparks page content lenth issue (Bug 4557)
|
101
|
* Create validate and isAuthorized unit tests (Bug 4558)
|
102
|
* Cannot insert replication server via gui (Bug 4594)
|
103
|
* Timed Replication takes many hours and drives the load up on KNB (Bug 4616)
|
104
|
* [ESA] Update fails when document rev number is missing (Bug 4627)
|
105
|
* fails to catch some insert and update failures (Bug 4637)
|
106
|
* must support java 1.6 (Bug 4641)
|
107
|
* Convert build to pull eml from svn instead of cvs (Bug 4644)
|
108
|
* handleGetRevisionAndDocTypeAction should search both xml_documents and xml_revisions table (Bug 4645)
|
109
|
* Metacat couldn't update a document from client, which previous versions only stay in xml_revisions table (Bug 4649)
|
110
|
* metacat runs out of memory (Bug 4658)
|
111
|
* ESA skin links are hard coded to data.esa.org (Bug 4698)
|
112
|
* Update release 1.9.2 release notes (Bug 4707)
|
113
|
* Handle writing a text node > 4000 characters to the db. (Bug 4708)
|
114
|
* Metacat should run against Tomcat 6 (Bug 4716)
|
115
|
|
116
|
Release Notes for 1.9.1:
|
117
|
------------------------
|
118
|
The 1.9.1 release holds the bug fixes found after releasing 1.9.0 beta.
|
119
|
These bugs were primarily replication issues. There is no difference
|
120
|
in functionality between 1.9.0 and 1.9.1
|
121
|
|
122
|
Release Notes for 1.9.0:
|
123
|
------------------------
|
124
|
This release focuses on simplifying the Metacat installation process by
|
125
|
creating a binary (war) installation. The need to build the application
|
126
|
on the server has been removed (although the option is still available).
|
127
|
In order to facilitate this method of installation, a few major modifications
|
128
|
were made to the code:
|
129
|
|
130
|
-- Ant token replacement was removed for all non-build variables in the
|
131
|
application (most of this was already done in 1.8.1).
|
132
|
|
133
|
-- The Metacat properties confguration was moved into the application
|
134
|
itself.
|
135
|
|
136
|
-- Database schema version detection and install/upgrade utilities were
|
137
|
added to the application.
|
138
|
|
139
|
Also, this release includes several enhancements:
|
140
|
-- it supports the new EML 2.1.0 version.
|
141
|
|
142
|
-- Documents are now stored on the local filesystem as well as in the
|
143
|
database in order to preserve document integrity.
|
144
|
|
145
|
-- Metacat verifies new schemas when they are added.
|
146
|
|
147
|
-- Additional access is propegated with documents during replication.
|
148
|
|
149
|
High priority bugs were addressed in this release as well.
|
150
|
|
151
|
The enhancements/bugs addressed are:
|
152
|
|
153
|
* escaped "less than" in inlinedata causes invalid eml output (Bug 2564)
|
154
|
* need to set filename for download files (Bug 2566)
|
155
|
* add ability for search engines to index metacat documents (Bug 2826)
|
156
|
* EML citation section should include both organizationNames and individualNames (Bug 3059)
|
157
|
* refactor skins to get organization list from metacat getOrganizations() function (Bug 3114)
|
158
|
* Update dataknp.sanparks.org packageId attributes to match Metacat Ids (Bug 3258)
|
159
|
* New documents explicitly set as public access don't show up correctly (Bug 3262)
|
160
|
* Modify confguration utility in metacat (Bug 3371)
|
161
|
* Integrate perl token replacement changes (Bug 3372)
|
162
|
* Create skin specific configuration utility (Bug 3373)
|
163
|
* Add authentication for configuration utility (Bug 3374)
|
164
|
* Create a sorted properties utility (Bug 3375)
|
165
|
* Add DB upgrade/install functionality to java code (Bug 3376)
|
166
|
* Create ANT install target for developers (Bug 3377)
|
167
|
* Create LSID server installation (Bug 3380)
|
168
|
* Create unit test code for 1.9 additions (Bug 3381)
|
169
|
* create simple turnkey installer for metacat Phase I (Bug 3461)
|
170
|
* Maps do not display in Firefox version 3 (Bug 3462)
|
171
|
* Replicate access rules in replication (Bug 3464)
|
172
|
* Metacat casesensitive="true" option in pathquery expressions is broken (Bug 3472)
|
173
|
* Add full schema checking when metacat register new schema (Bug 3474)
|
174
|
* Incorporate EML 2.1.0 access changes in metacat (Bug 3495)
|
175
|
* getprincipals action returns invalid XML document (Bug 3527)
|
176
|
* Update knbweb to serve new metacat install (Bug 3545)
|
177
|
* Replication should write to disk (Bug 3554)
|
178
|
* Update acknowlegements in metacat readme (Bug 3588)
|
179
|
* Validate the ldap administrator field. (Bug 3616)
|
180
|
* Allow for different authentication services in metacat configuration (Bug 3680)
|
181
|
* Tag utilities module and have metacat check out that tag (Bug 3685)
|
182
|
|
183
|
Release Notes for 1.8.1:
|
184
|
------------------------
|
185
|
This release focuses on bug fixes. In this release, the problem that Metacat 1.8.0 and previous
|
186
|
versions use illegitimate EML 2.0.1 schemas is addressed: first, Metacat 1.8.1 comes with
|
187
|
legitimate EML 2.0.1 schemas; second, existing invalid EML 2.0.1 documents will be
|
188
|
automatically fixed while maintaining their package ID during the Metacat 1.8.1 upgrading process.
|
189
|
Details please see:
|
190
|
http://bugzilla.ecoinformatics.org/show_bug.cgi?id=3239
|
191
|
http://bugzilla.ecoinformatics.org/show_bug.cgi?id=3241
|
192
|
|
193
|
Note: after upgrading the Metacat to version 1.8.1, some replication issues may be seen, e.g., the
|
194
|
EML 2.0.1 documents from Metacat 1.8.0 or ealier verions may be rejected since Metacat 1.8.1 uses
|
195
|
different EML 2.0.1 schemas (see bug 3239). If this is case, Metacat administrators should notify
|
196
|
their counterparts to upgrade previous version Metacats to 1.8.1.
|
197
|
|
198
|
The fixed bugs include:
|
199
|
|
200
|
*Character set (charset) problem when filling out form (Bug2797)
|
201
|
*Charset bug: > "less than" symbol does not display correctly (Bug2517)
|
202
|
*Metacat performance issue in Sanparks skin (Bug 3174)
|
203
|
*Metacat using illegitimate versions of EML schema (Bug 3239)
|
204
|
*Update older invalidated eml201 document in Metacat (Bug 3241)
|
205
|
*Verify existing token changes to skins (Bug 3176)
|
206
|
*The edit feature in the NCEAS Data Repoistory does not work (Bug 2644)
|
207
|
*Expose permission options for registry uploads (Bug 3014)
|
208
|
*ESA registry doesn't have LTER in login dropdown menu (Bug 2647)
|
209
|
*Data Catalog Map is slow when selecting (Bug2732)
|
210
|
*Only one attribute per element returned with pathquery results(Bug 2999)
|
211
|
*The field "skinconfigs" in the MetacatUtil class is public (Bug 3057)
|
212
|
*Generalize the reading of skin.configs in DBTransform (Bug3058)
|
213
|
*The query example in metacatquery.html document need to be changed (Bug3137)
|
214
|
*Add upload method into Metacat tour (Bug 3139)
|
215
|
*Query resultset doesn't show component name in kepler skin (Bug 3178)
|
216
|
*Add fields used in Morpho search to the default indexPaths property (Bug 3259)
|
217
|
*Private data cannot be downloaded from metadata display page (xsl) (Bug 3263)
|
218
|
*An error message happen during the metacat start up (Bug 3279)
|
219
|
*Replication: Timed replication failures occur twice instead of once (Bug 3304)
|
220
|
*Inline Data does not work correctly without the <pre> tag (Bug 3088)
|
221
|
*Include FGDC metadata in KNB and NCEAS skin search results (Bug 3146)
|
222
|
|
223
|
Release Notes for 1.8.0:
|
224
|
------------------------
|
225
|
This release focuses on improving query performance. Both the selection
|
226
|
and access control queries were rewritten to execute efficiently.
|
227
|
To improve search performance, a query caching mechanism was introduced.
|
228
|
Cached queries are currently supported only for public users.
|
229
|
|
230
|
New Features:
|
231
|
* Data registries now support uploading of data objects along with data
|
232
|
packages (Bug 1982)
|
233
|
|
234
|
Bug Fixes:
|
235
|
* Metacat Performace: Rewrite the xml_nodes queries (Bug 2155)
|
236
|
* Metacat Performace: Rewrite the xml_access part of the query (Bug 2557)
|
237
|
* Query cache mechanism (Bug 2905)
|
238
|
* Metacat Performance: updates from Morpho of data packages are taking
|
239
|
longer than five minutes (Bug 2805)
|
240
|
* Metacat Performance: Optimize Postgres and Tomcat (Bug 2157)
|
241
|
* Metacat Performace: Upgrading hardware setup (Bug 2175)
|
242
|
* Metacat Performace: Add/drop indices on key columns (Bug 2153)
|
243
|
* Display of metadata documents reorganized, including a new citation format,
|
244
|
obvious download options, and a redesigned data table layout (Bugs 2981, 2832)
|
245
|
* I.E. display fixes on default skin (Bug 2579)
|
246
|
* Web Address links fixed (Bug 2147)
|
247
|
* NCEAS skin redesigned to use IFRAME-less layout, match new website.
|
248
|
* Spatial query: data packages must be fully contained by the selection
|
249
|
bounding box in order to appear in the search results (Bugs 2972, 2732).
|
250
|
* FGDC support: upload, delete, update, access control, and download
|
251
|
(Bugs 2807, 2925, 2926, 2929, 2030).
|
252
|
Compatibility Notices:
|
253
|
* Tomcat 3 and 4 are no longer tested or supported. Users are
|
254
|
highly encouraged to upgrade to Tomcat 5.5
|
255
|
|
256
|
Release Notes for 1.7.0:
|
257
|
------------------------
|
258
|
This release features only a few minor changes to the core Metacat engine.
|
259
|
The major focus of this release is the addition of the spatial functionality.
|
260
|
The geographic coverage of metadata documents can now be cached in a GIS-
|
261
|
accessible format and published via web mapping services and an online
|
262
|
interactive map.
|
263
|
|
264
|
New Features:
|
265
|
* Three new open source libraries have been integrated with Metacat:
|
266
|
- Geoserver: A standards-compliant web map server to publish
|
267
|
geographic data to the web.
|
268
|
(http://docs.codehaus.org/display/GEOS/Home)
|
269
|
- GeoTools: A java-based GIS toolkit to programatically
|
270
|
manipulate spatial datasets.
|
271
|
(http://geotools.codehaus.org/)
|
272
|
- Mapbuilder: A javascript application to provide an interactive
|
273
|
web map front-end to Geoserver.
|
274
|
(http://docs.codehaus.org/display/MAP/Home)
|
275
|
* Spatial Caching/Indexing mechanism; documents with geographic
|
276
|
coverages will be added to the spatial cache.
|
277
|
* Spatial Query action in metacat servlet.
|
278
|
* Interactive Web map to visualize and query the spatial
|
279
|
distribution of metadata documents.
|
280
|
* Experimental python, ruby and php client libraries to interface with metacat.
|
281
|
* Preliminary process in place for web based configuration of metacat.
|
282
|
|
283
|
Compatibility Notices:
|
284
|
* Tomcat 3 and 4 are no longer tested or supported. Users are
|
285
|
highly encouraged to upgrade to Tomcat 5.5
|
286
|
|
287
|
Bug Fixes:
|
288
|
* Metacat administrators are able to modify and delete documents
|
289
|
created by other users.
|
290
|
* Fixed problems with indexing XML attributes, see bug 2469
|
291
|
|
292
|
|
293
|
Release Notes for 1.6.0:
|
294
|
------------------------
|
295
|
|
296
|
This release comes with more performance improvements, initial support for
|
297
|
LSIDs (Life Sciences Identifiers) and FGDC standard, more controls for
|
298
|
Metacat administrators and bug fixes. Below is the list of bug fixes and
|
299
|
performance improvements.
|
300
|
|
301
|
Bug Fixes:
|
302
|
* Improved the indexing algorithm. Earlier indexing failed for some documents
|
303
|
randomly and used to take a lot of time to complete for others. The
|
304
|
code for indexing was changed to take care of both these problems.
|
305
|
* Earlier, xmlns prefix was used to determine the namespace of the document.
|
306
|
Now schemaLocation is used instead xmlns prefix to determine the namespace
|
307
|
of the document as that is a better indicator of document type.
|
308
|
* INSTR was used in some SQL statements and it is not supported by Postgres.
|
309
|
So SQL statements were modified so that INSTR is not used.
|
310
|
* Replication was changed to include replication of deleted documents also.
|
311
|
* Fixed bug in squery which didnt allow use of not-contains
|
312
|
|
313
|
New Features:
|
314
|
* Added FGDC schema and XSLT so that Metacat can handle FGDC standard
|
315
|
* Added support for LSID. This includes modifying the stylesheets to
|
316
|
display the LSIDs, modifying the build to include a new target
|
317
|
'install-ldap'.
|
318
|
* Added following access control levels to Metacat:
|
319
|
1. Administrators - users who can do the following:
|
320
|
a. Run replication
|
321
|
b. Delete any document
|
322
|
c. Modify any document
|
323
|
d. run indexing for any document
|
324
|
e. check the logs
|
325
|
2. allowedUsers - User who are allowed to submit
|
326
|
3. deniedUsers - Users not allowed to submit
|
327
|
* Added a new skin for Ecological Society of America.
|
328
|
* Created an Advanced search servlet which can be used from the web.
|
329
|
* Various connections have been modified to be secure. e.g. connection between
|
330
|
ldaps is made secure now, replication is done over secure channels.
|
331
|
|
332
|
Performance:
|
333
|
* Reduced size of xml_nodes by creating a new table for holding nodes from
|
334
|
deleted documents and old revisions of the documents.
|
335
|
* Provided a new variable in metacat.properties where more frequently searched
|
336
|
for paths can be specified. Seperate indexes are created for these paths
|
337
|
- so that search is faster.
|
338
|
* Included log4j for logging and debuging to prevent wasting of time in printing log statements.
|
339
|
|
340
|
Release Notes for 1.5.0:
|
341
|
------------------------
|
342
|
|
343
|
This release comes with performace improvement, user interface enhancements,
|
344
|
and bug fixes. Below is the list of bug fixes and performance improvements.
|
345
|
|
346
|
Bug Fixes:
|
347
|
* Modify property values of harvester registration servlets to match the
|
348
|
servlet-mapping URL values in web.xml. The old values used the servlet
|
349
|
class names. This worked in Tomcat 4 but seems to break in Tomcat 5 on
|
350
|
Windows. The new values use the servlet-mapping URL values. This should
|
351
|
work in both Tomcat 4 and Tomcat 5. (Bug 162)
|
352
|
* Re-implement logic to prune old log entries from the HARVEST_LOG and
|
353
|
HARVEST_DETAIL_LOG tables. The old logic caused integrity constraint
|
354
|
violations in the database because it tried to delete parent records from
|
355
|
HARVEST_LOG prior to deleting child records from
|
356
|
HARVEST_DETAIL_LOG. (Bug 162)
|
357
|
* In data registry, minor bugs fixed like the error page shows the link back
|
358
|
to the form when error page was generated because of a document read
|
359
|
request from search results page, the successful delete button leading
|
360
|
to a blank screen and the old ACL overwritten by the registry.
|
361
|
(Bugs 1307, 1310, 1322, 1344, 1551)
|
362
|
* Changed the code to support insertion of following characters: ', `,
|
363
|
charcters in the Numeric Character Reference format (&#xyz;) and
|
364
|
characters like µ. Characters like µ will be converted to and stored in
|
365
|
Numeric Character Reference format(&#xyz;). They will also be returned
|
366
|
in Numeric Character Reference and it is upto the client to convert them
|
367
|
and display them accordingly in the application. Partial fix provided by
|
368
|
Johnoel Ancheta. (Bug 1538,1711)
|
369
|
* Spatial search failed on Oracle because of invalid entries made by
|
370
|
some documents in the nodedata column of xml_nodes for paths involving
|
371
|
'eastBoundingCoordinate', 'westBoundingCoordinate',
|
372
|
'northBoundingCoordinate', 'southBoundingCoordinate'. A new column
|
373
|
nodedatanumerical was added to xml_nodes table such that all the numerical
|
374
|
nodedata is stored in this column and this column is now used for spatial
|
375
|
search. (Bug 1703, 1718)
|
376
|
* In the default skin, clicking on the keywords on the home page did not
|
377
|
result is a search being done. Fix provided by Owen Jones. (Bug 1768)
|
378
|
* Metacat generated a success message even when a document which didnt
|
379
|
exsist was requested for deletion. This has been fixed. (Bug 1850)
|
380
|
* "packagetype" in xml-relation table was entered as eml200 namespace when
|
381
|
an eml201 document was inserted. This is fixed now so that "packagetype"
|
382
|
in xml-relation table points to eml201 namespace. (Bug 1979)
|
383
|
* System_id in xml_catalog pointed to http://knb.ecoinformatics.org/knb/
|
384
|
earlier. Fixed such that it points to the locally installed metacat url.
|
385
|
(Bug 1986)
|
386
|
* Changes to the Query subsystem fix bugs that prevented attributes from
|
387
|
being expressed solely in the xpath query statement and the returnfield
|
388
|
values. For instance, a query URL may now include search strings like
|
389
|
'@packageId=sbclter%25' and return strings like 'returnfield=@packageId'.
|
390
|
Previously, the attribute had to be appended to an element:
|
391
|
'/eml/@packageId=sbclter%25'. These fixes change DBQuery.java,
|
392
|
QuerySpecification.java, and QueryTerm.java (Bug 2052)
|
393
|
* Search query failed in case of Oracle if number of documents in the result
|
394
|
were more than 1000. This has been fixed. (Bug 2000)
|
395
|
* Removed any occurence of enum which is now a keyword in Java 1.5
|
396
|
|
397
|
|
398
|
Enhancements:
|
399
|
* Major improvements done in user interface for the data registeries and
|
400
|
various other skins. Improvements done based on suggestions from Mark
|
401
|
Stromberg, Laura Downey and others. Improvements also done in resultset.xsl,
|
402
|
the default skin and ldap templates. (Bug 1948)
|
403
|
* Coded added such that administrator can delete documents irrespective of
|
404
|
who the document belongs to.
|
405
|
* Performance impovement done in searching of datasets. A part of the search
|
406
|
time was taken up because of generation of resultset after the search had be
|
407
|
done. So this was the sequence of events in earlier metacat
|
408
|
1) Search for the given text
|
409
|
2) A list of docids generated
|
410
|
3) For each of the docids
|
411
|
3a) Use xml_index and xml_nodes table to generate the string descibing
|
412
|
the document including the returnfields requested in the search
|
413
|
4) Add all the strings from step 3a to send back the resultant
|
414
|
document. Here a decent amount of time was being taken by step 3a.
|
415
|
The algorithm is now modified by addition of two tables xml_queryresult and
|
416
|
xml_returnfields and a user defined parameter xml_returnfield_count. The
|
417
|
new algorithm works as follows:
|
418
|
1) Search for the given text
|
419
|
2) A list of docids is generated
|
420
|
3) For the given set of return fields generate a unique string and check
|
421
|
if that string exists in xml_returnfields
|
422
|
3a) If string does not exist in xml_returnfield, then enter a new
|
423
|
record usage_count as 1 and returnfield_string as the unique string
|
424
|
generated above.
|
425
|
3b) Else if the string exists, increment usage_count
|
426
|
4) Given the docids from step 2 and the id of the returnfield record from
|
427
|
step 3, query for any docids that already exist in xml_queryresult.
|
428
|
For the docids that do exist, get the queryresult_string.
|
429
|
5) For rest of the docids from step2 which were not found in step 4, do
|
430
|
the following for each of the documents:
|
431
|
5a) Use xml_index and xml_nodes table to generate the string descibing
|
432
|
the document including the returnfields requested in the search
|
433
|
5b) If usage_count of the record from step is more than
|
434
|
xml_returnfield_count set in metacat.properties, then store the
|
435
|
string in xml_queryresult as a record which has the returnfield_id
|
436
|
representing the set of returnfields, docid representing the
|
437
|
document and the string as queryresult_string.
|
438
|
6) Add all the strings from step 4 and step 5a to send back the resultant
|
439
|
document
|
440
|
So the results from step 3a in previous algorithm are effectively cached
|
441
|
and hence same computation is not done again and again for each search.
|
442
|
When a document is deleted, all the entries for that document in
|
443
|
xml_queryresult table are also deleted. When a document is updated, all
|
444
|
the entries for that document in xml_queryresult table are deleted. This
|
445
|
works fine because those entries will be generated and cached again the
|
446
|
next time the document is part of a search is requested.
|
447
|
* Performance impovement done for % search.
|
448
|
* Following new functions added to metacat client API: a method to set access
|
449
|
on an xml document and a method to get newest version for a given document.
|
450
|
* Implement a new HarvesterServlet for running Harvester as a servlet. This
|
451
|
eliminates the need to run Harvester in a terminal window. By default, the
|
452
|
HarvesterServlet is commented out in lib/web.xml.tomcat(3,4,5). The user
|
453
|
documentation will be modified to instruct Harvester administrators to
|
454
|
uncomment the HarvesterServlet entry.
|
455
|
* Minor enhancement to support multiple email addresses for harvester
|
456
|
administrator and site contact. Each address is separated by a comma or
|
457
|
semicolon.
|
458
|
* Increase number of rows in Harvest List Editor from 300 to 1200.
|
459
|
* Changed default maxHarvests value to 0. Added logic to ignore maxHarvests
|
460
|
value when it is set to 0 or a negative number. This allows Harvester to
|
461
|
run indefinitely without shutting down after reaching a maximum number of
|
462
|
harvests. The previous default value of 30 would cause Harvester to
|
463
|
terminate after 30 harvests.
|
464
|
|
465
|
Details of all changes can be found in the bug database here:
|
466
|
http://bugzilla.ecoinformatics.org/buglist.cgi?product=Metacat&target_milestone=1.5
|
467
|
|
468
|
|
469
|
Release Notes for 1.4.0:
|
470
|
------------------------
|
471
|
|
472
|
This is a major release, and is the first to introduce many new features to
|
473
|
Metacat. Some of the major new features in this version of Metacat include:
|
474
|
|
475
|
* Added a new 'Harvester' that allows documents to be periodically pulled
|
476
|
from distributed sources into metacat, useful for interfacing with other
|
477
|
system types. See the Metacat Tour for details.
|
478
|
* Added new 'skins' capability to allow the GUI for the metacat web interface
|
479
|
to be more easily customized to fit into site needs. The skin is based on
|
480
|
a flexible mix of XSLT, CSS, and Javascript.
|
481
|
* Added a web-based metadata entry form for submitting limited EML documents
|
482
|
as part of a data registry. The GUI for the registry is customizable and
|
483
|
is integrated with the 'skins' system for the main metacat interface. The
|
484
|
registry subsystem is written in Perl, and can simultaneously be used to
|
485
|
present multiple 'registry' interfaces.
|
486
|
* A new 'client API' has been developed and implemented in Java and in Perl
|
487
|
so that metacat functions can be accessed from any program in those
|
488
|
languages. The client API supports the major metacat servlet actions,
|
489
|
including login(), logout(), query(), insert(), update(), delete(), and
|
490
|
upload(). See the Metacat Tour for details.
|
491
|
* Added a new 'getlog' action that produces a usage history for all major
|
492
|
events. So now an XML report can be generated for document reads, inserts,
|
493
|
deletes, etc. See the new section in the Metacat Tour.
|
494
|
* Added a new 'buildindex' action that can rebuild the index entries for any
|
495
|
document in the database.
|
496
|
* The configuration file for metacat (metacat.properties) has been moved out
|
497
|
of the jar file and into the WEB-INF directory, allowing far easier changes
|
498
|
to the configuration parameters.
|
499
|
* Results in default web interface are sorted by title in the XSLT
|
500
|
(configurable)
|
501
|
* Many bugs were fixed.
|
502
|
|
503
|
Details of all changes can be found in the bug database here:
|
504
|
http://bugzilla.ecoinformatics.org/buglist.cgi?product=Metacat&target_milestone=1.4
|
505
|
|
506
|
Release Notes for 1.3.1:
|
507
|
------------------------
|
508
|
|
509
|
This is a simple interim bug fix. No major functionality changes. Bugs fixed
|
510
|
include:
|
511
|
1) Metacat 1.3.0 doesn't work in Java 1.3 because a subtle API differnce in
|
512
|
Java 1.3 and Java 1.4. Currently, Metacat 1.3.1 will work in both Java 1.3
|
513
|
and Java 1.4.
|
514
|
2) Distribution package size was reduced.
|
515
|
|
516
|
|
517
|
Release Notes for 1.3.0
|
518
|
------------------------
|
519
|
|
520
|
In 1.3.0 release, the structure of the xml_access table was changed and a new
|
521
|
table, xml_accesssubtree was added. If you try to update a previously
|
522
|
installed Metacat, you should run a script file to updated the table structure
|
523
|
before installation.
|
524
|
For Oracle user: At the SQLPLUS prompt type the following -
|
525
|
@src/reviseformetacat13.sql
|
526
|
For Postgresql user: At install directory prompt type the following -
|
527
|
psql exp < src/reviseformetacat13_postgres.sql
|
528
|
(where 'exp' is the database name).
|
529
|
|
530
|
After installation, user should run "ant schemasql" command to register EML2
|
531
|
schema in xml_catalog table.
|
532
|
|
533
|
If you are a new Metacat user, this step is unneeded.
|
534
|
|
535
|
Note: 1) We recommend to use Tomcat 4 and JAVA 1.4 to run Metacat. Otherwise,
|
536
|
it will cause potential replication issues.
|
537
|
2) Delete the xercesImpl.jar and xmlParserAPIs.jar files
|
538
|
which are in $CATALINA_HOME/common/endorsed. They are old version and
|
539
|
don't support XML schema validation.
|
540
|
|
541
|
New Features in 1.3.0
|
542
|
1) Partialy support EML2 document. User can store, query, read and write
|
543
|
EML2 documents. However, Metacat only support access control in resource
|
544
|
level. The subtree level access control will be ignored.
|
545
|
2) Support other xml document base on namespace/schema.
|
546
|
3) Support query for attribute value
|
547
|
4) Assign MIME type to data file base on metadata when user try to read it.
|
548
|
5) Owner can assign access rules to a document which does not have access
|
549
|
document to apply it.
|
550
|
6) Support exporting single file, not only whole package
|
551
|
7) Resupport Microsoft SQL Server.
|
552
|
|
553
|
Fixes in 1.3.0:
|
554
|
1) Couldn't finish delta T replication for large set of documents.
|
555
|
2) Couldn't create access control during delta T replication.
|
556
|
3) Eorr will be written to a seperated log file if some documents
|
557
|
were failed in replication.
|
558
|
4) Decrease the time to create access rules during insert or update
|
559
|
a package.
|
560
|
|
561
|
Documentation
|
562
|
-------------
|
563
|
See the docs directory for detailed documentation and installation
|
564
|
instructions.
|
565
|
|
566
|
Details of the Metacat architecture can be found on the website for
|
567
|
the Knowledge Network for Biocomplexity (KNB):
|
568
|
|
569
|
http://knb.ecoinformatics.org/software/metacat/
|
570
|
|
571
|
Contributions to this work are welcome. Please see the above web site
|
572
|
for details on how to contribute.
|
573
|
|
574
|
Major Known Bugs or Feature Requests (see http://bugzilla.ecoinformatics.org)
|
575
|
-----------------------------------------------------------------------------
|
576
|
If you discover a bug please report it, either by email (above) or by using
|
577
|
our bug tracking system (http://bugzilla.ecoinformatics.org). There is a
|
578
|
list of currently unimplemented features in Bugzilla that we are working on
|
579
|
for the next release.
|
580
|
|
581
|
Legalese
|
582
|
--------
|
583
|
This software is copyrighted by The Regents of the University of California
|
584
|
and the National Center for Ecological Analysis and Synthesis
|
585
|
and licensed under the GNU GPL; see the 'LICENSE' file for
|
586
|
details.
|
587
|
|
588
|
This material is based upon work supported by the
|
589
|
National Science Foundation under Grant No. DEB99-80154, DBI99-04777, and
|
590
|
0225676 for SEEK. Any opinions, findings and conclusions or recomendations
|
591
|
expressed in this material are those of the author(s) and do not necessarily
|
592
|
reflect the views of the National Science Foundation (NSF).
|
593
|
|
594
|
This software is partially supported by a grant from the Andrew W.
|
595
|
Mellon Foundation.
|
596
|
|
597
|
This product includes software developed by the Apache Software
|
598
|
Foundation (http://www.apache.org/). See the LICENSE file in lib/apache
|
599
|
for details.
|
600
|
|
601
|
The source code, object code, and documentation in the com.oreilly.servlet
|
602
|
package is copyright and owned by Jason Hunter. See the cos-license.html file
|
603
|
for details of the license. Licensor retains title to and ownership of the
|
604
|
Software and all enhancements, modifications, and updates to the Software.
|
605
|
|
606
|
This software includes the JDBC driver for PostgreSQL. See the
|
607
|
postgresql-license.txt file for details.
|