Bug #325

create site filters to convert site metadata to eml packages

Added by Matt Jones over 19 years ago. Updated over 16 years ago.

Target version:
Start date:
Due date:
% Done:


Estimated time:


Site specific metadata/data formats need to be converted into EML packages and
transferred via the harvester API to metacat. See visio diagram for design ideas.

Related issues

Blocks Utilities - Bug #323: Establish API for communication with src and destIn Progress11/08/2001

Blocks Utilities - Bug #324: perl implementation of harvester apiIn Progress11/08/2001


#1 Updated by David Blankman about 19 years ago

Attended Data Junction workshop in mid December to evaluate Data Junction as an option for
parsing structured & semi-structured legacy (ascii)site metadata in order to harvest into

Worked with some of the sites with legacy metadata at workshop in Phoenix (Jan 7-9) as
part of Data Junction evaluation process.

Currently in process of doing actual conversion
of site metadata for the North Temperate Lakes metadata. Conversion will be both to eml and to NTL
oracle database.

#2 Updated by Matt Jones about 19 years ago

Moved issues that we do not intend to address during the current release to the
'Postpone' milestone.

#3 Updated by David Blankman over 18 years ago

Have done some sample conversions from semi-structured text metadata (document
fragments) into eml-beta9. Was waiting until it became clear that no significant
changes would be made until I started to refine the process. I am currently
starting this process.

#4 Updated by David Blankman about 18 years ago

One complete conversion. Have developed basic mapping. Because of lack of
completeness of exisitng metadata at the attribute level, there is a fair
amount of manual work that needs to be done.

#5 Updated by Matt Jones over 16 years ago

Duane -- could you deal with this by either closing it if it is eing tracked
elsewhere or updating it with a plan. Thanks.

#6 Updated by Duane Costa over 16 years ago

A number of metadata conversion applications were implemented by David
Blankman, with the help of two graduate students, to help sites convert their
native metadata to EML. One application was successfully used at the Hubbard
Brook (HBR) site. A second is expected to be deployed soon at the Arctic (ARC)
site. Several other applications have neared completion but have not yet been
deployed at the sites.

Mark Servilla, lead scientist for Network Information Systems (NIS) at the
LTER Network Office, is analyzing the results of a recent LTER site survey and
has provided his assessment to the NIS Advisory Committee so that the
committee can determine the appropriate level of effort to place in the
continued develop and maintenance of these applications. Since the time that
these conversion applications were originally conceived, many of the sites
have moved forward on their own and in some cases they no longer need such an

Since this bug is local to LTER and not directly related to Metacat
development, I will close it. The work will be tracked internally in the
Request Tracker system at the Network Office (

#7 Updated by Redmine Admin almost 8 years ago

Original Bugzilla ID was 325

Also available in: Atom PDF