Project

General

Profile

Bug #748

Systematic approach to rectification

Added by Michael Lee almost 20 years ago. Updated about 16 years ago.

Status:
New
Priority:
Normal
Assignee:
Category:
userLoad
Target version:
Start date:
11/13/2002
Due date:
% Done:

0%

Estimated time:
Bugzilla-Id:
748

Description

PI decide how to approach design of rectification


Related issues

Is duplicate of VegBank - Bug #759: Loader rectification tools: PlantConcept (from TaxonInterp and TaxonAlt)Resolved11/13/2002

Is duplicate of VegBank - Bug #760: Loader rectification tools: CommConcepts (from CommInterp)Resolved11/13/2002

Is duplicate of VegBank - Bug #763: Loader rectification tools:NamedPlace (from place)Resolved11/13/2002

Blocked by VegBank - Bug #747: [615] :Loader rectification tools-bResolved11/13/2002

Blocked by VegBank - Bug #754: Loader rectification tools: ReferencesResolved11/13/2002

Blocked by VegBank - Bug #770: [673] :Loader rectification tools:Picklists-bResolved11/13/2002

Blocked by VegBank - Bug #746: Loader rectification tools:PartyResolved11/13/2002

Blocks VegBank - Bug #822: Annotation: view current notes on data + create notesResolved11/13/2002

History

#1 Updated by Michael Lee almost 22 years ago

just not time for these bugs in 1.0, pushed to 1.1

#2 Updated by Michael Lee over 19 years ago

we need a plan for how we will rectify parties, plants, etc. to VegBank records.
VegBranch has a tool for this as a starting point, perhaps. This will be
nearly impossible to automate (in that no computer will be able to judge
ambiguous cases), so it will have to be a step-by-step process.

This plan needs to be created very soon. This bug can be marked resolved as
soon as the plan is finished.

#3 Updated by Robert Peet over 19 years ago

"Create a plan" -- This must be the mother of all bugs.

So I suppose it was intended to be "create a plant". I think we decided to
omit this option from the loader and require that any plants rejected by the
validation/rectification layer be returned to the submitter to enter through
forms. Ultimately we will provide a mechanism for mass insertion of plants
(perhaps via the Access tool), but for now no. The forms for loading plants
will need to search for matches in the concept/names/references tables and
report misses and close misses. The level at which this gets done will
increase in sophistication as we move beyond version 1.0 to 2.0

I turn this bug over to Michael for refinement, and he will in turn hand it to
Gabe for implementation

#4 Updated by Michael Lee over 19 years ago

Indeed, this is the mother of all bugs (MOAB). Well, at least all bugs that
pertain to rectification. We sort of made a plan in Santa Barbara last meeting,
which was essentially, that rectification would be a 1.0.1. issue for us to
resolve. How we are going to do rectification remains to be solved, as well as
the different types of things that need rectification.

Currently, I believe our status with recitification is that your value (be that
a closed list value, a party, a plant, a placeNAme) must match exactly or else
your plot gets rejected. We need to "Create a plan" to make rectification work,
but this should probably wait until we have created a framework for web pages to
talk to the db and vice versa. Quite crucial for rectification to work.

So for now, I'll accept this bug as mine, and I will hopefully be able to get us
moving on this for 1.0.1

#5 Updated by Michael Lee almost 19 years ago

one of 5 major bugs (or so) and thus critical and highlighted red.

We will use the notes tables to populate information which requires
rectification. Thus we will need to add a note type "rectification Request".

When data are imported into Vegbank via the XML loader, several things may need
rectification.

1) closed lists with values that don't match will need to either:
a) user changes to match a value
b) user changes to make null (if nulls are allowed)

2) [more complex] certain entities that are referenced may need checking to make
sure they are not duplicates (party, reference, plantConcept, commConcept, a few
others). IF a user submits a new one of the above, we might want to do one of
the following:
a) add the new thing, but also add a note requesting that the user go back
and check that this is indeed new. Options for user are then: a) confirm it's
new, b) match to another eleemnt (ie party). IF b) we run into problems because
it would be nice to delete the extraneous party that was created.
b) not add the element, but instead store the XML as the note, and when the
user deals with rectification requests, the XML is reparsed and info presented.
If user says, yes this is new, it's added, if they say, no this is something
else, then the something else gets referenced and the first thing goes away.
This could get complex if very nested elements, but we may be able to use this
route. Would have to have some rectification-placeholder elements, probably, so
that taxonInterpretations could be stored, pointing to uncertain plantConcepts.
This is complex, but almost all elements to be rectified are not too complex:
party, plant, comm, reference, methods.

--------------
anyway, we need to develop a plan that will extend easily to new pieces of data
that we'd like to rectify.

#6 Updated by Michael Lee almost 18 years ago

  • Bug 760 has been marked as a duplicate of this bug. ***

#7 Updated by Michael Lee almost 18 years ago

  • Bug 746 has been marked as a duplicate of this bug. ***

#8 Updated by Michael Lee almost 18 years ago

  • Bug 754 has been marked as a duplicate of this bug. ***

#9 Updated by Michael Lee almost 18 years ago

  • Bug 763 has been marked as a duplicate of this bug. ***

#10 Updated by Michael Lee almost 18 years ago

  • Bug 759 has been marked as a duplicate of this bug. ***

#11 Updated by Redmine Admin over 9 years ago

Original Bugzilla ID was 748

Also available in: Atom PDF