Metacat

handle last group of ids (oops)

use range of the list for test system metadata

use non-random list for generating system metadata in test mode

use scope prefix (knb-lter-%) for random test doc population

do not subset the list for MS generation testing -- at least not as the default in svn!

only run ORE generation for EML docs -- no need to run this for all documents (yikes!)

use IdMan method to find docids that do not already have system metadata records -- this lets us re-run without re computing system metadata for every entry (in case the process is interrupted). I haven' been using this option because I wanted to continually regenerate all SM for everything in my test DBs, but we are so close to release that I want to get this in there.

for testing: limit and randomize the docs to generate metadata for

FOR TESTING ONLY: limit number of records to 100 so that we can get an estimate

refactor D1-specific upgrade utilities into their own package