VegBank

(In reply to comment #0)

Some of the following is done, some of it can be done with SQL, some of it can't.

The URL describes tasks needed for nightly, or perhaps weekly for VegBank.
MLee should write the SQL that accomplishes these things, then Chad could
implement the cron job.

• make automated caching of home page data + wget on all the cache data.
  DONE! make backup of database
  *remove backups older than 4 months old too??
  *SQL: plus we should probably vacuum analyze too each night
  *SQLFile: perhaps would be nice to run SQL each night: dba_current-table-stats.sql in src/sql - this gets stats on what's currently in the db in terms of record counts for each table.
  *SQL: delete anon datasets > 24 hours old
  *SQL: delete users datasets with stopDate more than one month ago

OK, everything that can be done via SQL, including the VERY IMPORTANT VACUUM ANALYZE is now accomplished by "periodic_cron_sql.sql" in /src/sql/.

This needs to be run against the db, as well as "dba_current-table-stats.sql" in the same dir, probably weekly is fine.

There are a few outstanding tasks that should be done by the cron job, namely, but these are other bugs:
*make automated caching of home page data + wget on all the cache data. (bug #2482)
*remove backups of the database that are older than 4 months, except a few (bug #2395)

I've come up with the SQL, but that's all I can do with this. Chad, can that be implemented with a Cron on a nightly or weekly basis?

caching of homepage data is CRITICAL that it be done somehow without ant.

Perhaps we could set a cron-job to run ant to get the data?????

this is now running with a cron job.

Original Bugzilla ID was 2478