2012-01-17

WIS sync monitor updated

The WIS metadata sync monitor http://toyoda-eizi.net/2011/syncmon/mon.html
has been updated. The diffs no longer indicate lists of identifiers, as
they became unrealistically huge these days. The numbers are indicated
instead.

(1) Snapshot Diffs fixed - it has long been broken
http://toyoda-eizi.net/2011/syncmon/curr/DIFF.atoment

(2) CSV version of Snapshot Diffs added
http://toyoda-eizi.net/2011/syncmon/curr/DIFF.csv

(3) Diag Diffs fixed - it has long been broken
http://toyoda-eizi.net/2011/syncmon/curr/DIAG.atoment

(4) CSV version of Diag Diffs added
http://toyoda-eizi.net/2011/syncmon/curr/DIAG.csv

There were also internal improvements to collect data more robustly. Even
though I've paid every efforts of ugly parallel programming, the growing
size and slowing performance of servers makes the process a bit slower --
the update will be visible about 80 minutes after every 3 hours.

If you have RSS reader, try following the feed:
http://toyoda-eizi.net/2011/syncmon/news.atom

2012-01-11

WISTEST-* sets removed

The WISTEST-* OAI sets was made for presenation at CG-XVI. The sets
included OAI identifiers in operational namespace
"urn:x-wmo:md:int.wmo.wis::*" and hence caused trouble in loading the WMO
baseline metadata.

After the test sets removed, 2702 records of baseline MD was inserted into
WIS-UNASSOCIATED set. It reflects only onto the set WIS-CATALOGUE, and I
believe that won't affect synchronisation among CMA/DWD/JMA.