WIS sync monitor updated

The WIS metadata sync monitor http://toyoda-eizi.net/2011/syncmon/mon.html
has been updated. The diffs no longer indicate lists of identifiers, as
they became unrealistically huge these days. The numbers are indicated
instead.

(1) Snapshot Diffs fixed - it has long been broken
http://toyoda-eizi.net/2011/syncmon/curr/DIFF.atoment

(2) CSV version of Snapshot Diffs added
http://toyoda-eizi.net/2011/syncmon/curr/DIFF.csv

(3) Diag Diffs fixed - it has long been broken
http://toyoda-eizi.net/2011/syncmon/curr/DIAG.atoment

(4) CSV version of Diag Diffs added
http://toyoda-eizi.net/2011/syncmon/curr/DIAG.csv

There were also internal improvements to collect data more robustly. Even
though I've paid every efforts of ugly parallel programming, the growing
size and slowing performance of servers makes the process a bit slower --
the update will be visible about 80 minutes after every 3 hours.

If you have RSS reader, try following the feed:
http://toyoda-eizi.net/2011/syncmon/news.atom

WISTEST-* sets removed

The WISTEST-* OAI sets was made for presenation at CG-XVI. The sets
included OAI identifiers in operational namespace
"urn:x-wmo:md:int.wmo.wis::*" and hence caused trouble in loading the WMO
baseline metadata.

After the test sets removed, 2702 records of baseline MD was inserted into
WIS-UNASSOCIATED set. It reflects only onto the set WIS-CATALOGUE, and I
believe that won't affect synchronisation among CMA/DWD/JMA.

fixed: size of OAI set displayed incorrectly

In the WIS community there is a convention that the size of OAI set is
included in ListSet response.

http://www.wis-jma.go.jp/meta/oaiprovider.jsp?verb=ListSets

Until last week there was an problem that the size of WIS-GISC-TOKYO is not
displayed correctly. It is now fixed and it returns reliable number.

The documentation at http://www.wis-jma.go.jp/cms/metadata/oai-pmh/ uses the
ListSets internally, and hence fixed accordingly.

OAI Sync Monitor update

Recent updates of OAI Sync Monitor
http://toyoda-eizi.net/2011/syncmon/mon.html

- Beijing joined and the set WIS-GISC-BEIJING introduced
- Temporary set WIS-UNASSOCIATED introduced
- Testing set WISTEST-* no longer monitored.

metadata updates

- GISC Tokyo has loaded GTS baseline metadata for VBRR, VNNN, VTBB, VLIV,
VMMC, RPMM, VHHH.
- Set WIS-WIMMS created.
- most of WISTEST-JMA set has been deleted; right now deletion in terms of
OAI so other synching centres may harvest that del-notification to react.
Four records are kept just for testing.

WIS Sync Monitor revived

My monitor has been refreshed. It has now updated list of servers and sets,
and there is a bit nicer top page with minimal description.

http://toyoda-eizi.net/2011/syncmon/mon.html

all records in WIS-GISC-TOKYO confirmed to have non-empty dateStamp

Hi,

I've run a test program to check all records in WIS-GISC-TOKYO set. This
time no record has gco:nilReason="missing".

Best,
Eizi