new metadata for World Data Centre for Greenhouse Gases

The World Data Centre for Greenhouse Gases (WDCGG), operated by Japan
Meteorological Agency, has moved to new website
http://ds.data.jma.go.jp/gmd/wdcgg/ effective 29th February 2012. So we've
re-generated WIS version metadata to reflect new URL structure. Now 1570
records are available.

You can browse list of records at GISC Tokyo:
http://www.wis-jma.go.jp/meta/search.jsp?oai_provider=0&text=WDCGG

You can also use GISC's SRU interface. This example searches CO2 observation
in sub-sahara Africa:
http://www.wis-jma.go.jp/meta/sru.jsp?version=1.1&operation=searchRetrieve&query=CO2+and+geo.bounds+within%2Fpartial%2Fnwse+%2220+-20+-45+50%22

And the good news is we have fixed URL link in metadata records, so the
catalogue now links to real data for example
http://ds.data.jma.go.jp/gmd/wdcgg/cgi-bin/wdcgg/accessdata.cgi?select=inventory&index=NMB123S00-NOAA

Metadata entry from Cambodia

On 22nd March, Department of Meteorology (DOM) of Cambodia has submitted an
metadata record describing their GTS bulletin SMKP01 VDPP.

http://www.wis-jma.go.jp/meta/search.jsp?text=SMKP01VDPP

This is a great step!

take 2

this is a test of blog posting

metadata records for GRIB data at GISC Cache Tokyo

I'm now publishing metadata records for GRIB data in two-tier structure.

== Tier 1: Per-bulletin record

Example: http://www.wis-jma.go.jp/meta/search.jsp?text=HVXO10RJTD

The record has two links in "identification info". One links to actual
data:

Example: http://www.wis-jma.go.jp/data/browse?Indicator=RJTD&LinkText=HVXO10

Another links to metadata of a product which the bulletin belongs to.

Example:
http://www.wis-jma.go.jp/meta/search.jsp?text=GSM25X&keywords=GRIB+Aggregate

== Tier 2: Per-product record

Here I define "product" as a set of GRIB bulletins that share code-form,
model, resolution, and spatial area.

Example:
http://www.wis-jma.go.jp/meta/search.jsp?text=GSM25X&keywords=GRIB+Aggregate

This one links to actual data in the product.

Example:
http://www.wis-jma.go.jp/data/browse?Type=GRIB&Discipline=Global+Spectral+Model&Resolution=2.5+2.5&Area=90.0+0.0+0.0+357.5

WIS Sync monitor runs 4-hourly

Starting 12Z yesterday (2012-02-08T12Z), the monitor runs 4 hourly instead
of 3 hourly before. This is due to increase of harvesting/processing time
these days. Apologies for any inconvenience.

WIS Sync Monitor Updated again

The WIS metadata sync monitor http://toyoda-eizi.net/2011/syncmon/mon.html
had pretty much updated. The greatest beauty is that we serve each archived
file (not only zipfiles): you can save URLs in the RSS
http://toyoda-eizi.net/2011/syncmon/news.atom and click them later days!

I hope that won't cause too much load on my server.

Each report in RSS is issued in XHTML instead of Atom Entry XML which was
hard to handle in mobile devices. For example the "change since last
monitor" page becomes HTML like
http://toyoda-eizi.net/za/hist2012W06.zip/20120206T03/DIAG.html
and each link leads you to archived list of identifiers. That is useful in
maintaining sync network.

WIS sync monitor updated

The WIS metadata sync monitor http://toyoda-eizi.net/2011/syncmon/mon.html
has been updated. The diffs no longer indicate lists of identifiers, as
they became unrealistically huge these days. The numbers are indicated
instead.

(1) Snapshot Diffs fixed - it has long been broken
http://toyoda-eizi.net/2011/syncmon/curr/DIFF.atoment

(2) CSV version of Snapshot Diffs added
http://toyoda-eizi.net/2011/syncmon/curr/DIFF.csv

(3) Diag Diffs fixed - it has long been broken
http://toyoda-eizi.net/2011/syncmon/curr/DIAG.atoment

(4) CSV version of Diag Diffs added
http://toyoda-eizi.net/2011/syncmon/curr/DIAG.csv

There were also internal improvements to collect data more robustly. Even
though I've paid every efforts of ugly parallel programming, the growing
size and slowing performance of servers makes the process a bit slower --
the update will be visible about 80 minutes after every 3 hours.

If you have RSS reader, try following the feed:
http://toyoda-eizi.net/2011/syncmon/news.atom