2015-01-12

TDCF migration of upper-air sounding data

The World Meteorological Organization (WMO) has been working for TDCF migration, which is transition from observation reports and forecast messages in TAC (traditional alphanumeric codes) into TDCF (table-driven code forms) namely BUFR (binary universal representation) and CREX.  For most of message types, the parallel distributions were scheduled up to November 2014.  

Some countries actually stopped their TAC distributions, and
it turned out that the meteorology community needs more work to get fully ready to the transition, especially for upper-air sounding.  The situation was complicated since WMO tried to change not only code but reporting practice, as discussed in following forum thread:

Traditionally, the alphanumeric messages for a single ascent of radiosonde are supposed to be disseminated in four parts:

  • Part A: standard isobaric levels up to 100 hPa
  • Part B: significant levels up to 100 hPa
  • Part C: standard isobaric levels above 100 hPa
  • Part D: significant levels above 100 hPa

The standard isobaric levels are 1000, 925, 850, 700, 500, 400, 300, 250, 150, and 100 for Part A; and 70, 50, 30 and 10 hPa for Part C.  Weather charts are supposed to be drawn at those levels (JMA's charts are available at http://www.jma.go.jp/jp/metcht/kosou.html).

The significant levels (in Parts B and D) supplements standard levels so that linear interpolation of all reported data (both standard and significant levels) gives enough accuracy.  Roughly they are chosen at kinks of plots of temperature, humidity, and winds  (a good illustration of temperature siglevs is given at ECMWF website).  Please see the Manual on Codes Volume I.1 for the complex rules for selecting significant levels.

Then, why do we split messages at 100 hPa?  The answer is time of delivery.  The 100 hPa level lies 16 km above sea level.  Typical radiosonde has 6 m/s speed.  It takes 45 minutes to reach that level.  The time may double if we wait for the end of ascent: that's why WMO member states agreed to split the report.

In the new paradigm of BUFR, there is a rule called B/C 20 and 25 to determine how to migrate from TAC to BUFR:
https://www.wmo.int/pages/prog/www/WMOCodes/BC_Regulations/BC20-PILOT.pdf
https://www.wmo.int/pages/prog/www/WMOCodes/BC_Regulations/BC25-TEMP.pdf
It describes two messages should be sent for a single ascent:

  • Standard and significant levels up to 100 hPa
  • Standard and significant levels above 100 hPa
I guess the designers of the rules thought "the reason for splitting Parts A-B and C-D is simply for size of bulletins;  now the size limitation of GTS bulletins are being eliminated;  why don't we merge unnecessary split?"

That was correct, but the meaning or value of the reporting style was not stressed.  So implementers simply used the template only and ignored the text regulations.  Most implementations simply converts existing TAC to BUFR in parts.

It was supposed that BUFR would get the mainstream, i.e. observation systems directly generated BUFR and TAC were made as a compatibility service.  By doing so we could eliminate various problems of TAC reports.  But that mainstreaming did not take place in many WMO members.  I suspect the change of the rule is even not known for many people working for observation systems.  So the part-for-part converter had to be chosen.

There are many benefits of BUFR-mainstreamed data processing, which is basically straightforward handling of numbers.  For example 1000's digit of geopotential height in lower troposphere is omitted in FM 35 TEMP.   If 700 hPa height is 3451 metres, only digits "451" is shown in the report, and the recipient has to guess the lost digit using "common sense".  It is usually 3451 m in most of the world, but it can be 2451 m in very cold places like Antarctica, so it is a headache for automated system.  A simple-minded converter always generates BUFR with 3451 m value for TAC input "451" which may be incorrect.  But the benefit has not so stressed for these decades, and I don't think many understand it.

Right now there are many proposals to change the part-by-part converted BUFRs to distinguish Parts A-D.  But I'd really remind the situation filled by a whole bunch of unimplemented regulations and ununderstood good intentions.  I think we must be really careful for changing rules, since current one takes many years to be understood partly.

2014-12-01

Horizontal and Vertical Datums in Operational Meteorology

Tommorow afternoon I'll talk about the idea below in OGC Met-Ocean DWG.  Hope that makes sense for them.
---
Volume A, Publication 9 of WMO is a catalogue of observing stations, compiled from submission from WMO's member states.  That, of course, includes latitude, longitude and hight above MSL (mean sea level), which are measured from some datum.  Which datum?  That is the question.

Honestly I don't know.  And I'd like to be honest.  So I'd like to make it clear that the datum is unclear.

Recommendation 1, CBS-Ext.(06) recommended that WGS 84 and EGM-96 are the references i.e. datums for coodinates and hight measurement.  But I saw not so much coordinates in the catalogue has changed since then.  So it is highly likely that many member states do not recognise what the recommendation is, and the coordinates/hight measured from past national datums are still listed.

For horizontal coordinates i.e. latitude/longitude that is no problem.  Volume A used to have one arc-minute precision.  The format has been changed to have one arc-second precision, but there are still a bunch of entries with zero-zero seconds.  One arc-minute is roughly one kilometer on the earth, and that is the precision of meteorological analysis.  If there is some coordinates data from different datum, the difference is usually less than a kilometer, so we can live with the situation.

Vertical datum is different.  Some national datums have difference more than one meter from EGM-96.  And we want 0.01 m precision (even the old format had one meter precision). One meter error means 0.1 hPa error in pressure, which is significant in operational meteorology.

So we need to be clear that the datum is unclear.

2014-11-14

16th ECMWF Workshop on High Performance Computing in Meteorology, 2014-11-27/31

This time I wasn’t there. Presentations are available on the web.

http://www.ecmwf.int/en/workshop-high-performance-computing-meteorology

2014-11-11

[METNO C] new Korean Argo Float BUFR; NZ stops TEMP/SHIP/AIREP/AMDAR/PILOT/TEMP

TAC termination comes to the Eastern hemisphere....

5 AA 20/11/2014 2 TOKYO REPUBLIC OF KOREA SEOUL 07/11/2014 E IOPX02
RKSL FM 94-XIII AS AVAILABLE ARGO FLOAT BUFR

0061 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 30/04/2012 E
SINZ20 NZKL FM 12-XI 03,09,15,21 93004 93023 93069 93110 93186 93196
93245 93292 93309 93334 93339 93373 93404 93420 93439 93498 93515
93527 93546 93597 93615 93678 93709 93773 93781 93800 93805 93831
93845 93891 93909 93929 93947 93985 93994 XXX
0062 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 20/09/1999 E
SIPS20 NZKL FM 12-XI 03,09,15,21 91824 XXX
0063 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 19/08/2011 E
SIPS21 NZKL FM 12-XI 03,09,15,21 91723 91964 XXX
0064 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 20/09/1999 E
SIVE20 NZKL FM 13-XI 03,09,15,21 XXX SHIP
0065 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 19/08/2011 E
SMNZ01 NZKL FM 12-XI 00,06,12,18 93004 93023 93069 93110 93186 93196
93245 93292 93309 93334 93339 93373 93404 93420 93439 93498 93515
93527 93546 93597 93615 93678 93709 93773 93781 93800 93805 93831
93845 93891 93909 93929 93947 93985 93994 XXX
0066 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 20/09/1999 E
SMPS01 NZKL FM 12-XI 00,06,12,18 91824 XXX
0067 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 19/08/2011 E
SMPS02 NZKL FM 12-XI 00,06,12,18 91723 91964 XXX
0068 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 20/09/1999 E
SMVE01 NZKL FM 13-XI 00,06,12,18 XXX SHIP
0069 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 17/02/2009 E
SMVJ01 NZKL FM 13-XI AS AVAILABLE XXX SHIP
0070 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 17/02/2009 E
SNVE20 NZKL FM 13-XI AS AVAILABLE XXX SHIP
0071 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 20/09/1999 E
UAPS01 NZKL XXX AS AVAILABLE XXX AIREP REPORTS OVER SOUTHWEST PACIFIC
0072 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 09/12/2003 E
UDOC01 NZKL FM 42-XI AS AVAILABLE XXX AMDAR REPORTS OVER TASMAN SEA
BETWEEN AUSTRALIA AND NEW ZEALAND
0073 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/01/2012 E
UENZ02 NZKL FM 35-X EXT. 00 93112 93417 93844 93997 XXX
0074 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 20/09/1999 E
UENZ02 NZKL FM 35-X EXT. 12 93112 93417 93844 XXX
0075 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/01/2012 E
UGNZ21 NZKL FM 32-IX 00 93112 93417 93844 93997 XXX
0076 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/12/2011 E
UGNZ21 NZKL FM 32-IX 12 93112 93417 93844 XXX
0077 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/01/2012 E
UHNZ02 NZKL FM 32-IX 00 93112 93417 93844 93997 XXX
0078 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/12/2011 E
UHNZ02 NZKL FM 32-IX 12 93112 93417 93844 XXX
0079 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/01/2012 E
UKNZ02 NZKL FM 35-X EXT. 00 93112 93417 93844 93997 XXX
0080 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 20/09/1999 E
UKNZ02 NZKL FM 35-X EXT. 12 93112 93417 93844 XXX
0081 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/01/2012 E
ULNZ02 NZKL FM 35-X EXT. 00 93112 93417 93844 93997 XXX
0082 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 20/09/1999 E
ULNZ02 NZKL FM 35-X EXT. 12 93112 93417 93844 XXX
0083 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/01/2012 E
UPNZ02 NZKL FM 32-IX 00 93112 93417 93844 93997 XXX
0084 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/12/2011 E
UPNZ02 NZKL FM 32-IX 12 93112 93417 93844 XXX
0085 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/01/2012 E
UQNZ21 NZKL FM 32-IX 00 93112 93417 93844 93997 XXX
0086 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/12/2011 E
UQNZ21 NZKL FM 32-IX 12 93112 93417 93844 XXX
0087 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 01/01/2012 E
USNZ02 NZKL FM 35-X EXT. 00 93112 93417 93844 93997 XXX
0088 DD 15/12/2014 5 WELLINGTON NEW ZEALAND WELLINGTON 20/09/1999 E
USNZ02 NZKL FM 35-X EXT. 12 93112 93417 93844 XXX

European GTS Headings with no receipt at GISC Tokyo since 2014-11-03 or 11-04

One week has passed since several European countries shut down synoptic reports in TAC (Traditional Alpha-numeric Codes).  Here is current status.

 

= No receipt since 2014-11-04

 

SIAA14EGRR
SIAA21EGRR
SIAA22EGRR
SICY20EGRR
SIGI21EGRR
SIHE20EGRR
SINL20EHDB
SINL21EHDB
SIST21EGRR
SIUK21EGRR
SIUK42EGRR
SIUK43EGRR
SMAA01EGRR
SMAA02EGRR
SMAA14EGRR
SMCY01EGRR
SMGI01EGRR
SMHE01EGRR
SMST01EGRR
SMUK01EGRR
SMUK42EGRR
SMUK43EGRR
SNAA14EGRR
SNAA41EGRR
SNGI21EGRR
SNHE40EGRR
SNST41EGRR
SNUK41EGRR
SNUK42EGRR
SNUK43EGRR
UKNL01EHDB
USNL01EHDB

 

l  Exeter UK (EGRR) terminated all surface reports in FM12 SYNOP (heading S*EGRR) including overseas territories and Antarctica

l  De Bilt Netherlands (EHDB) terminated only Parts A and B of Upper-air sounding in FM35 TEMP.  Parts C and D (heading ULNL01 and UENL01) are still available.  I don’t know why.

 

= No receipt since 2014-11-05

 

SIIE21EIDB
SIIE22EIDB
SIIE23EIDB
SMIE01EIDB
SMIE22EIDB
SMIE23EIDB

l  Dublin Ireland (EIDB) terminated Synop - GISC Tokyo has not been receiving hourly SYNOP (SNIEiiEIDB).

2014-11-10

Changes of present weather symbols for synoptic charts - long messy history

I've got involved in a question:

"There are many websites describing plot symbols for weather maps.  Why some are different?"

Is there really difference?  Yes, unfortunately.

Currently valid definition of the symbols are given in the Attachment II-4 of the Manual on GDPFS Volume I (WMO Pub No.485).  The symbols are given in 10x10 table indexed by two-digit number ww, and the meaning of the numbers are defined in the code table 4677 of the Manual on Codes, Volume I.1 (WMO Pub. 306).  Those are all online in PDF --- thanks to the Internet.  But you can find several websites showing slightly different tables, for example http://www.australianweathernews.com/learn_about_surface_charts.htm or http://www.asahi-net.or.jp/~ns8m-hgc/w-wld1.htm .  The differences are (as far as I found):

-       00-03 have circle-like symbols, which are currently absent,

-       07 does not have alternative symbol like cursive lowercase L for ocean spray,

-       11 is *two* horizontal broken bars, unlike current *three* broken bars ( or http://www.fileformat.info/info/unicode/char/2637/index.htm), and

-       12 is *one* broken bar over another bar, unlike current *two* broken bars over another bar ( or http://www.fileformat.info/info/unicode/char/2633/index.htm).

 That's the table used before 1962.  I found the same table in the WMO Technical Regulations published in 1959.

-       1962: Rec.67 CSM-III decided the symbols for 11 and 12 should be the present style. The text suggests there were confusion before that.

-       1970: 6.4.2.2 CSM-V introduced the symbol for spray (code 07).  It also decided removal of many code points including 00-03, but those are not carried out at that time.

-       1980: Rec.7 CBS-Ext.(80) superseded the symbol table with new one in which code points 00-03 remain blank.a

The final reports of CBS (Commission for Basic Systems) and CSM (Commission for Synoptic Meteorology) are found here: http://goos.kishou.go.jp/ws/ETMC/code_task/doc_cmm_cbs.html

 

2014-11-07

METNO A - Correction as note in Part F

Change of the index number could be done in Part C, but Part F was chosen to indicate that previous notice is invalid.  Correctness was achieved by sacrificing computer readability….

> NOXX01 LSSW 060800
> METNO A4514
> A  NIL /
> B  NIL /  
> C  NIL /  
> D  26529     PANEVEZYS         55 44 07N     24 25 02E     HP58.3     H/HA57.09 /
>     01004(1)  NY-ALESUND II     78 55 24N     11 55 20E     HP.          H/HA15.5 /
> E  NIL /
> F  (26529 PANEVEZYS)   ()  ERRONEOUSLY INDICATED AS 26259 PANEVEZYS  IN METNO A4414, SECTION D /
> G  NIL /
>