- 1 - wmo information system (wis) heinrich knottenberg deutscher wetterdienst kaiserleistraße 42...
TRANSCRIPT
- 1 -
WMO Information System (WIS)
WMO Information System (WIS)
Heinrich Knottenberg
Deutscher Wetterdienst
Kaiserleistraße 42
D-63067 Offenbach am Main
E-Mail: [email protected]
27.September.2005 WMO Metadata Workshop - 2 -
WMO Information System (WIS)
Contents• Background
• Concept of WIS
• Impact on and benefit for WMO programmes
• Future actions
• Summary
27.September.2005 WMO Metadata Workshop - 3 -
WMO Information System (WIS)
Current WMO Information System
Includes:
(A) The World
Weather Watch
(WWW)
Source: Dr Geoff Love, President of CBS, 2001
27.September.2005 WMO Metadata Workshop - 4 -
WMO Information System (WIS)
Current WMO Information System
With its vitally important systems:
A (i) The Global
Observing
System (GOS)
Source: Dr Geoff Love, President of CBS, 2001
27.September.2005 WMO Metadata Workshop - 5 -
WMO Information System (WIS)
Current WMO Information System
A (ii) The Global
Data Processing
System (GDPS)
Source: Dr Geoff Love, President of CBS, 2001
27.September.2005 WMO Metadata Workshop - 6 -
WMO Information System (WIS)
Region IAfrica
Region IIAsia
Region IIISouthern America
Region IVNorthern & Central
America
Region VSouth-West Pacific
Region VIEurope
W ashington
Brasilia
BuenosAires
Dakar
Nairobi
Jeddah
Kairo
Sofia
Offenbach
Moskau
Peking
Tokio
Melbourne
Neu Delhi
= W orld M eteorological Centre (W M C)
= Regional Telecom m unication Hub (RTH)
Algier
Prag
Toulouse
Exeter
M ain Telecom m unication Network (M TN)
D W D /T I15b/M a25.02 .05
A (iii)The GlobalTelecom-municationSystem (GTS)
Current WMO Information System
27.September.2005 WMO Metadata Workshop - 7 -
WMO Information System (WIS)Information types, formats and
transmission systems• Real time
– meteorological
– hydrological
– marine
– aeronautical
• Non real time– climatological
– chemical composition
– agricultural
– ...
•ASCII–SYNOP, TEMP, CREX,...–XML–...
•Binary data formats–GRIB–BUFR–netCDF–...
•Graphical formats–MPEG–GIF–...
•Dial-up links
•Leased circuits
•Managed data networks
•Internet
•Satellite
•HF Radio, Telegraphy
•Post
•..
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 8 -
WMO Information System (WIS)
Current WMO Information SystemAnd also
includes:
(B) The multiplicity of Internet-based systems to meet WMO related requirements not met by the WWW
Source: Dr Geoff Love, President of CBS, 2001
27.September.2005 WMO Metadata Workshop - 9 -
WMO Information System (WIS)
Types of WWW Centres
• NMC National Meteorological Centre, e.g., Brasila (Brazil)
• RSMCRegional Specialised Meteorological Centre, e.g., Beijing (China)
• WMCWorld Meteorological Centre, i.e. Melbourne, Moscow, Washington
• RTHRegional Telecommunication Hub, e.g., Vienna, Cairo, …
• RTH on MTNRTH on Main Telecommunication Network, e.g., New Delhi, Tokyo, Washington, …
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 10 -
WMO Information System (WIS)
World Data Centres (WDC)• WDC for Meteorology, Asheville• WDC for Meteorology, Obninsk • WDC for Meteorology, Beijing • WDC for Climate, Hamburg• WMO WDC for Ozone and Ultraviolet Radiation • WMO WDC for Greenhouse Gases • WMO WDC for Aerosols • WMO World Radiation Centre• WMO WDC for Aerosol Optical Depth • WMO WDC for Precipitation Chemistry • WMO Global Runoff Data Centre• ...
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 11 -
WMO Information System (WIS)
TRENDS IN INFORMATION REQUIREMENTS
Increasing data volumes from remote sensing systems
Source: Dr Geoff Love, President of CBS, 2001
27.September.2005 WMO Metadata Workshop - 12 -
WMO Information System (WIS)
TRENDS IN INFORMATION REQUIREMENTS
Increasing data volumes from numerical weather prediction systems
Source: Dr Geoff Love, President of CBS, 2001
27.September.2005 WMO Metadata Workshop - 13 -
WMO Information System (WIS)
TRENDS IN INFORMATION REQUIREMENTS
The need to integrate different data sets (eg. Data from the GAW network with those from the GOS)
Source: Dr Geoff Love, President of CBS, 2001
27.September.2005 WMO Metadata Workshop - 14 -
WMO Information System (WIS)
TRENDS IN INFORMATION TECHNOLOGIES
Exponential growth of the Internet - including global penetration
Source: Internet Software Consortium (http://www.isc.org/) , 2003
27.September.2005 WMO Metadata Workshop - 15 -
WMO Information System (WIS)
TRENDS IN INFORMATION TECHNOLOGY
The opportunity is to take these new technologies and build a logically separate Future WMO Information System (FWIS), using the Internet, which meets the requirements of all WMO programmes for the exchange of meteorological and related data.
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 16 -
WMO Information System (WIS)WMO Congress XIV (2003)
“The multiplicity of systems of the different Programmes
causes incompatibilities, inefficiencies, duplication of
efforts and higher overall costs.”
Congress approved the concept of FWIS, which will
provide a single coordinated global infrastructure for
the collection and sharing of information in support of all
WMO and related international programmes.
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 17 -
WMO Information System (WIS)
Inter-Programme Task Team on FWIS
• Created in 1998 by CBS-Ext(98), Karlsruhe (Germany)
• Melbourne (Australia), 1-5 Nov. 1999
• Monterey, CA (USA), 28 Aug. - 1 Sep.2000
• Langen (Germany), 25-29 Jun. 2001
• Johannesburg (South Africa), 23-27 Sep. 2002
• Kuala Lumpur (Malaysia), 20-24 Oct. 2003
• Geneva (Switzerland), 22-24 Sep. 2004
Result: Concept, pilot projectsDieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 18 -
WMO Information System (WIS)Cross-programme requirements for
FWIS• Widely available and electronic (on-line) metadata and data
catalogues of all relevant data required by the WMO
Programmes
• Harmonisation of data formats, transmission standards,
archiving and distribution mechanisms to better support inter-
disciplinary use of data and products.
• Standard practices for the collection, electronic archival and
exchange of metadata, both high-level and detailed, especially
for stations and instruments.Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 19 -
WMO Information System (WIS)
Technical requirements Routine collection and automated dissemination of all
observed data and products (”push”) according to requirements.
Ad-hoc requests for data and products (”pull”)
FWIS should be reliable, cost-effective, modular, scalable, and flexible to support:
Different user groups
Various data policies, such as WMO Res. 40 and 25 Data as well as network security Integration of diverse datasets
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 20 -
WMO Information System (WIS)
Virtual structure of FWIS
• National Centres (NC)• Global Information System Centres (GISC)• Data Collection and Production Centres (DCPC)• Data communication network
The names of these virtual centres describe their functionality, not the actual organisational entities. There may be organisations, such as NMHSs, which combine all three virtual centres within one facility.
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 21 -
WMO Information System (WIS)
National Centre (NC)
• Collect national observations
• “Push” data intended for global dissemination to the associated GISC
• “Push” data intended for regional or specialised distribution to the associated DCPC
• Collect, generate and disseminate products for national use.
• Participate in monitoring the performance of the system
• Authorize their national users to access FWIS, as appropriate
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 22 -
WMO Information System (WIS)
Global Information System Centre (GISC)
• Receive observations intended for global exchange from NCs and DCPCs within
their area of responsibility
• Exchange information intended for global exchange with other GISCs
• Disseminate, within its area of responsibility, the data and products agreed by WMO
for global exchange
• Hold the data and products agreed for global exchange for at least 24 hours and
make it available via WMO request/reply (”Pull”) mechanisms
• Maintain, in accordance to the WMO standards, a catalogue of all data and products
for global exchange and provide access to this catalogue
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 23 -
WMO Information System (WIS)
Data Collection and Production Centre (DCPC)
• Receive information intended for dissemination to NCs within its area of responsibility (i.e. regional
collection)
• Collect programme-specific data and products
• Produce regional or specialized data and products
• “Push” information intended for global exchange to their associated GISC
• Disseminate information intended for regional exchange
• Support access to their products via request/reply (”Pull”) mechanism
• Maintain data and product catalogues in a WMO-agreed standard format and facilitate access to this
catalogue
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 24 -
WMO Information System (WIS)
Data communication network
The data communication network should:
• be based on an agreed technology available to the participating
centres
• be capable of handling the data volumes
• include satellite communication channels, terrestrial links and
managed data network services
• handle the agreed transmission protocols
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 26 -
WMO Information System (WIS)Information distribution
NationaldisseminationRequest/reply(Internet)
Nationalusers
Nationalusers
Routinedissemination(Internet, privatenetwork,satellite,etc.)
GISC
GISC
GISC
GISC
NC
NC
NC
NCNC
NC
NC NC
DCPC
DCPC
DCPC
DCPC
Various communicationnetworks
NationaldisseminationRequest/reply(Internet)
NationaldisseminationRequest/reply(Internet)
Nationalusers
Nationalusers
Routinedissemination(Internet, privatenetwork,satellite,etc.)
Routinedissemination(Internet, privatenetwork,satellite,etc.)
GISC
GISC
GISC
GISC
NC
NC
NC
NCNC
NC
NC NC
DCPC
DCPC
DCPC
DCPC
Various communicationnetworks
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 27 -
WMO Information System (WIS)
New features
• Common to all WMO programmes
• Supporting real and non-real time data sets
• Supporting “pull” and “push” mechanisms for all data
• Supporting various communication protocols for data
transmission
• Using different types of communication links as available and
appropriate, including GTS, satellites and Internet
• Using off-the-shelf hardware and software systems
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 28 -
WMO Information System (WIS)
FWIS design concepts
Dieter C. Schiessl, WMO, Feb 2004
, NC
27.September.2005 WMO Metadata Workshop - 29 -
WMO Information System (WIS)
Other relevant activities• EUMETNET UNIDART project
• development of a meteorological Web portal which will provide uniform access to meteorological data and products through the Internet using Grid services
• CliWare – Russian information system that allows authorized users to access hydro-
meteorological data and products over the Internet • Earth System Grid
– US project that enables management, discovery, distributed access, processing, & analysis of distributed terascale climate research data
• NCAR Community Data Portal • DMAC of IOOS
– US project to acquire and use ocean-related data
• NERC DataGrid– UK e-Science project for accessing environmental information
• RA-VI VGISC project• WIS VPN Pilot Project in RAs II and V
Dieter R.Sanek, 2005
27.September.2005 WMO Metadata Workshop - 30 -
WMO Information System (WIS)
Impact on and benefits for WMO• FWIS concerns only telecommunication and data management
functions of the WMO and does not affect the data processing components of any WMO Programme.
• Provision of data and products on the basis of request/reply services would likely be the most significant addition.
• Programmes would benefit from the services offered by FWIS for the implementation of their data exchange tasks.
• For individual users, either a person or an institution, FWIS would provide a single entry point for any data request, be it on a routine basis by dissemination of certain user defined information sets or on an ad-hoc basis for a special data set.
• By making use of off the shelf technologies of a lower cost, FWIS would allow least developed Members, for the first time, to actively participate in the WMO Programmes, specifically the WWW.
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 31 -
WMO Information System (WIS)
How could FWIS be constructed?
• A GISC is a new development (metadata directories, etc.)
• The NC and DCPC basically already exist and add interfaces for
new services
• A pilot project for GISC development is the RA-VI VGISC project
• Development of more GISC’s projects, e.g. RA-II project
• Workshop in conjunction with CBS-Ext(06)
• Trials of inter-GISC communication after 2006
• Phased implementation of FWIS from 2008 onwards Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 32 -
WMO Information System (WIS)
RA-VI VGISC Project
• In 2001, RA-VI decided to create a project for the development of a prototype GISC.
• The NMSs of France, Germany and the UK have volunteered to jointly design and implement a virtual GISC (VGISC) shared by their Services and to include the ECMWF and EUMETSAT as DCPCs into the concept, funded partially as EU project SIMDAT.
• A proof-of-concept system was demonstrated during CBS XIII.
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 33 -
WMO Information System (WIS)
VGISC Project OverviewSteering Group
(Geerd Hoffmann, DWD)
2005 (beginning)
2001
2006 (mid)
2008 (end)
VGISC-SIMDAT
VGISC-Definition and -Prototype
VGISC-Operations
27.September.2005 WMO Metadata Workshop - 34 -
WMO Information System (WIS)
VGISC Working Groups
• Data Policy (Francois Duvernet, Meteo France)• Data Management (Steve Foreman, UK Met)• Data Acquisition and Dissemination (H. Knottenberg, DWD)• Communication (Hans Janßen, DWD)
27.September.2005 WMO Metadata Workshop - 35 -
WMO Information System (WIS)
“Pull” request handling
data flow
control flow
local data sourcelocal production
tools
production controltranslator
data controltranslator
localinstruction(for ownproductiontools)
Production(NC/DCPC)
atomiccatalogue
productcatalogue
product instancecatalogue
distribution catalog.
customer orders
Metadata-pool
GISC-node
distribution tool (push)
monitoring tool
synchronisation tool
definition demon or-webservice
Web-Browser
Client
distribution demon or-webservice (pull)
GISCproduct instance
pool localinstruction(searching foratoms inown database )
global instructions(for data searching and production)
Tools and frontend-Server(adminstration- andcoordination centre)
Internet Portal(web frontend)
Local data pool(s)
27.September.2005 WMO Metadata Workshop - 36 -
WMO Information System (WIS)
“Push” distribution
atomiccatalogue
productcatalogue
product instancecatalogue
distribution catalog.
customer orders
Metadata-pool
GISC-node
monitoring tool
synchronisation tool
definition demon or-webservice
Client
distribution demon or-webservice (pull)
GISCproduct instance
pool
data flow
control flow
distribution tool (push)
Internet Portal(web frontend)
Tools and frontend-Server(adminstration- andcoordination centre)
Local data pool(s)
- 37 -
WMO Information System (WIS)
• DWD: Portal
• DWD: Push/Pull System
• DWD: Access to climate time-series data (UNIDART-Project)
• UK Met Office: XML Metadata / - Data Prototype (Description only)
• ECMWF: Model Analyses
• EUMETSAT: Access to EUMETCast Dissemination
• NCAR: Model Analyses
CBS 2005 GISC Prototype
- 38 -
WMO Information System (WIS)
Installation at the CBS XIII in Saint Petersburg
EUMETCast
Receiver
Ninjo
Server
MSG
Server
ClientClient
DVB
Broadcast
Hotel wireless LANInternet
Ninjo
Client
VGISC
Dissemination
Interactive
LAN
Provided by EUMETSAT (Exhibition Hall)
27.September.2005 WMO Metadata Workshop - 39 -
WMO Information System (WIS)
27.September.2005 WMO Metadata Workshop - 40 -
WMO Information System (WIS)
SIMDAT
Data Grids for Process and Product Development using Numerical Simulation and Knowledge Discovery
www.simdat.org
funded by the European Commission
General
27.September.2005 WMO Metadata Workshop - 41 -
WMO Information System (WIS)
Application Activities
Four sectors of international economic importance:
Automotive
Pharmaceutical
Aerospace
Meteorology
Technology Activities
Seven Grid-technology development areas:
Grid infrastructure
Distributed Data Access
VO Administration
Workflows
Ontologies
Analysis Services
Knowledge Services
SIMDAT Application and Technology
27.September.2005 WMO Metadata Workshop - 42 -
WMO Information System (WIS)
SIMDAT Conceptual View
27.September.2005 WMO Metadata Workshop - 43 -
WMO Information System (WIS)
VGISC-SIMDAT Working Groups
• Project Manager: Matteo dell’ Aqua, ECWMF
• Virtual Organisations (Lothar Wolf, EUMETSAT)• Ontology (Jeremy Tandy, UK Met Office)• Distributed Data (Jacques Roumilhac, Meteo France)• Grid Infrastructure (Hans Janßen, DWD)
27.September.2005 WMO Metadata Workshop - 44 -
WMO Information System (WIS)
SIMDAT VGISC structure
VGISC
Logo
- 45 -
WMO Information System (WIS)
To be presented to EU-Commission in November 2005:
• VGISC-Nodes at the contributing sites
• DWD: Access to climate time-series data
• UK Met Office: XML Metadata / - Data Prototype
• Meteo France: Model Output
• ECMWF: Model Analyses
• ECMWF: Observational Data (One Sample Day)
SIMDAT Demonstrator
27.September.2005 WMO Metadata Workshop - 46 -
WMO Information System (WIS)
WIS VPN Pilot Project in RAs II and V
„CBS XIII was also very pleased to note the success of the first phase of the Virtual Private Network project in Regions II and V, and that the pilot project would be significantly expanded with additional components, including prototype applications, and more participating NMHSs in the years 2005-2006."
• Australia• Brunei• China• Hong Kong, China• India• Iran• Japan
• Macao, China• Oman• Republic of Korea• Malaysia• New Zealand• Saudi Arabia• Vietnam
Participants
27.September.2005 WMO Metadata Workshop - 47 -
WMO Information System (WIS)
WIS VPN Pilot Project in RAs II and V
Japan(Simulating DCPC)Vietnam
(Simulating NC)
India(Simulating NC)
Brunei(Simulating NC)
Korea(Simulating NC)
New Zealand(Simulating NC)
Malaysia(Simulating NC)
Saudi Arabia(Simulating NC)
Beijing(Simulating DCPC)
Australia(Simulating GISC)
Internet
Permanent or routine VPN link
Hong Kong, China(Simulating NC)
(Pattern A) Test for branch links among a GISC, DCPCs and NCs on routine basis
27.September.2005 WMO Metadata Workshop - 48 -
WMO Information System (WIS)
WIS VPN Pilot Project in RAs II and V
(Pattern B) Test for ad hoc request/reply between a portal site for data request and eachrequesting center or each data source center
Vietnam(Simulating NC)
India(Simulating NC)
Brunei(Simulating NC)
New Zealand(Simulating NC)
Malaysia(Simulating NC)
Saudi Arabia(Simulating NC)
Beijing(Simulating NC)
Korea(Simulating Data Source)
Hong Kong, China(Simulating Data Source)
Internet
Japan(Simulating Portal Site
for data request)
Occasional VPN connection
Occasional non-VPN connection
Australia(Simulating GISC)
27.September.2005 WMO Metadata Workshop - 49 -
WMO Information System (WIS)
Inter-Commission Coordination Group on FWIS(ICG-FWIS)
Created in 2004 by EC-LVI through Resolution 2.
Terms of reference:
• To coordinate the refinement and consolidation of the FWIS based on the approved concept and then the implementation planning phases;
• To assess in detail the data exchange and data management requirements of WMO Programmes, at present and for the foreseeable future, which should be met by the FWIS;
• To advise the technical commissions on the development in data-communications and management functions to be required in the FWIS as regards their respective programmes;
• To guide the orderly evolution of existing WMO information systems towards FWIS;
• To address the major issues that had been identified.
27.September.2005 WMO Metadata Workshop - 50 -
WMO Information System (WIS)
Inter-Commission Coordination Group on FWISICG-FWIS (First meeting in Geneva, 12-14 January 2005) recommended coordination
mechanisms for the FWIS development and future activities: Support of the proposed CBS Inter-Programme Expert Team on Metadata
Implementation, Expert Team on FWIS GISCs and DCPCs and Expert Team on FWIS/GTS Communication Techniques and Structure.
Strongly supported the establishment of TCs’ Expert Teams that are relevant to FWIS (data-management, metadata, XML, data-exchange) and their mutual cooperation and coordination for fostering consistent and rapid FWIS development
Metadata aspects are crucial for the FWIS development and should be quickly consolidated, full endorsement of the WMO Core Profile of the ISO Metadata Standard.
Recommendation for organizing a inter-programme workshop on metadata, jointly with CBS/IPET-Metadata, by September 2005 and a workshop on GISC development, jointly with CBS/ET-GISC&DCPC (1 Q 2006)
Importance of the development of new Programme’s pilot projects to promote an early introduction of FWIS elements
Recommendation to rename FWIS as WIS (WMO Information System)
27.September.2005 WMO Metadata Workshop - 51 -
WMO Information System (WIS)
Summary• The WIS would be used for the collection and sharing of information for
all WMO and related international programmes. • The WIS vision provides a common roadmap to guide the orderly
evolution of the information system functions performed by current WMO Programmes into an integrated system that meets efficiently all of the requirements of Members for the relevant international environmental information.
• The support and involvement of regional associations and technical commissions is needed, as early as possible, in all phases of the WIS development in order to ensure a full and shared ownership of the project, and its effective implementation.
• There should be a workshop on WIS in conjunction with CBS-Ext(06) • The implementation of WIS needs to be done in a phased approach in
order to support the IPY (International Polar Year 2007/2008) and THORPEX.
Dieter C. Schiessl, WMO, Feb 2004
27.September.2005 WMO Metadata Workshop - 52 -
WMO Information System (WIS)
The Metadata are the “Core”
27.September.2005 WMO Metadata Workshop - 53 -
WMO Information System (WIS)
Thank you for your attention !
27.September.2005 WMO Metadata Workshop - 54 -
WMO Information System (WIS)