http:// godae august 2007 contribution from f. blanc for igst, august 2007 strong understanding of...

GODAE August 2007Contribution from F. Blancfor IGST, August 2007

http://www.GODAE.org

• Strong Understanding of systems (homogeneous description, primary product viewing), Opendap/Thredds delivery technology together with NetCDF/CF (a GODAE standard) lot of good tools available and underwork for data access

• Weak ocean catalogues of reference user guidance operationality & quality proof user feedback analysis volume handling on internet education on data management issues

Report on Product & Data servers Strengths & Weaknesses



Catalogue

Embedded GODAE catalogues (// Seadatanet): systems – products – services

(action 27 done template for catalogue of systems)

Master ocean data cataloguesIdentified firstPush interdependenciesRecord product (inventory level)

into relevant master catalogue

Report on Product & Data servers Outcome 1

Collaborative Environment

SEADATANET GCMD

EO Portal



Spatial Representation

Metadata Contact

Data Identification Info

Content Information

Extension Information

Portrayal Catalog Info

Application Schema Info

Metadata Constraints

Metadata Maintenance

Distribution Info

Reference System

Data Quality InfoMetadata

Online Source

Responsible Party

Citation

Required

Conditionalor Optional

LanguageCharacter SetHierarchyStandard Name,Version Date

ISO 19115Organization



Data server report

Do we want to revise report format ?

Report made available on the public web (‘cms’ format prefered)

KPI ? (action 28)




What do we want to know ?What we know !

• KPI stands for Key Performance Indicators.

The main goal of the KPIs is the provision of needed information to measure & evidence the end to end performance of GODAE.

KPIs are Quantifiable, Synthetic, Accurate,

Targeted.

Among others, KPIs are also good tools to point out strengths and weaknesses.

Following on KPI action



What do we want to know ? What we know !

• 3 profiles of KPI users:

– the GODAE Board to report to the GODAE Patrons on feasibility & utility

– the GODAE Operators to report on implementation & usefulness,

– the GODAE Users to ensure that products are visible, accessible and useable, and have feedback on products use and needs





• 3 key issues identified so far:

– KP1: Quality of organisation (& efficiency)“Do the systems do what they say they will do?”

– KP2: Quality of production (& consistency) “Have the productions reached the operational and qualified level?”

– KP3: Use performance “How well the products meet user needs?”





KP1: Quality of organisation (& efficiency)Where are we in implementation?

Number of regional and global demonstrationsClear visibility & understanding of systemsHow many systems are operational or suited for reanalysis?Can we evaluate the gain in implementation (faster or delayed)?Long-term technical coordination solutions?Other?

Commitment of systems to the data sharing plan?MetadataVocabularyFormatAccess ToolsReference fields




KP1: Quality of organisation (& efficiency)Has this ease product access?

Availability of productsConfidence in productsAny integrated application ….Other ?

For what they are used?Countries & visitors (evolution curve)Range of applications, and number per yearRange of services (ocean catalogues, operational applications)






KP2: Quality of production (& consistency)How far in operationality?

System status clear(research & development, reanalysis mode, demonstration, pre-operational, operational, stopped)

Dissemination/accessibility status clear(production OK, dissemination OK, timeliness, be it for real time or historical data, services failure)

Track of changes and key data streams clear (cf. synchronised observations)Long term issues (time series context & consistency)

Back-up scenario





KP2: Quality of production (& consistency)How far in qualification?

(report with a qualification status, may depend on system type - reanalysis, operational forecast, observations -)

agreement on metrics productsproduction set uproutine production

How is shown qualification?Report with a qualification status

(research & development, periodic/operational assessment)Qualification data (random or regular validation report, ocean

resolution achieved, forecast skill computation, model errors)Dissemination & availability of the qualification indication





KP2: Quality of production (& consistency) Is the products well defined & described

(coherent and meaningful)? Use of common vocabularyCoherency in system descriptionGuidance for accessGuidance for useGuidance for qualification





KP3: Use performanceHow the user is aware of products?

(visibility of key data streams) In GoogleFederated cataloguesList of available systems (with user guidance)List of products servers (with user guidance)List of integrated services (with user guidance)

How simple to access the products? (effective distributed dissemination system)

Registration process Interoperable use (pull) versus push systemAdvanced tools (extractors) Internet capacityDistribution services capacity (volume/needs)





KP3: Use performanceHow they are used?

Datasets usedParameters selectedSpace and time windowHow oftenPreferred services (catalogue, access, advanced tools)

Any user feedback? Is the product well understood?

Strengths and drawbacks, ComplaintsShowcases and age of showcaseNumber of distributed working group and size of the groupNumber of projects or collaborations liaised to GODAEBenefit? Other ?




Data server report

Do we want to revise report format ?

Report made available on the public web (‘cms’ format prefered)

KPI ?


Does GODAE need a quantitative measurement system ?

What indicator is worth to be maintained and monitored in time?

Is the context, clear enough to get coherent & useful indicators ?



OGC standards (action 30)

See Keith Haines & Jon Blower paper

– Web Coverage Service (WCS) Opendap serve gridded data in continuous “coverages”

– Web Map Service (WMS): serve 2D Geospatial maps for GIS applications.

– Web Feature Service (WFS): to serve Geospatial feature data like terrestrial limits, river positions, ARGO float locations, satellite/ship track.


Oil spill detection processor

ERS SAR online data access

Ship detection processor

ERS SAR online data access

ERS SAR catalogue

Envisat ASAR catalogue

RadarSat catalogue

Wave height & direction model



Application cases

– DEWS (UKMO), ATOLL-MOTU (CLS) serve NetCDF data

– Godiva2, Argonautica serve Google Maps

What’s next ?

– Cf. presentation (Stefano Nativi, [email protected])




A common interoperability architecture

• A service view– Data Observation & Measurement services– Data Storage, Management & Processing services– Data Inventory & Access services– Data Discovery & Query services– Data Browsing and Evaluation Services– Data Portrayal and Visualization services– Data Download services– Data Security services

SOCIETY

INFRASTRUCTURES,

PLATFORMS

and SYSTEMS



The GI community architecture

Data Inventory, Access &

Download Services

CS-W

(ISO profiles)

WFS

WMS

Data

Visualization

Services

WCS

Data Access & Inventory Tiers Data Presentation Tier

SHP

GeoTIFF

Others...

..

netCDF

Data Tier

Data storage. Management &

processing Services

Viewservices

WMS

Viewservices

ISO GF

DataModel

ISO 1911519119

(Profiles)

Data Catalog Tier

Data discovery

& query

Services



The netCDF-Community architecture

Data storage. Management &

processing Services

THREDDS

Data

Server

HTTP

OPeNDAP

Data

Visualization

Services

WCS

Data Presentation Tier

GRIB

HDF

Others...

..

netCDF

NetCDF &the

Common DataModel

Data Tier

Data Access & Inventory Tiers

Data Inventory, Access &

Download Services

19115

ISO profiles

DatasetInventoryCatalogModel



GRIB

HDF

Others...

..

netCDF

Data Access & Inv. Tiers Data Presentation TierData Tier

THREDDS

Catalog

Service

HTTP

OPeNDAP

WCS

SHP

GeoTIFF

Others...

..

netCDF

WFS

WMS

WCS

Viewservices

WMS

Viewservices

Mediation &

Brokering

service

NetCDF &the

Common DataModel

ISO GF

DataModel

Data Catalog Tiers

CS-W (ISO

profile)

CDI service

Other ISOCompliantservices

ISO 19115ISO 19119

ProfileModels

DatasetInventoryCatalogModel



Data model harmonization

ISO 19123Data Model

netCDFData Model

CFMetadata

Data Models Mediation

GISInformationCommunity

Earth SciencesInformationCommunity

ncML-GML

Encoding Model

ncML-GML

Encoding ModelncML

EncodingModel

ncMLEncoding

Model

GML 3.xEncoding

Model

GML 3.xEncoding

Model



ncML-GML

• Mediation Markup Language• An extension of ncML (netCDF Markup Language) based on GML

(Geography Markup Language) grammar



And now merging possible with other type of data



GIS service for system assessment ?


http:// godae august 2007 contribution from f. blanc for igst, august 2007 strong understanding of...

Documents

performance of godae

godae users

godae operators

godae patrons

godae board

kpi action slide

data server report

data management issues