marine core service my ocean wp 15 thematic & assemby center for in situ

MarineCore

Service

MY OCEAN

WP 15Thematic & Assemby

Center for In Situ

Marine Core Service

MyOcean : Second Annual Meeting / 27-28 April 2011 / Roma

Reminder -

Partnership

Marine Core Service


15.1

15.3

15.415.5

15.2

MyOcean in-situ TAC tasks

Define common distribution means: vocabularies, formats, organization, monitoring tools,…

Develop a reliable distributed architecture for in-situ data delivery to MFCs and MyOcean users

Converge on common real time quality control procedures and flag conventions Converge on Real –tIme QC methods for physical variables in coherence with international

standards Develop methods for Quality Control of biogeochemical data both in real time and delayed

mode and provide recommendations for acquisition of biogeochemical data from various platforms

Enhance the T&S basin scale assessment methods for global ocean and adapt them to regional scales, if possible

Turn to operations enhanced calibration/validation methods

Coordinate at European Level with EuroGOOS and SeaDataNet, and with JCOMM observing program(as Argo, OceanSites,Gosud, DBCP,..)

Marine Core Service


R&D : main achievements

Main achievements are The near real-time Quality control procedures developed for T&S,

sea level and current have been endorsed by EuroGoos and passed by SeaDataNet to IOC

Similar NRT QC procedure has been developed for Biogeochemical data ( mainly Chlorophyll/Fluorescence and Oxygen) and have been deployed in the INS TAC centers

Validation procedures have been defined at regional scale

Main difficulties Develop methods that can be extended to EuroGoos and

SeaDataNet

Remaining activities/objectives Develop KPI to monitor the INS TAC product quality for internal

and later external use

Marine Core Service


Dev. & Maintenance

Objectives Define an set up a distributed but reliable architecture for in situ data integration for operational oceanography

Steps VO : 4 global products available from global component operated by

Coriolis V1: 6 regional + a global portals set up distributing 2+14 additional

Real-Time products V2 : Regional and Global portals enhanced with 7 scientifically

analyzed T&S product for reanalysis purposes (1990-2010)

V1 step up in 3 steps Stream1/Stream2 November 2009- April 2010 : Data integration and distribution set up March 2010- June 2010 /December 2010: Common real-time QC

procedures applied in Stream1/Stream2 regions September 2010-March 2011/ March-August 2011 : Scientific

product assessment performed in Stream1/Stream2 regions

Marine Core Service


Dev. & Maint. : main achievements

Main achievements are The 12 PU and 7 DU have been set up and tested ( SIVP) The NRT QC procedures have been deployed in all regions The stream1 components has set up a first version of Validation/

Assessment of T&S product The Oceanotron software that replaces OPEnDAP for insitu has

been developed and deployed. Connection to MISGW is specified and should be available for V2 as well as WMS service for in situ

Main difficulties Ins-Tac is highly distributed The MyOcean tools need evolutions to handle in situ products

Remaining tasks Implement KPI

Marine Core Service


Reminder - Objectives for Production

Objectives, Products, Difficulties, … Set up the regional , EU and global portals that would integrate , in

a sustained manner, enough data to significantly ease the MFC and MyOcean users activities and have a real added value for the regions

Be able to operate this distributed infrastructure in a coherent and reliable way

Be able to turn to operation the methods defined in R&D

1

2

6

4

75

3

Marine Core Service


Production : main achievements

Main achievements are In all regions the link with data providers have been established and good

collaboration with EuroGOOS ROOSes set up the data are integrated in regional and global portals and used by some MFCs More providers are interested to contribute The service organization has been set up , and stream1 proved that the

escalation process described in SIOPM was efficient

Main difficulties In the Global component the DU was harder to set up than planned because

of the number of platforms and time needed to update the portal In NSW and Baltic regions the organization of the responsibilities has been

revisited to secure operations In some regions like Black sea there is very few real time observations

Remaining objectives Set up an efficient monitoring of the production and alert system Elaborate T&S re-analyzed product for reanalysis activities

Marine Core Service


Monitoring platform availability per day

Global Component ≈ 2100 platforms per day:1250drifters , 30vessels, 300 floats,350 moorings ≈150 platforms from GTS

Integrates Global Networks and Regional observations acquired in the In situ Tac components

Jan

11

Mar

11

Marine Core Service


Monitoring platform availability per day at PU level also

4 ferrybox lines acquired routinely by Niva PU and integrated in Global Du

Marine Core Service



NWS Component ≈ 140 platforms per day: 70 moorings , 60 drifters, <10 profilers, 1

vessel , some GTS data

Baltic Component :≈ 90 platforms per day 90 moorings , 2 vessels

Marine Core Service



Med Component :≈ 100 platforms per day 24 drifters , 35-50 moorings, up to 8 vessels,

≈10-15 floats,

Arctic Component :≈ 120 platforms per day80 drifters , 3-8 vessels, ≈10-15 floats, ≈10-20

platforms from GTS

Marine Core Service



Black sea Component 1 mooring 1 float , sometimes one drifter and one vessel

IBI Component ≈ 250 platforms per day:100drifters , 5-9vessels, 15floats,120 moorings ,<10 platforms from GTS

Marine Core Service


Service to Users

117 registered users for INS TAC ( 6 products in the catalogue)

378 product requested

Marine Core Service


Service to Users

Increase in request for Global products Regional products start to be requested (Arctic, Med)

since V1 launch

Marine Core Service


Production: T&S regional re-analysed products Covers 1990-2010

Best values of T&S data available to be used for assimilation and/or validation depending of the regions

Contains data that have been through Delay Mode scientific assessment plus real time data scientifically assessed ( flagged but not corrected) within the INS TAC– Exhaustivity in term of data ( more and not less than WOD09, should

include national cruises)– Better quality than WOD09– Scientific assessment documented– Provide Information on the accuracy of the data better with the data but

can be in the documentation

It's a Myocean product presently planned to be on the catalogue: – follow MyOcean data policy : freely available to registered users– Can be complemented by restricted access data for MyOcean MFCs only

Marine Core Service


Production: Potential risk for T&S regional re-analysed product

SDN and MYO want to collaborate on building product for re-analysis but further work is needed to better specify the needs and speak the same language

The timing of the 2 projects doesn't fit : SDNI is finished, SDNII is in negotiation phase and KO is foreseen for end 2011, MYO-V2 is end 2011

The "Best product " from SDN to MyO described in the MoU has not been developed in SDNI.

– Presently the only regional aggregated T&S datasets that exist from SDN are the ones used for building the regional climatology but they are restricted access as they merge public data with restricted data. At the best they can provided as internal product for MFCs

What can be done for MYOI ?– Set up the mechanisms to be able to integrate the SDN products when available and Trace

the access to the datasets provided by SDN and provide feedback to SDN. This will be possible when the connection to MISGW is fully implemented for INS-TAC

– Provide the regional aggregated T&S datasets build for climatology by SDN to MyOcean MFCs ONLY if SDN agrees to provide them

– Start building prototype of regional T&S data for MYO users• A lot of T&S European data are presently available freely at US-NODC or ICES and

some of them are included in the V1 Global T&S Re-analyzed product

• Some INS-TAC partners , also involved in SDN, can provide their institution data to start building the MyOI products as a temporary solution waiting for SDNII

Marine Core Service


Reminder - Objectives for Cal / Val

Objectives Assess scientifically the quality of the products using the methods

develop in R&D

Process different for real time products and re-analyzed products

Difficulties The amount of data available in an area to do perform consistency

checks at basin scale Based in most regions on Visual QC by an operator and test against

Climatology ( plan to rely on SeaDataNet form enhanced regional climatology in Europe)

Steps First work on T&S parameters as they are assimilated in MFCs Second on current, sea level and biogeochemical data used for

validation by MFCs

Marine Core Service


Cal/Val : main achievements

Main achievements are T&S stream 1 products have been validated and system is in place for

quarterly assessment T&S global re-analyzed product assessment has been performed

using both statistical methods and visual assessment by a scientist Validation process has been defined for all the V1 products and

mainly rely on visual QC because data are to sparse

Main difficulties For some data such as sea level it's difficult to do better than provider.

INS-TAC is than essentially an integrator of observations For biogeochemical data biofouling is an issue that may sometimes

difficult to detect in RT. Consistency between parameters will be used whenever possible to

at list detect outliers. Remaining tasks

Finalize the Product Quality KPI that will provide a traffic light view of the INS-TAC product quality taking into account the amount of platform versus expected, the delay between the date of the data and first delivery by INS TAC, the amount of bad/suspicious data versus good ones

Marine Core Service


Organizational Challenges– Converge from different history on data sharing to common practices– Convince outside & national data providers

Technical Challenges– Lack of on the shelves data model standards and OGC services for

sparse datasets

Operational Challenges– Guaranty operational services on a distributed architecture– Manage to elaborate re-analyzed T&S products for re-analysis at

Global and regional scale for internal AND external users in collaboration with SeaDataNet, EuroGOOS for European data resolving the data policy issues

Ultimate Challenges …– The quality of the in situ product will depend on the availability and

sustainability of the in-situ observing systems that presently are mostly funded on research funds

Main Challenges

Marine Core Service


Past (event, work or tasks achieved) :– September 2009 : Start of monthly phone meetings to better steer the INS-TAC activities– October 2009 : in situ portal specifications approved and presented at EuroGOOS annual

meeting– December 2009-April 2010-April 2011: Plenary WP15 meetings– January 2010 : SeaDataNet-MyOcean MoU signed– February 2010: T&S real-time QC procedure approved and provided to SeaDataNet– March 2010-April 2010 : all INS-TAC portals are up and distributed products in prototype

mode– June 2010 : RTQC procedures implemented for Stream 1- Assessment procedure defined– Autumn 2010 : Assessment procedure implemented for Stream 1- RTQC procedures

implemented for stream2– October 2010 MyOcean RTQC procedures endorsed by EuroGOOS– Summer –Autumn 2010: Service organization defined for INS TAC, and mandatory ITIL

processes in place– December 2010 : Start of V1 service for stream1 products– March 2011 : RTQC procedures sent to IOC by SDN for proposal as a standard

Future :

– June 2011: Start of V1 service for stream2 products– Summer 2011: set up of quality KPI– Summer 2011: Elaboration of V2 products in partnership with SDN ( even if SDNI finished and

SDNII not started…)– December 2011: Start of V2 products

Calendar

Marine Core Service


Some illustrations…

January 2010

Marine Core Service



Gliders

FerryBox

Moorings

April 2011

Marine Core Service



marine core service my ocean wp 15 thematic & assemby center for in situ

Documents