ESA Report to DAI/IPR WG

Gian Maria Pinna

DAI/IPR meeting

Toulouse

2-5 November 2004

Products

Metadata

GFE

MUIS Orders

DataProducers

InteractiveUser Services

MasterCatalogue

Metadata

Products

Outputproducts

PFD

Orders

Production Orders

AMS

POHProcessors

Browses

MUIS

Browses

DataConsumers

CENTRAL INFRASTRUCTURE

Multi-Mission Facility Infrastructure

QC

MMOHS

Products

Statuses

SS

E

MMFI Elements

MMFI Deployment

• MultiMission Facility Infrastructure deployment is on-going

• Tape robotics installation completed in the 6 centres– STK Powderhorn 9310, with 2000 slots (400TB each, max 1.2 PB)

– STK L700e, with ~700 slots (140TB)

• 8 TB NAS for data storage on line, accessed via AMS, and MMFI central data cache

• Fast disk arrays for AMASS cache (~1.2 TB) extensive testing, presently under deployment at remote facilities

• Documentation under completion (ADD, ICD, Technical Baseline Description)

HARM(Historical Archive Rationalization and Management)

• Transcription HW&SW from old media (D1, DLT) to AMS (StorageTek T9940B based)

• Orbits stitching (reducing overlap between acquisition stations)

• Rationalization in thematic archives

• SAFE (Standard Archive Format for Europe)– Based on previous experiences (Wilma, CEOS ICF, Cryosat)

– XML metadata

– Self-descriptive

– Pointers to binary data structures

– Draft 1.3 available for review (see SB’s presentation)

– Efforts for XFDU compatibility

• Transcription of data on the AMS in original format started

FEOMI(Facility Evolution into an Open Multimission Infrastructure)

• Contract awarded and project started (KO: September, 9th)

• Porting of Envisat, ERS and TPM ground segments to MMFI

• Upgrade of mission specific elements to interface with MMFI

• Phase out of mission specific elements where same functionality can be ensured by MMFI elements

• Will bring to operations costs reduction starting from 2006

• Phase 1 (User/System Requirements, AD) to be completed by end January 2005

Network rationalization and upgrade(LAN, WAN)

• Production LAN upgrades to Gbit under completion at all centres

• Networking our facilities with 34+ Mbps links via European academic network

• To be used for data circulation inside ground segments• Also to be used to ensure better service to users for

access to products on-line (automatic and transparent re-routing)

New EO Missions

• In line with Oxygen, all new EO missions will rely at various levels on the MMFI architecture and components– GOCE LTA development started

– AEOLUS and SMOS LTA development to be started

– SENTINEL missions concept under finalisation. Based on MMFI

– New processing systems under development will have MMFI interface (e.g. new Linux-based Envisat processors)

GOCE LTA Architecture

MUS

LTAREPROCESSOR

MMFIPDS

GFE

GOCE LTA

PFD

POH

MMOHSdistribution

request

retrievaldirective

distributionexecution

LTAEXPORT

ReprocessedProducts

PDSProducts

& Support Files

Products& Support Files

Inventory Info

download file

Inventory Synch

End User Product

USERS

DataManager

HPF

CMF

browsing

AMS

distribution requestDistribution

directive

SDF

IPF #1LEVEL 0

AUX DATAFILES

LEVEL 1b

IPF-THINLAYER

LEVEL 1BSCIENCE

PROCESSOR(s)

ORDERMANAGER

REPROMANAGER

IPF #2LEVEL 0

AUX DATAFILES

LEVEL 1b

IPF-THINLAYER

LEVEL 1BSCIENCE

PROCESSOR(s)

reprocessingcommand

FTP

LE

VE

L 1b

LocalCatalogue

CatalogueBrowser

Products

Products

MMMC

Catalogue updates

PV -2004

• “Ensuring the Long-Term Preservation and Adding Value to the Scientific and Technical Data”– 5-7 October in ESRIN– 37 papers– 80+ registered participants

Future PVs?

• Lessons learnt– Parallel big workshop (IAC) in Vancouver– Similar conference (CODATA) one month later– CODATA meets every two years– Suggestion to make PV a regular venue on

alternate years with CODATA

• Previous contacts with DLR to host PV-2005. Unfortunately they declined

• Looking for volunteering organizations