mission exploitation platform proba-v · 02/06/2016 · mission exploitation platform proba-v...
TRANSCRIPT
MISSION EXPLOITATION PLATFORM
PROBA-V
ERWIN GOOR, VITO
VITO – COMPANY PROFILE
VITO - Flemish Institute for Technological Research, Belgium
750 employees, 26 nationalities, 140 mio€ turnover in 2014
Remote Sensing unit: 80+ employees
2 June, 2016 3
Energy Materials Chemistry
Health Land use
VITO REMOTE SENSING PRODUCTS AND SOLUTIONS
2 June, 2016 4
Infrastructure
+150 Tbytes/year
PROBA-V User Segment (incl. SPOT-VEGETATION, METOP-AVHRR S10, …)
htt
p:/
/pro
ba-v
.vgt.
vit
o.b
e/
htt
p:/
/w
ww
.vit
o-e
odata
.be/
PROBA-V MEP CONCEPT
02 June 2016 8
Bring the users to the data by offering a platform with
» complete archive of PROBA-V & SPOT-VEGETATION
& derived products from PV_MEP users
& HR EO/reference data to support Cal/Val activities on the platform
» Scalable ICT resources (private cloud) & processing middleware (Hadoop)
» Users develop applications & can offer this as on-demand service
» A growing set of tools & software from various contributors
» Documentation & collaborative tools
» User support
Develop Operate Support users
DATA MANAGEMENT
11 January 2016 9
Product Distribution Facility www.vito-eodata.be
PROBA-V (Oct 2013-present) SPOT-VEGETATION (1998-2014)
Tapes
Data Manager (download & cache data)
Sentinel
Data Hub
Landsat
Meteo
data
Copernicus
Global Land Service
… ??? …
MEP Applications
3rd-party data providers / users
Derived
products
Permanent
Archive
User
storage
(NFS) link to
Archive
Focus on standardisation
THE APPLICATIONS (JAN ‘16)
02 June 2016 10
proba-v-mep.esa.int
GEOVIEWER
» Screenshots
» Ook overlay
» !!! Duidelijk ook WCS tonen Andrea gevraagd dat je hier een data extract kan downloaden in
format & clipping naar wens
02 June 2016 12
TIME SERIES VIEWER
Quickly explore & review satellite time series and complementary indicators for
environmental monitoring
02 June 2016 13
TIME SERIES VIEWER
02 June 2016 14
Coming soon …
On-the-fly calculations for pixels & user-defined polygons
Web service interface
TSVIEWER VIDEO
2 June, 2016 15
N-DAILY COMPOSITOR
First example of pre-defined on-demand processing service
02 June 2016 17
N-DAILY COMPOSITOR - ROADMAP
N-daily compositor is a ‘first’ pre-defined on-demand processing service
more operational services can be shaped with users/partners/…
02 June 2016 18
PRE-DEFINED ON-DEMAND PROCESSING SERVICE
CLOUD TOOLBOX
» ESA RSS Cloud Toolbox, enriched with a set of tools:
» Support for Python & R
» GDAL ‘upgrade’ – GRASS GIS
» SNAP ‘Sentinel Application Platform’ - Sentinel 3 toolbox
» QGIS
» R studio, PROBA-V Product Customisation Tool
» And PROBA-V sample data
» March ‘15 till October ‘15 over Europe – All collections (L1C, 1 km, 300 m, 100 m)
» Graphical environment which can be launched with VNC, i.e. from Windows.
» Request via ESA RSS Cloud Toolbox service - http://eogrid.esrin.esa.int/cloudtoolbox/
02 June 2016 19
CLOUD TOOLBOX
02 June 2016 20
CLOUD TOOLBOX - ROADMAP
» Jan 2016
» Sample PROBA-V data & pre-installed tools
» Cloud Toolbox runs on a public cloud
Suited for e.g. RS students image correction, classification, interpretation, statistics, …
Try it & provide us your feedback on missing tools, …
» Autumn 2016
» Cloud Toolbox runs at VITO private cloud with access to full PROBA-V data archive
» + processing libraries, to be integrated in user-developed applications
» Tools for developing & processing on Hadoop
Benefit Hadoop/Spark: large-scale distributed processing (beyond capabilities of your system)
user projects to assess the learning curve & Tutorials/Blogs
02 June 2016 21
VIRTUAL RESEARCH ENVIRONMENT
JUPYTER NOTEBOOK
A notebook records & distributes ‘reproducible’ research
Roadmap
- Available for demonstrations
(on-demand)
- Released in 2017 to all users
Interactive Data Analysis
&
Rich Media Output
02 June 2016 27
WEB-BASED INTERACTIVE COMPUTING
INFORMATION DASHBOARDS
» Notebooks are very flexible, but require programming knowledge
» For decision makers, we create flexible ‘information dashboards’
02 June 2016 31
Dashboards, using services/data at the platform
Integration of UAV/RPAS data
Monitoring of one field Input & visualise fieldwork data
Benchmarking of productivity
between different fields
02 June 2016 37
USERS & REQUIREMENTS – PROBA-V MEP
02 June 2016 39
MEP user groups
GeoViewer, TSViewer
iPython, On-demand
Composite
Development VM’s, API’s
Any user
Remote sensing Expert
Developers
# U
sers
Fle
xib
ilit
y
MEP application flexibility
DEVELOPMENT PLAN (SCHEDULED DATES)
11 January 2016 42
Nov 2015 Mid 2018
Operations (*)
Early delivery
(pre-operations)
Iteration 1 Iteration 2 Iteration 3
26 Jan 2016
July 2016
Iteration 1
June 2017
Iteration 2
January 2018
Iteration 3
Transfer to operations
(*) includes continuous user support & data/service integration
02 June 2016 46
State-of-the-art tools for
BIG Data
Processing & analytics
Operations
Relevant EO-data …
growing in size
FIRST PILOT ‘USER’ APPLICATIONS
» First pilot user applications on the PROBA-V MEP: 2016/17:
» PROBA-V Toolbox (also as plug-in to existing toolboxes)
» Land Cover Monitoring
» Snow Mapping
» Detection of Disturbances in Natural Vegetation
» Detection of Fires / Burned Areas
» Desert Locust
» Looking for further collaborations
» Applications, tools, Software components, … develop pre-operational service
» More EO data: data copy OR links with other Exploitation Platforms
» Focus on machine-to-machine interfaces: discovery – viewing – access – analytics –
processing - …
» Expertise on Hadoop – OpenStack – Data analytics - …
02 June 2016 48 Geo application platform with open access to data via partnerships
proba-v-mep.esa.int
Thank you …
Erwin Goor – VITO - Belgium
http://proba-v-mep.esa.int/