software for processing and interpreting remote sensing ... · pdf filesoftware for processing...

41
Software for Processing and Interpreting Remote Sensing Image Time Series Felix Rembold, Ferdinando Urbano, Carolien Tote, Herman Eerens, Dominique Haesen, Sven Gilliams, Lieven Byderkerke

Upload: ngotu

Post on 30-Mar-2018

219 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

Software for Processing and Interpreting

Remote Sensing Image Time Series

Felix Rembold, Ferdinando Urbano, Carolien Tote, Herman Eerens,

Dominique Haesen, Sven Gilliams, Lieven Byderkerke

Page 2: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

2

Why SPIRITS?

» Large availability of free remote sensing data, but:

» Remote sensing and processing software not specifically

designed for time series processing

» Food security analysts are usually not software programmers

» Tools developed in the past are no longer updated (e.g.

WINDISP)

» Little customization allowed by online platforms (e.g. Crop

explorer, Decision Support Interface (DSI), MARS Viewer)

Page 3: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

3

What is SPIRITS?

» An integrated modular software for raster image time series

processing for:

» producing information and facilitating analysis normally needed

for crop monitoring bulletins

» strengthening early warning systems in food insecure countries

» automation of repetitive time series processing steps

» other uses like environmental monitoring

» Complementary to other environmental

analysis software (E-station) or

drought monitoring systems (ASIS)

Page 4: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

4

What is SPIRITS?

» SPIRITS is a Graphical User Interface written in Java and

based on GLIMPSE (previously developed set of C programs)

» controlling/using/launching/ in-built executables

» includes open source libraries (GDAL, HSQLDB…)

» can also run external executables

Page 5: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

5

Who are the users?

» Agricultural monitoring experts (e.g.

Ministries of Agriculture and Forestry,

Rural Development projects, FAO, WFP,

etc…)

» Remote sensing experts in research or

government organizations

» GIS experts with need to process remote

sensing time series

» E-station users focusing on agricultural

monitoring

» Other experts working with spatial data

(food security, environment…)

» …

Page 6: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

6

SPIRITS information

» Software developed by VITO for the MARS Unit of the Joint Research

Centre (MARSOP contracts)

» Version 1.0 November 2012, complete with manual and tutorials

» Currently Version 1.2 released in October 2014

» Scientific paper published by «Environmental Modelling & Software»

Page 7: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

7

Software, data and support freely available here:

http://spirits.jrc.ec.europa.eu

Page 8: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

8

http://spirits.jrc.ec.europa.eu/ a dedicated

website to:

» Disseminate Spirits

• Download the latest release

• Download the tutorial and the training data set

• Download data in Spirits format (e.g. ECMWF dekadal data, Tamsat

rainfall, eMODIS)

» Support users

• Wiki, FAQ, Video tutorial (to be done)

» Involve users

• Wish list, Mailing list, Forum, News, Calendar

Page 9: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

9

SPIRITS documentation

Page 10: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

10

SPIRITS FUNCTIONALITIES

Page 11: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

11

The SPIRITS menu

» File

» File and project definitions, renaming etc…

» Processing

» Image processing modules for single images (tools) or on a time-series

of images

» Analysis

» Produce maps, browse database, create charts… can be automated

» Import/Export

» format conversions

» rasterization

» User tools

» Runs external or internal

executables on time series

Page 12: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

12

Main functionalities (1/5)

Import and export external data formats

» Image importer: all formats supported by GDAL

» Vector to raster conversion

» File renamer

» Image exporter

Page 13: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

13

Main functionalities (2/5)

Spatial processing operations

» Region of interest (ROI) extraction

» Resampling

» Area fraction image generation

» Low pass filters

Page 14: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

14

Main functionalities (3/5)

Thematic processing operations

» Rescaling

» Index

» Masking

» Flagging

» DMP (Dry matter production)

» Clustering

Page 15: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

15

Main functionalities (4/5)

Temporal processing operations

» Smoothing

» Compositing

» Averaging

» Cumulating

» Phenology

» Phenological averaging or cumulating

» Long term statistics

» Anomalies

» Similarity analysis

» Similarity based yield assessment

Page 16: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

16

Main functionalities (5/5)

Analysis tools

» Map composer

» Database with regionally and thematically aggregated

statistics

» Graph composer

» User tool

Page 17: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

17

Map composer

» Create image maps

» Choose frame and

background extension and

properties

» Overlay vector files

» Edit legends

» Label features

» Add logos

» Copy directly into a report

» Export as PNG

Page 18: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

18

Maps – Time Series

Page 19: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

19

Aggregated statistics extraction and

visualization

LandcoverAdministrative boundaries SPOT-VGT images

“RUM” database – regional unmixed

�All zones�forest

�grasssland�Agriculture�bushland

Page 20: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

20

Selection

Available

Values

Time series analysis charts

Database browser:selected seriescan be sent toa chart

Page 21: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

21

Chart

operations

» Normal

» Average

» Minimum

» Maximum

» Historical Average

» Historical Minimum

» Historical Maximum

» Absolute Difference

» previous period

» previous year

» average

» historical average

» Relative Difference

» previous period

» previous year

» average

» historical average

Page 22: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

22

Charts – time series

Page 23: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

23

Growing user community

SPIRITS users/contributors

B-CGMS

Page 24: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

24

Strengths

» Advanced TS processing, unique tool

for crop monitoring

» Modular structure

» Fast computation

» Automation of complex data

processes

» Automation of outputs on multiple

time/space objects

» Freely available

» Growing community of practice

(website and training)

» Complete documentation: manual

and tutorial

Weaknesses

» specific standards

» File format (modified ENVI)

» Fixed filename structure

» …

» Initial steep learning curve

» previous knowledge in remote

sensing required

Page 25: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

25

News and next steps

» Major technical developments implemented in 2014

» Import/export: HDF5 format

» Smoothing: Witthaker smoother

» Anomaly indicators: SPI (Standard precipitation index)

» Database operations: Standard deviation and Z-scores

» Projection: reprojection from other projections to Geographic Lat/Long

» Training workshops held in 2014

» AGRICAB regional workshops and follow up training

workshops

» MARS trainings follow up: South Sudan, Burkina

Faso, demo at IMAAFS…

» Technical improvements identified for 2015

» Import of different input frequencies (current

standard: daily, 10-daily, monthly)

» …

Page 26: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

26

Summary: in a nutshell…

“SPIRITS is a tool that simplifies and speeds up a growing number

of time series data processing and analysis steps”

Remote sensing background required and initial training recommended

Powerful and complete solution for working with time series when no

programming skills are available

Page 27: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

27

EXAMPLE OF A SPIRITS WORKFLOW

Page 28: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

Example of a SPIRITS workflow

Page 29: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

Quickly visualizing single images..

Add legends, titles, logos, vector layers..

Page 30: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

..or entire series

Page 31: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

Importing files from various sources..

Etc.

Page 32: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

..Automated spatial subset

Page 33: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

..Masking

Page 34: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

..Smoothing

Page 35: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

..Compositing

1-10

August

11-20

August

21-30

August

Maximum NDVI in August

Page 36: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

..Long Term Averages

Mean, max, min, sd,…

Page 37: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

..Anomalies

Actual

Historical mean

Difference maps

Page 38: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

Extraction of statistics..

Page 39: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

Creating chart templates..

Page 40: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

..to quickly create series of charts

Page 41: Software for Processing and Interpreting Remote Sensing ... · PDF fileSoftware for Processing and Interpreting Remote Sensing Image Time Series ... rainfall, eMODIS) ... » Processing

41

Thank you!