ecogrid & virtual laboratory for e-science willem bouten, project leader floris sluiter, design...

26
Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementatio Guido van Reenen, data analysis Victor Mensing, Vlinderstichting Dirk Zoetebier, Sovon Aart Jan van der Linden, Talmon Com from field observation to spatial knowl CBPG

Upload: isaiah-holden

Post on 28-Mar-2015

218 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Ecogrid&

Virtual Laboratory for e-Science

Willem Bouten, project leaderFloris Sluiter, design & implementationGuido van Reenen, data analysis

Victor Mensing, VlinderstichtingDirk Zoetebier, SovonAart Jan van der Linden, Talmon Comm.

from field observation to spatial knowledge

CBPG

Page 2: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Virtual Laboratory for e-ScienceMission

To boost e-Science by creating an e-Science environment and carrying out research on methodologies.

Essential components

- e-Science development areas

- a Virtual Laboratory development area

- a Large-Scale Distributed computing development area, consisting of high performance networking and grid parts

Page 3: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Virtual Laboratory for e-ScienceAim

To develop and apply a Grid and Virtual Lab technology based information system and research environment.

Page 4: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Virtual Laboratory for e-Science

P1 – e-Science in ApplicationsP2 – generic Virtual Laboratory methodologyP3 – large-scale distributes systemsP4 – scaling up & validating in ‘real-time’ applications

VL- e

The VL-e project has four programme lines, most of them containing more than one subprogramme.

Page 5: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Virtual Laboratory for e-Science

P1 – e-Science in ApplicationsSP1 – Data Intensive ScienceSP2 – Food InformaticsSP3 – Medical Diagnosis & ImagingSP4 – BiodiversitySP5 – Bioinformatics ASPSP6 – The Dutch Telescience Laboratory

VL- e

e-Science in Applications

Research of the P1 line is carried out within the following subprogrammes:

Page 6: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Virtual Laboratory for e-Science

Biodiversity

Aim

To develop and apply a Grid and Virtual Lab technology based information system and research environment

for identification, distribution, integration and analyses of observations and model results of the dynamics of flora and fauna

VL- e

e-Science in Applications

biodiversity

Page 7: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Virtual Laboratory for e-Science

Biodiversity

Partners:

CBPG – Computational Bio- and Physical Geography(IBED – Institute for Biodiversity and Ecosystem Dynamics)(UvA – Universiteit van Amsterdam)

RNLAF – Royal Netherlands AirforceVOFF – Association for Research of Flora & Fauna

And co-operation with other programme lines, especially subprogrammes of P2 (generic Virtual Laboratory methodology)

VL- e

e-Science in Applications

biodiversity CBPG

Page 8: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Virtual Laboratory for e-Science

Biodiversity

Two main components:

1. a national database for biodiversity information

this talk (Ecogrid)

2. a PSE for integrated analysis of observations and model results

topic of Judy Shamoun-Baranes (BAMBAS)

VL- e

e-Science in Applications

biodiversity

EcoGrid

Page 9: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

EcogridObjectives

1. Construct a virtual database that is connected to geographically distributed databases which contain information on the distributions of species, on landscape characteristics and on weather.

Page 10: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

EcogridObjectives

1. Construct a virtual database that is connected to geographically distributed databases which contain information on the distributions of species, on landscape characteristics and on weather.

2. Develop generic methodologies and tools for scale conversions, to be able to integrate and interpret data that are observed at different spatial scales.

Page 11: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

EcogridObjectives

1. Construct a virtual database that is connected to geographically distributed databases which contain information on the distributions of species, on landscape characteristics and on weather.

2. Develop generic methodologies and tools for scale conversions, to be able to integrate and interpret data that are observed at different spatial scales.

3. Use this infrastructure across the boundaries of organisations to indentify:- spatial wood web structures- biodiversity hotspots- effects of changed land-use- ...

Page 12: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Example: insect diversity and Red-backed Shrikes

Page 13: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

### #

##

#

#####

###

##

##

### ############ #####

######### ##### #

##### ######### ##

##### ########

# ####

###

#

## ######

## ######

#### #####

## ### #

#####

#####

## ## #

######

#####

####

# #

##

##################

## ###################

########### #

### #

###

######

#

#

######

############ #

#### ####

####

####

### #

#

##

#

###

###

####

##

## #

# ##

## ####

# #

#

#

#

#

# #

##

#

##

########

Nitrogen dep. }

Page 14: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Initial Situation

VlinderstichtingFLORONNMVRAVONBLWGVZZ ANNEMOONEIS-NLTineaSOVON

VOFF{

Ecogrid - data acquisition

Page 15: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

} centralVOFF

database

Ecogrid - data acquisition

observationobservationtaxonomytaxonomy localitylocality

SOVON

NCO databases

Page 16: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

central databases

NCO databases

Data shared by all NCO’s

NCO-specific data

RAVON

Page 17: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

GISmapsetc.

ACTIVE MEMBER

PK Person ID

central databases

SPECIES

PK Taxon ID

OBSERVATION

PK Observation ID

Species ID

NCO databases

OBSERVATOR GROUP

FK Person ID

FK Observation ID

Main Observator

TAXONOMYWEBwebpages

PERSONSportal login

METADATA

GIS LOCATION

km hokx, yrouterelevé

EXTRA INFO

Page 18: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

• Spatial functions to query (SQL) within and across layers:

• Equals()

• Disjoint()

• Intersects()

• Touches()

• Crosses()

• Within()

• Contains()

• Overlaps()

• Special indexing techniques (GisT)‘Layers’ build with these data types,

stored as tables in PostgreSQL/PostGIS.

spatial databases

Page 19: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

dataacquisition

portal

dataacquisition

portal

EcoGridvirtualmeta

database

Spotfire

data miningmodules

geostatistics

scale conversionmodules

modelexperiments

processeddata

centraldatabases

VOFF

centraldatabases

VOFF

landscapelandscape

weatherweather

VL-eScience Research Environment

scienceportal

scienceportal

BAMBASdatabase

Ecogrid system - overview

Page 20: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

dataacquisition

portal

dataacquisition

portal

EcoGridvirtualmeta

database

Spotfire

data miningmodules

geostatistics

scale conversionmodules

modelexperiments

processeddata

landscapelandscape

weatherweather

VL-eScience Research Environment

scienceportal

scienceportal

BAMBASdatabase

Ecogrid system - prototype

SOVON

Page 21: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Ecogrid - portal prototype

Page 22: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Ecogrid - portal prototype

Page 23: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Ecogrid - portal prototype

Page 24: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Ecogrid - portal prototype

Page 25: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

Ecogrid - portal prototype

Page 26: Ecogrid & Virtual Laboratory for e-Science Willem Bouten, project leader Floris Sluiter, design & implementation Guido van Reenen, data analysis Victor

• PostgreSQL (and Postgis) are especially suited for large scientific databases

• By the end of this year all the databases will be populated and we will have online data acquisition.

• Then we will shift our focus on using the data and concentrate on Analysis and Datamining

Concluding remarks