Big Data Processing and Apps for Citizens'

Observatories - The CITI-SENSE Approach

VGI and Crowdsourcing session, Lisbon, Portugal

Thursday May 28th, 2015, 1100-1120

Arne J. Berre, Arne.J.Berre@sintef.no

5 Citizen

Observatory

projects

� Crowdsourcing workshop: Citizens’ Observatories Infrastructures for Citizen Science and Crowd Sourcing -concepts, methodologies, apps and sensors with INSPIRE in mind, Friday May 29th, 1100-1700

Dates: 01/10/2012-30/09/2016

Duration: 48 months

Budget:12M€

Partners: 28 partner organisations fromEurope, Israel, South Korea and Australia

CITI-SENSE

Project data

Grant agreement nº: 308524

Project web portal:

http://www.citi-sense.eu

Citizens’ observatory central web portal: http://co.citi-sense.eu

CITI-SENSE partners

CITI-SENSE

� Development of sensor-based Citizens‘

Observatory Community for improving Observatory Community for improving

quality of life in cities

� Citizens’ observatories – communities that share technological solutions,

information products and services and community participatory methods.

Complementing established environmental data and information systems,

improving local environmental decision making.

� Nine cities (Barcelona, Belgrade, Edinburgh, Haifa, Ljubljana, Oslo, Ostrava,Vienna, Vitoria) use sensors to gather data on outdoor urban spaces andindoor school environments.

CITI-SENSE | Mobile Sensors

www.citi-sense.eu

CITI-SENSE Sensor platformsfor Air Quality Sensors

� Mobile Personal Sensor Package (PSP) Solution/apps – Ateknea with Sensing&Control – (In Crowdsourcing workshop, Outdoor with Sensing&Control – (In Crowdsourcing workshop, Outdoor session in Lisbon on Friday May 29th, 1100-1700)

� Atmospheric sensors –Atmospheric

� Geotech/EnviroLogger– Geotech

� Radon sensor –OBEO

� SenseItNow – Spanish Vittoria app with SensApp/WFS – NILU, Tecnalia, (SINTEF)

� DUNAVNET platform – Dunavnet

� VESNA platform – JSI

The Personal Sensor Pack developed

by Ateknea is equipped with the following sensors:

� NO , O , CO (ppb)

Personal Sensor Pack (PSP)

� NO2, O3, CO (ppb)

� Temperature (°C)

� Relative Humidity (%)

� USB connectivity

� Bluetooth 2.0

� New version released May 2015

In situ sensors

SenseItNow app

VESNA App

This project has received funding from the European Union’s Seventh Framework Programme for

research, technological development and demonstration under grant agreement no 308524 12 of 21

CITI-SENSE Platform

SensorApplicationPlatforms

OBSERVE-Static

--Mobile

--Questions

PUBLISHDISCOVER

COMPOSE

VISUALISEANALYSE

ACT

NOTIFYMANAGE

Human

SensorData

Service

VESNADunavnet

….

GEOSS Common Infrastructure (GCI)

Component & Service Registry

(CSR)

Discovery & Access Broker (DAB)

XYZ

Sensor

package

SenseItNow

AppNN

App

XYZ portal

SensApp

Log

SensApp

Android

CivicFlow

portal

CITI-

SENSE

portal

Spatial and EnvironmentalData ServicesPlatform (SEDS)

• WFS-T interface

•Sensor Registration Service

• Sensor Data Ingest Service

• Data Storage and Processing

Service

• Data Publication Service

XYZ

Server

SensApp

Server

Linked DataPlatform

(optional future)

Event

Notification(optional future)

CivicFlow

Server

GEOSS,

GMES,

Copernicus

GNSS

INSPIRE,

…

CITI-SENSE Platform Data flow dfd Data Flow Diagram

SensApp

Platform

GEOSS

Spatial &

Environmental Data

Platform

Linked Data

Platform

Sensor Data

Provider

Sensor Data

Provider

Sensor Data

Provider

Data Ingestion

Services

Data Publication

ServicesData

Validation

Authentication

Data Consumers

Authentication

CITI-SENSE and GEOSS

GEOSS and Community portals

GCI Architecture

GEOSS Common Infrastructure

GEO Web Portal

GEOSS User

Discovery & Access

GEOSS Registries: • Standards &

Interoperability

Community

Portals

CommunityInfrastructure

Link from GEOSS Portal

Community View ofGEOSS Resources

GEOSS

Helper

Citizens

Observatory

Portals

Services and SW Applica ons e.g. So ware, Data Access, Processing, Community Portals, Documents

EO data Catalogues &

Repositories e.g. IDN, INSPIRE, geo.data.gov

Integrated/Federated EO

Discovery/Access Systems

e.g. GENESI, CWIC, FedEO*

Component & Service

Registry (CSR)

Clearinghouse (CH)

* Prototype

capabili es

Register

Resources Providers

Interoperability

• User Requirements

• Best Prac ces Wiki

GEOSS Resources

Discovery and Access

Broker (DAB)

Service Monitoring

harvest

real- me

search

data data

Seman c Component* CommunityCatalogue

CommunityBroker

Community Data, Information,

Services and Applications

Register Community Resources as Appropriate

Enables Integration ofGEOSS and non-GEOSSRegistered Resources

GCI Access toCommunity Infrastructure

HelperApplications

GEO Portals

GEOSS/INSPIRE/Member StateCommon Infrastructures

Components & Services

Standards &Interoperability

Best Practices

Registries

CITI-SENSE Observatory

Web Apps, Mobile Apps, GEO-PORTALS, REPORTING

Business Process Tier

Discovery Service

Metadata editor

Discovery & View Application

User EmpowermentSocial media

Citizen Participation

Protocol for Citizen Empowerment

CITI-SENSE Products and Services

OBSERVEPUBLISH

DISCOVER

COMPOSEDISCUSSANALYSE

ACT

NOTIFYMANAGE

HumanSensorDataService

GEOSSClearinghouse

User RequirementsRegisters:OntologiesApp Schemas…..

User & Rights Management

Visualisation & Portrayal Services

Data Composition & Fusion Services

Semantic Annotation, Mediation & Discovery

Data Access Tier

OGC Web Services (WFS, WCS, SOS)

Event Services(WS-N, SAS, SES)

DownloadServices

Vocabularies Workflow Management & Orchestration (Service Chaining)

Model Transformation & Model-as-a Service

Uncertainty Handling & Provenance

Sensor Platform Tier

Smart PhoneMobile Sensors

Mobile Devices, Apps, VGI

Bluetooth

Low Energy

(BLE)

Intelligent

Gateways

Adaptive Sensors(ThingML, Contiki, TinyOS, …)

In situ/Mobile Sensors

Wi-Fi Linked DataServices

The Big Data V's

Volume Velocity VeracityVariety Value

€€

€

€

€

€ €

€

9-6-2015 19www.bdva.eu

Data at Rest

Terabytes to

exabytes of existing

data to process

Data in

Motion

Streaming data,

requiring mseconds to

respond

Data in Many

Forms

Structured,

unstructured, text,

multimedia,…

Data in Doubt

Uncertainty due to

data inconsistency &

incompleteness,

ambiguities, latency,

deception

€€

Data into

Money

Business models can

be associated to the

data

WFS,Linked Data

Big DataProcessing

Operational,Archive

Big Data stream processing – with

predictions and detection of events

http://www.proasense.eu

ProaSense – Big Data Event architecture

Storm

MongoDB Kafka

Apache Storm

• Bolts and spouts

• Stream-based communication

• Polling input, push-based internals

• Distributed and resilient

23

• Distributed and resilient

Extending CITI-SENSE with Linked Data

This project has received funding from the European Union’s Seventh Framework Programme for

research, technological development and demonstration under grant agreement no 308524 24 of 21

http://project.dapaas.eu

How can we simplify

Linked Open Data

publication and consumption?

http://dapaas.eu

DaPaaS – Enablers

DaPaaS platform

Grafter Grafterizer(Graphical Tool & DSL)

RDF RDF RDF

database-as-a-service

PLUQI Open Data Visualization-

as-a-service

RDF

DDP

Citizens’ Observatories Web Portals

Thank you for your attention!

– Find us on

� CITI-SENSE CO’s central web portal: http://co.citi-sense.eu

� Common CO project’s web site: http://www.citizen-obs.eu/� Common CO project’s web site: http://www.citizen-obs.eu/

� LinkedIn: https://www.linkedin.com/groups/Citizens-observatories-5164755

� Facebook: https://www.facebook.com/int.cit.obs

� Twitter: https://twitter.com/Citizensobs

� Email: Arne.J.Berre@sintef.no

� CITI-SENSE web site: http://citi-sense.nilu.no/