Open data & Open research data: experience from Compass4D

FOT-Net Data Stakeholder Meeting on Data Sharing Activities 08 March 2016 ERTICO, Brussels Dr. Evangelos Mitsakis Associate Researcher Centre for Research and Technology Hellas Hellenic Institute of Transport

Thessaloniki on the map

~1.400.000 inhabitants ~450.000 private cars & 20.000 motorcycles 1.300.000 daily trips 1 (+1) public transport operator for urban trips ~35 public transport operators for extra-urban trips 1.950 taxis 6.433 kms of streets 8,8 kms of dedicated bus lanes 12 kms of dedicated bicycle lanes 89,4 kms of ring road 197.696 parking places

Thessaloniki ITS timeline

•Cooperative technologies •Multimodal integrated services •Personalized traveler assistants •Agent and activity based dynamic models •Eco and climate-friendly mobility (e.g. electro-mobility) •Internet-based services (Internet of things, Future Internet)

2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2014 2015 2016 2017 2018

THESSALONIKI 2020

RAIL4SEE

2013 2019 2020

HIT portal

ΜΟΒΙΝΕΤ

Intelligent Urban Mobility Management

and Traffic Control System

EASYTRIP

SEE-ITS

COMPASS4D

Future internet

Electromobility

Multimodal

Smart cities

Telematics public transport system

Peripheral ring road surveillance

system

Equipment

Services

Studies

Policy

COGISTICS

LOGIMATIC

Related local stakeholders

Region of Central Macedonia Municipality of Thessaloniki CERTH-HIT THEPTA Transport services providers - operators: OASTH,

TRAINOSE, taxis, metro Private sector: passenger infomobility, city logistics

CERTH probe data

Stationary sensors: Point-to-point tracking of MAC IDs with Bluetooth detectors (43).

Dynamic sensors: Floating Car Data provided in real time by a professional fleet (more than 1200 vehicles).

Cooperative technologies (COMPASS4D and COGISTICS): RSU is a static sensor and OBU is a dynamic sensor (CAM message).

Social media (Twitter & Facebook)

- State-of-the-art platform for data and software related to the Transport sector in Greece - Content aggregator, observatory, research infrastructure, services - Data collection and processing - Data standardization and certification - Data management - Data analytics - Data merging / enrichment - Optimization and routing algorithms - Data analytics and visualization - Transport modeling and simulation - Commercial and research studies

Specialized transport software

Algorithm

Data

Thessaloniki HIT PORTAL

Thessaloniki HIT PORTAL

Thessaloniki HIT PORTAL

• Conventional detectors: Data rate varies between 90 seconds (loops) and 5 minutes (radars and cameras). About 300k entries per day requiring approximately 15 MB of uncompressed storage space.

• Bluetooth detectors: Data from units are being transferred to db server every 15 minutes. About 250k - 300k entries per day requiring approximately 50 MB of uncompressed storage space.

• Floating Car Data: Data are being transferred to CERTH-HIT's server every 2 minutes. About 2m entries per day, requiring approximately 200 MB of uncompressed storage space

• 5000 monthly queries to the HIT PORTAL services

Towards a “Big Data” Portal

- Bluetooth detectors - Floating Car Data - Social media - Conventional detectors (loops, radars and cameras)

- Historical data - Real-time - Near real-time

- Conventional detectors (15MB / day) - Bluetooth detectors (50MB / day) - Floating Car Data (200MB / day)

Volume

Velocity

Variety

A novel Open data platform at CERTH-HIT

Datatank (Back office + restAPIs) CKAN (front end)

Open data platform sections

Open data set catalogue Open data publishing Open linked data Open research data Inspiration: ways developers use open data Comments: section where people can log suggestions for tools

they’d like to see developed with the data sets Open data accelerator: a move to unite government publishers of

data, the businesses that use it, as well as citizens and developers Open data declaration and open data policy (Transparency,

Participation, Collaboration, Innovation, Progress, terms of data use etc)

Open data platform content

Floating car data Congestion (json, xml, php) Speed (json, xml, php)

GPS (json, xml, kml, GeoJSON, WKT, CSV, PHP)

Open data platform content

Bluetooth detections data Detections (json, xml, php) Travel times (json, xml, php) Devices (json, xml, kml, GeoJSON, WKT, CSV, PHP)

Paths (json, xml, kml, GeoJSON, WKT, CSV, PHP)

Open data platform content

Research data (COMPASS4D) Floating car data along two arterials Higher frequency (1 Hz) GPS location, zone ID Timestamp, Speed Qualitative data

Cooperative safety messages Speed advices

Open data platform target groups

Researchers - Academics Public authorities and public transport providers Service providers and private companies Start-ups, independent programmers and web

entrepreneurs Open data communities and data hackathon events

Dr. Evangelos Mitsakis Associate Researcher Centre for Research and Technology Hellas Hellenic Institute of Transport e: emit@certh.gr t: +30 2310 498459

http://www.opendata.imet.gr