presentation of the big data europe project at the eip water conference 2016 in leeuwarden, the...
TRANSCRIPT
BIG DATA EUROPEH2020 COORDINATION & SUPPORT ACTIONEMPOWERING COMMUNITIES WITH DATA TECHNOLOGIESFEBRUARY 2016HTTP://WWW.BIG-DATA-EUROPE.EU/
Integrating Big Data, Software & Communities for Addressing Europe’s Societal Challenges
#EIPWater2016
Semantic Web Company (SWC)
SWC was founded 2001, head-quartered in Vienna
30 experts in linked data technologies
Product: PoolParty Semantic Suite (launched 2009)
Serving customers from all over the world
EU- & US-based consulting services
SWC: Portfolio & Core Product
PoolParty is a world-class semantic technology suite that offers sharply focused solutions to your knowledge organization and content business.
PoolParty Semantic Suitehttp://www.poolparty.biz
SWC: Customers & PartnersSome of our Customers
● Credit Suisse● Boehringer Ingelheim● Roche● Wolters Kluwer● BMJ Publishing Group● Red Bull Media House● Canadian Broadcasting Corporation
(CBC)● Pearson● Council of the EU● DG Environment, EC● Healthdirect Australia● Ministry of Finance (Austria)● World Bank Group● Inter-American Development Bank
(IADB)● International Atomic Energy Agency
(IAEA)● Buildings Performance Institute
Europe (BPIE)● Renewable Energy & Energy Efficiency
P (REEEP)● Global Buildings Performance Network
(GBPN)● American Physical Society● Education Services Australia (ESA)● Norwegian Directorate of Immigration● Australian National Data Service
Finance / Automotive / Publisher / Health Care / Public Administration / Energy / Education
Selected Partners● EBCONT● EPAM Systems● iQuest● PwC● Tenforce● OpenLink Software● Ontotext● MarkLogic● Gravity Zero● Altotech● Wolters Kluwer● Taxonomy Strategies● Digirati● Fraunhofer (IAIS)● University of Leipzig
(INFAI)● The Open Data Instizute
(ODI)
We all have one goal in mind: Make machines smart enough so that they can help us to find those needles in the haystack, which are really relevant to us.
SWC: a research driven SME
http://www.aligned-project.eu/ http://lod2.eu
http://semagrow.eu/
http://www.big-data-europe.eu/
http://www.openfridge.net/
http://nolde.at/ http://www.kiwi-project.eu/
1st EC Innovation Radar 2015
The Motivation – Big Data
Every day, we create 2.5 quintillion bytes of data — so much that 90% of the data in the world today has been created in the last two years alone.
This data comes from everywhere: sensors used to gather climate information, posts to social media sites, digital pictures and videos, purchase transaction records, and cell phone GPS signals to name a few.
This data is big data. Source: IBM
The Motivation – Data Management
BIG DATA
Open DataLinked
DataLinked Open Data
Data Repositories
DatabasesData
LibrariesCatalogues
Social Media
Big Data DimensionsVolume
Velocity
Variety
10001010101010101010101001010010101010101001010010101001010010101001010010100101010010101010010101000101010101001010101010101010100101010101010100101010111000101010101010101010100101001010101010100101001010100101001010100101001010010101001010101001010100010101010100101010101
10001010101010101010101001010010101010101001010010
…….………….……………..……..……………
1 0
1000101010101010101010100101001010101010100101oo11
Veracity!Value !!!
Big Data Dimensions
Big Data in Europe: Challenges, Opportunities
HealthClimateEnergyTransportFoodSocietiesSecurity
Loremipsumdolors
KSDJOPSCKKSDKA
B
LKASJLLAWWD
S
wpweppepwpisio
we
10101001101010010101
0
Regional Data Repositories 10101
001101010010101
0
10101001101010010101
0
#2: Interlink, Centralise Access, Explore101010100101010101001011010001010101010010101010100001011010001010101010010101010100100101010100101010101001011010
001010
Data Eleme
nt
related relate
d
#3: Analyse, Discover, Visualize#4: Mashup, Cross-domain Exploitation
JournalistsCitizens Industry
Authorities
Big Data in Europe: Obstacles
1 mai 2023
#1 Big Data “Variety“ problem Multiple Data Sources Required: Integration, Harmonisation
#2 Opening-up Data concerns Loss of control, lack of tracking Reservations about large corporations
#3 Limited Skills, Training, Technology
Lack of Data Scientists Lack of Generic Architectures, components
Big Data in Europe: Obstacles
1 mai 2023
Extraction, Curation Quality, Linking, Integration
Publication, Visualization, Analysis
Extraction, Curation, Quality, Linking, Integration, Publication,
Visualization, Analysis
HealthTransport
Security
Extraction Curation Quality Linking Integration Publication Visualization Analysis
Data Repositories Linked Open Data Cloud
Stage 1
Stage 2
Stage 3
Food SocietiesClimate Energy
BDE Partners: Community – Tech - Network
Rationale Show societal value of Big Data Lower barrrier for using big data
technologieso Required effort and resourceso Limited data science skills
Help establishing cross-lingual/organizational/domain Data Value Chains 1 mai 2023
RationaleCOORDINATION
Stakeholder Engagement (Requirements
Elicitation)
SUPPORTDesign, Realise, Evaluate
Big Data Aggregator Platform
Create and Manage Societal Big Data Interest
Groups
Cloud-deployment ready Big Data Aggregator
Platform
CSA Measures
Results
SummaryTwo clearly defined coordination and support measures: Coordination: Engaging with a diverse range of stakeholder groups
representing particularly the Horizon 2020 societal challenges Health, Food & Agriculture, Energy, Transport, Climate, Social Sciences and Security; Collecting requirements for the ICT infrastructure needed by data-intensive science practitioners tackling a wide range of societal challenges; covering all aspects of publishing and consuming semantically interoperable, large-scale data and knowledge assets;
Support: Designing, realizing and evaluating a Big Data Aggregator platform infrastructure that meets requirements, minimises disruption to current workflows, and maximises the opportunities to take advantage of the latest European RTD developments (incl. multilingual data harvesting, data analytics & visualisation).
BigDataEurope will implement and apply two main instruments to successfully realize these measures: Build Societal Big Data Interest/Community Groups in the W3C interest group
scheme & involving a large number of stakeholders from the Horizon 2020 societal challenges as well as technical Big Data experts;
Design, integrate and deploy a cloud-deployment-ready Big Data aggregator platform comprising key open-source Big Data technologies for real-time and batch processing, such as Hadoop, Cassandra and Storm.
Orthogonal Dimensions of Big Data Ecosystems
Generic Big Data Enabling Technologies
Data Value Chain
Data Generation & Acquisition
Data Analysis & Processing
Data Storage & Curation
Data Visualization &
Usage
Data-driven Services
Socie
tal C
halle
nges
Dom
ain
Spec
ific D
ata
Asse
ts
& T
echn
olog
y
Healthcare
Food Security
Energy
Intelligent Transport
Climate & Environment
Inclusive & Reflective Societies
Secure Societies
Methodology of Requirements Engineering
BDE Approach & Methodology• BDE Core Question Matrix as a basic
Tool• Online Survey (20.5. – 26.6.2015, 394
Participants)• 7 x 15 Face to Face Interviews (3 x 5
per SC)• 7 Workshops in 2015 (7 in 2016, 7 in
2017)• 7 BDE Pilot (Use Case) ideas /
specifications
Requirements
Use case pilots
Online survey Intervie
ws
BDE Stakeholder Engagement Approach & Activities
BDE Community Tools – JOIN IN NOW !• Website: news, events, community, …• 7 x BDE W3C Community Groups• 7+1x Mailing Lists• 7 x SC Workshops/Year = 21 Workshops• HangOuts & Webinars (Next: 2.3. - 14.00)
Technology Outlook – coming soon• BDE Aggregator Platform
• For Download & Cloud Version• Big Data Technology Support Tools• 7+ BDE Pilots
Work Packages & Implementation Phases
Community Building
M1-M12 M13-M24 M25-M36
Enabling Technologies
Component Integration
Uptake
Integrator Deployment
Community Assessment
WP3 – Big Data Generic Enabling Technologies & Architecture
WP5 – Big Data Integrator Instances
WP7 – Dissemination & Communication
WP2 – Community Building & Requirements
WP4 – Big Data Integrator Platform
WP6 – Real-life Deployment & User Evaluation
Blueprint of the Data Aggregator Platform
Batch Layer
Speed Layer
Data Storage
Real-time data &
Transactions …
Batch View
Real-time View
mes
sage
pas
sing
message passing
Applications & ShowcasesReal-time dashboardsDomain-specific BDE apps
Big Data AnalyticsIn-stream Mining
BDE Platform &
Intelligence
Input dataStreamSpatialSocialStatistical TemporalTransactionalImagery
+ Semantic Layer
Lambda Architecture
Announcements….• BDE Architecture & Platform Webinar, 02.03.2016,
14.00pm, LINK• Big Data Europe MeetUp Salzburg, 26.02.2016, 16.00pm
, LINK• 2016 Conference on Big Data from Space, March 15,
2016, LINK• 2nd BDE Workshop Series, 2nd half of 2016 – to be
announced soon!
SEMANTiCS2016, 13.-14. September 2016 Leipzig, Germany, http://www.semantics.cc
EDF2016, 29-30 June 2016Eindhoven, Netherlands, http://2016.data-forum.eu
BDVA Small Summit2016, 2.-3. March 2016The Hague, Netherlands, LINK
Martin Kaltenböck, [email protected]
Semantic Web Company GmbHMariahilfer Strasse 70/8, A-1070 Vienna+43-1-4021235http://www.semantic-web.athttp://www.poolparty-software.comhttp://slideshare.net/semwebcompanyhttp://youtube.com/semwebcompany
Your Questions please….www.big-data-europe.eu
1 mai 2023#BigDataEurope