big data - introduction and research topics - for dutch kadaster
DESCRIPTION
Presentation (in Dutch) on Big Data (BD) given on Oct 10, 2013 for Dutch Kadaster. To provide an introduction on BD, what could be BD in the geospatial domain, what could be opportunities and research topics for Dutch Kadaster. A personal view, i.e. by no means that this represents opinions or positions of Dutch Kadaster. Just a clarification beyond the buzzword...TRANSCRIPT
Big Data Onderzoek
Agenda
• Big Data
• Big Geo Data
• Onderzoeksvragen
2
Big Data Onderzoek
Not Just Volume
3
Big Data Onderzoek
Wat is Big Data?
4
Big data is the term for a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications. http://en.wikipedia.org/wiki/Big_data
Big Data Onderzoek
Uitdagingen
• inwinnen
• beheren
• opslag
• zoeken
5
• delen
• transfereren
• analyse
• visualisatie
en meer...
Big Data Onderzoek
Opportunity or Threat?
6
The opportunity of big data is also its challenge. We are drowning in data, and tweets, posts and video are not the structured data that fits well into relational databases for traditional querying. As a result, big data simply requires a new way of thinking about how to store and analyze data to accommodate these new realities and turn insights into actionable decisions.
http://www.greenbookblog.org/2012/03/21/big-data-opportunity-or-threat-for-market-research
Big Data Onderzoek
Gartner 2012 - 3V’s
7
Big data is high volume, high velocity, and/or high variety information assets that require new forms of processing to enable enhanced decision making, insight discovery and process optimization.
Big Data Onderzoek
Actually 4th V...
8
Veracity: Professional managers are wary of unverified data. Since much of the data deluge comes from anonymous and unverified sources, it is necessary to establish and flag the quality of the data before it is included in any ensemble. www.geospatialworld.net
Big Data Onderzoek
Gartner 2013 - Not Just 3V’s
1. 3Vs Volume, Velocity, Variety
2. Cost-Effective, Innovative Forms of Information Processing viz. technologies for storing, linking and analysis
3. Enhanced Insight and Decision Making “...the ultimate goal. Business value is in the insights, which were not available before...”
9
http://www.forbes.com/sites/gartnergroup/2013/03/27/gartners-big-data-definition-consists-of-three-parts-not-to-be-confused-with-three-vs
Three Parts
Big Data Onderzoek
Some Facts
10http://visual.ly/what-big-data
Big Data Onderzoek
Some Facts
11http://visual.ly/what-big-data
Some Facts
http://visual.ly/what-big-data
Big Data Onderzoek12
Big Data Onderzoek
Use Cases
13
http://www-01.ibm.com/software/data/bigdata/use-cases.html
Big Data Onderzoek
Case - Obama Re-election
14
http://rasiej.com/news/2013/1/15/big-data-helped-obama-win-the-election
Big Data Onderzoek15
Inside the Secret World of the Data Crunchers Who Helped Obama Win
http://swampland.time.com/2012/11/07/inside-the-secret-world-of-quants-and-data-crunchers-who-helped-obama-win/
Big Data Onderzoek16
Big Data Onderzoek
Amazon 2x
17
Big Data Onderzoek
Amazon - Case 1
18
Amazon pioneered the use of big data analytics in e-commerce, web personalization, multivariate testing of product offerings, and inference engines to predict consumer preferences. http://www.citeworld.com/business/22263/bezos-post-big-data
Big Data Onderzoek
Amazon - Case 1 + others
19
http://www.business2community.com/infographics/amazon-netflix-and-twitter-put-big-data-to-good-use-0574652
Big Data Onderzoek20
Big Data Onderzoek21
Big Data Onderzoek
2. Big Geo Data
22
Big Data Onderzoek
New?
23
Geospatial Data has always been Big Data. Now Big Data Analytics for geospatial data is available to allow users to analyze massive volumes of geospatial data.
http://www.opengeospatial.org/blog/1866
Big Data Onderzoek
Big Data in Geographic Information Science Panel 2012
24
Big Data is not only big because it involves a huge amount of data, but also because of the high-dimensionality and inter-linkage of the involved data sets. The on-the-fly integration of heterogeneous data from various sources has been named one of the frontiers of Digital Earth research, Bioinformatics, the Digital Humanities, and other emerging research visions.http://stko.geog.ucsb.edu/bigdatagiscience2012
Big Data Onderzoek
Lidar
25
Big Data Onderzoek26
Meteorology
Big Data Onderzoek
Amsterdam Realtime 2002
27http://realtime.waag.org
Big Data Onderzoek
Amsterdam Realtime Video
28
▶ Amsterdam Realtime - YouTube
Big Data Onderzoek29
Big Data Onderzoek30
Big Data Onderzoek
UK Linked Data
31
http://data.gov.uk/linked-data
Big Data Onderzoek
3. Big Data Kadaster
33
Big Data Onderzoek
Beware of Labeling
34
Big Data Onderzoek
Mogelijkheden
35
•Data Analyse op Kadaster diensten/kanalenkadaster.nlKLICPDOK
•Basisregistraties • koppelen (linken, navigeren)• ontsluiten (WFS)• real-time• multi-diminsioneel (2d,3d,4d,...)• visualisaties
Big Data Onderzoek36
http://www.geonovum.nl/onderwerpen/informatiemodellen/nieuws/surfen-door-het-stelsel-van-basisregistraties
Big Data Onderzoek
Vragen ?
37