big data and open data · 2020-01-28 · netties 2015 13th international conference on networking...
TRANSCRIPT
![Page 1: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/1.jpg)
Johann Günther 1
Big Data and Open DataIntroduction and Definition
Open Data and Big Data
The Impact on Digital Society and Smart Cities"
NETTIES 2015
13th International Conference on Networking Entities
La Casona, Tacoronte, Tenerife
March 5 - 8, 2015
Prof. Dr. Johann GüntherVisiting Professor at: Danube University Krems, Austria,
Source: Gottfried Salzmann Professor State University of Telecommunications, Russia,
Stadtlandschaft New York Research Professorship Jianghan University, Wuhan, China
![Page 2: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/2.jpg)
Johann Günther 2
2012: 16 years old girl in Netherlandsposted birthday party invitationmistakenly public on Facebook3000 people came
Picture: VMworld Gatherings, Parties and Activities
![Page 3: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/3.jpg)
Johann Günther 3
Data Worldwide
• Beginning recorded history till 2003: 5 billion Gigabytes
• 2011: 5 billion Gigabytes every 2 days• 2013: 5 billion Gigabytes every 10 minutes• 2015: 5 billion Gigabytes every 10 seconds
Source: Smolan & Erwitt 2012)
![Page 4: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/4.jpg)
Johann Günther 4
Big Data Worldwide
2012: 9,8 billion $2017: 32,4 billion $
Source: IDC
![Page 5: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/5.jpg)
Johann Günther 5
Big Data = large collections of data
Data Sets = old term from Main Frame Computing
Today Data Sets can not be handled with traditional applications
![Page 6: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/6.jpg)
Johann Günther 6
Development
Main Frame Computing
Personal Computing
Cloud Computing
Central Decentral
![Page 7: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/7.jpg)
Johann Günther 7
Very Important !!!
BIG DATA = GLOBAL
![Page 8: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/8.jpg)
Johann Günther 8
IAFeS
Our Organisation IAFeS uses eScience,which is based on Big Data
E-Science = computationally intensive science- highly distributed network environments- uses immense data sets
![Page 9: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/9.jpg)
Johann Günther 9
Characteristics of Big data
* Volume – Quantity of data * Variety* Velocity – due to the volume of data;
high speed of precessing is needed* Veracity - Quality of the data = problem.* Complexity - Data management with
- large volumes of data - from multiple sources
![Page 10: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/10.jpg)
Johann Günther 10
Obama and Big Data
• 2012 Obama administration announced Big Data Research and Development Initiative
• Big data analysis = important for Obama's re-election 2012• US Federal Government owns six of the ten
most powerful supercomputers in the world• „Utah Data Center“ under construction
by „United States National Security Agency“Handle large amount of information collected by the NSA
Picture: http://blogs.reuters.com/great-debate/2013/07/25/obamas-plan-one-nation-under-government/
![Page 11: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/11.jpg)
Johann Günther 11
Internet in Things will create more data
![Page 12: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/12.jpg)
Johann Günther 12
2020: 25 Billion Devices online
Source: Gartner
![Page 13: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/13.jpg)
Johann Günther 14
Since 2008: 200 billion Apps downloaded50% in 2013 (100 billion)
2014: 2 billion smartphones
2020: 8 out of 10 will have smartphone
Source: Gartner, IDC
![Page 14: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/14.jpg)
Johann Günther 15
Smart Phone Market:
* Samsung* Apple* Lenovo with Motorola* Huawei* LG Electronics* Xiaomi (Chinese “Apple”
Source: Gartner, IDC
![Page 15: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/15.jpg)
Johann Günther 17
Big Data in a dual, interconnected manner:
• Targeting of consumers • Data-capture
![Page 16: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/16.jpg)
Johann Günther 18
Big Data = modern form of communication= Social Media= leads to a hyper-networked society= individual acts spread via the network
Source: Andre Zwitter, „Network Ethics and Big Data: Cahnging Power in a Networked Society“, in BIFFL, Gudrun & RÖSSL, Lydia: „Migration & Integration 5“, 2014
![Page 17: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/17.jpg)
Johann Günther 19
Closing the profil on Facebook= „Virtual Identity Suicide“
![Page 18: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/18.jpg)
Johann Günther 20
Facebook: 1,228 billion user (end 02/2014)282 million in Europe27,38 million in Germany3,24 million in Austria
Instagram: 200 million user
Twitter; 232 million active user
Google+ 300 million
Xing: 12,65 million
![Page 19: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/19.jpg)
Johann Günther 21
Social Networks:
* Facebook* Instagram* Twitter* Google* Xing* Flickr* Foursquare* Last.fm* Delicious* Scribd* Slideshare* Covestor* Pinterest* tumblr* Goodreads* WhatsApp
![Page 20: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/20.jpg)
Johann Günther 22
Open Data
Data free available
Use for everyone
Republishing
No copyright
![Page 21: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/21.jpg)
Johann Günther 23
Open Data versus Closed DataSource: Donau-University, Peter Parycek
![Page 22: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/22.jpg)
Johann Günther 24
Open Data versus Closed DataSource: Donau-University, Peter Parycek
![Page 23: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/23.jpg)
Johann Günther 25
Our world is observable and configurable infrastructure:- Social Web- Smart Phone- Smart Home- Smart City
The objective is efficiency. e.g .: traffic control and traffic lights
![Page 24: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/24.jpg)
Johann Günther 26
Users of Big Data
eBay.com:
- 2 data warehouses at 7.5 petabytes and 40PB - + 40PB Hadoop cluster for search,
consumer recommendations and merchandising
- Inside eBay’s 90PB data warehouse
![Page 25: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/25.jpg)
Johann Günther 27
Users of Big Data
Amazon.com:- handles millions of back-end operations every day- more than half a million third-party sellers- Linux-based –
in 2005 the world’s three largest Linux databases- 7.8 TB, 18.5 TB, and 24.7 TB
![Page 26: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/26.jpg)
Johann Günther 28
Users of Big Data
Facebook* handles 50 billion photos* 1,4 billion users (end 2014)
![Page 27: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/27.jpg)
Johann Günther 29
Users of Big Data
• More Applications and Examples = this conference
![Page 28: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/28.jpg)
Johann Günther 30
„Google will knowthe answer to your question
before you ask it“
![Page 29: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/29.jpg)
Johann Günther 31
„Computer will understand us better than
we understand ourselfes.“
(Roy Kurzweil, 2014)
![Page 30: Big Data and Open Data · 2020-01-28 · NETTIES 2015 13th International Conference on Networking Entities La Casona, Tacoronte, Tenerife ... VMworld Gatherings, Parties and Activities](https://reader033.vdocument.in/reader033/viewer/2022050412/5f890266ac4806102e6d5671/html5/thumbnails/30.jpg)
Johann Günther 32
• The future is open, but the past is past.
• Technology is neutral - they can both good and bad
• Back to "Digital Biedermeier“?