ov big data
TRANSCRIPT
The Next Frontier for Innovation, Competition and Productivity
• ‘Big Data’ is similar to ‘small data’, but bigger
•…but having data bigger it requires different approaches:• Techniques, tools and architecture
•…with an aim to solve new problems•…or old problems in a better way
Big data is like teenage sex: everyone talks about it, nobody really knows how to do it, everyone thinks everyone else is doing it, so everyone claims they are doing it..
Dan ArielyProfessor of psychologie
Duke University – NC - USA
Every 2 Days We Create As Much Information As We Did Up To 2003
Eric SchmidtCEO Google
4 V‘s of Big Data
Volume• Data
quantity
Velocity• Data
Speed
Variety• Data
Types
Veracity• Messine
ss
Gartner (2001) IBM (2012)
VOLUME
4,4 Zettabytes of data
4,4 Trillion of Gigabytesin 2013 there is as much data
as known stars in the whole universe
44 Zettabytes of data
44 Trillion of Gigabytes62 times the number of all
sands in all beaches on earth
VELOCITY
1 TB OF INFORMATIONCaptured by NYSE
in every trading session
18,9 BILLIONNetwork connections by
20162,5 Network connections
per person on earth
VARIETY
30 BILLIONPIECES OF CONTENT
shared each month on facebook
400 MILLION TWEETS
Are sent every day by 200 million
active users per month
VERACITY
3,1 TRILLION A YEARUS$ what poor quality data
costs The US economy
1 OF 3 BUSINESS LEADERS
Don’t trust the information the use
to make decisions
Where have you been 15 days ago at 17:38
Google collects all our numeric transactions:
Our trajectory …Our clicks ..
Our choices ..Our comments …Our purchases …
Our search queries …
Why Big Data
• Key enablers of appearance and growth of Big Data are
–Increase of storage capacities
–Increase of processing power
–Availability of data
–Every day we create 2.5 quintillion bytes of data; 90% of the data in the world today has been created in the last two years alone
Big Data Analytics
• Examining large amount of data
• Appropriate information
• Identification of hidden patterns, unknown correlations
• Competitive advantage
• Better business decisions: strategic and operational
• Effective marketing, customer satisfaction, increased revenue
Applications for Big Data Analytics
Homeland Security
Finance Smarter HealthcareMulti-channel
sales
Telecom
Manufacturing
Traffic Control
Trading Analytics
Fraud and Risk
Log Analysis
Search Quality
Retail: Churn, NBO
Healthcare
• 80% of medical data is unstructured and is clinically relevant
•Data resides in multiple places like individual EMRs, lab and imaging systems, physician notes, medical correspondence, claims etc
• Leveraging Big Data• Build sustainable healthcare systems• Collaborate to improve care and outcomes• Increase access to healthcare
Market Size
Source: Wikibon Taming Big Data
By 2015 4.4 million IT jobs in Big Data ; 1.9 million is in US itself
Market for Big Data
•Gaining attraction
•Huge market opportunities for IT services (82.9% of revenues) and analytics firms (17.1 % )
• Current market size is $200 million. By 2015 $1 billion
• The opportunity for service providers lies in offering services around Big Data implementation and analytics for global multinationals
Future of Big Data
• $15 billion on software firms only specializing in data management and analytics. This industry on its own is worth more than $100 billion and growing at almost 10% a year which is roughly twice as fast as the software business as a whole.• In February 2012, the open source analyst firm Wikibon released the first market forecast for Big Data , listing $5.1B revenue in 2012 with growth to $53.4B in 2017• The McKinsey Global Institute estimates that data volume is growing 40% per year, and will grow 44x between 2009 and 2020.
Big Data Analytics TechnologiesNoSQL : non-relational or at least non-SQL database solutions such as HBase (also a part of the Hadoop ecosystem), Cassandra, MongoDB, Riak, CouchDB, and many others.
Hadoop: It is an ecosystem of software packages, including MapReduce, HDFS, and a whole host of other software packages
Thank you Hassen [email protected]