big data final presentation
TRANSCRIPT
4
WHAT IS BIG DATA?
AVAILABILITY OF DATA
STRUCTURED & UNSTRUCTURED
INDUCTIVE STATISTICS
CONCURRENCY CONTROL
COST EFFECTIVE
How big is the Big Data?
What is big today maybe not big tomorrow
- Any data that can challenge our current technology in some manner can consider as Big Data - Volume- Communication- Speed of Generating- Meaningful Analysis
An example of big data might be petabytes (1,024 terabytes) or exabytes (1,024 petabytes) of data consisting of billions to trillions of records of millions of people -- all from different sources
5
MAPREDUCE
Raw Input: <key, value>Raw Input: <key, value>
MAPMAP
<K2,V2><K2,V2><K1, V1><K1, V1> <K3,V3><K3,V3>
REDUCE REDUCE
Zeta-Byte Horizon
2012 2020
x50
As of 2009, the entire World Wide Web was estimated to contain close to 500 exabytes. This is a half zettabyte the total amount of global data is expected to grow to 2.7 zettabyte during 2012. This is 48% up from 2011
BIG DATA TECHNOLOGIES
BIG TABLE
BUSINESS INTELLIGENCE
CLOUD COMPUTING
DATA MART
DATA WAREHOUSE
DYNAMO
ETL
GOOGLE FILE SYSTEM
METADATA
DISTRIBUTED SYSTEM
14
Usage Example of Big Data(US 2012 Election)
16
predictive modeling mybarackobama.com drive traffic to other campaign sites Facebook page (33 million "likes")YouTube channel (240,000 subscribers and 246 million page views).Every single night, the team ran 66,000 computer simulations, Read it.Amazon web services
data mining for individualized ad targetingOrca big-data appYouTube channel( 23,700 subscribers and 26 million page views)
Ace of Spades HQ
WHAT IT ENSURES?
CREATING TRANSPARENCY
ENABLING EXPERIMENTATION TO DISCOVER NEEDS, EXPOSE VARIABILITY, AND IMPROVE PERFORMANCE
SEGMENTING POPULATIONS TO CUSTOMIZE ACTIONS
REPLACING/SUPPORTING HUMAN DECISION MAKING WITH AUTOMATED ALGORITHMS
INNOVATING NEW BUSINESS MODELS, PRODUCTS, AND SERVICES
18
22
CRITIQUES
EROSION OF PRIVACY
PRONE TO ERRORS
LESS TIME TO CLEAN DATA
PIVOT –POINT MOMENT FOR MARKETTING & SALES
25
SYNOPSIS
NEW EVOLVING ECOSYSTEM.
LINK BETWEEN IT AND PRODUCTIVITY
COMPETATIVE WEAPON
TACKLES COST AND DATA INTEGRATION
26
Bibliography
en.wiki.com Insight & Publication IBM website
Webopedia McKinsey Quarterly, Oct 2011, McKinsey Global
Institute