introduction to big data for labdug
DESCRIPTION
My slides for the 1st meeting of the LA Big Data User Group meetup event: "Introduction to Big Data"TRANSCRIPT
Introduction to Big Data
Daniel D. Gutierrez, Data Scientist
AMULET Analytics
March 2014
/ page 2
/ page 3
Not Everyone Likes the “Big Data” Hype
/ page 4
Volume is a Big Reason for Big Data
/ page 5
/ page 6
Economist
February 27, 2010
Profiled “Big Data”
/ page 7
Big Data
– “large data sets so big that commonly-used software tools are unable to capture,
curate, manage, and process the data within a tolerable elapsed time.”
Hadoop Dominates Big Data market
– Used widely by some of the world's largest websites,
such as Facebook, eBay, Amazon and Yahoo
– Moving into the enterprise
– Invented by developers at Yahoo!
/ page 8
What is Big Data?
Apache Hadoop
/ page 9
/ page 10
Characteristics of Big DataComponent Parts
Big Data is facilitated by Data Science
Data Science is facilitated by Machine Learning
Machine Learning is a confluence of disciplines: computer science,
mathematical statistics, probability theory, visualization, etc.
What is the “New” Part of Big Data
“Big” is new, more data to manage than ever before
Traditional data content is now coupled with internal and external sources of
unstructured data via social media
New forms of analysis such as sentiment and credibility analysis
Bubble Brewing?
Circa 2000 and the Internet bubble event. Will it occur again?
A bubble may occur, but not because of Big Data
/ page 11
Applications for Big Data
Smarter Healthcare
Multi-channel sales
Financial Services
Log Analysis
Homeland Security
Traffic Control
Telecom
Search Quality
Manufacturing
Trading Analytics
Fraud and Risk
Retail: Churn
“Big Data is the definitive source of
competitive advantage across all
industries. For those organizations
that understand and embrace the new
reality of Big Data, the possibilities
for new innovation, improved agility,
and increased profitability are nearly
endless.”
Source: Wikibon 2012
/ page 12
© 2014 AMULET Analytics. All rights reserved.
