building confidence in big data - ibm smarter business 2013
DESCRIPTION
Success with big data comes down to confidence. Without confidence in the underlying data, decision makers may not trust and act on analytic insight. You need confidence in your data – that it’s correct, trusted, and protected through automated integration, visual context, and agile governance. You need confidence in your ability to accelerate time to value, with fast deployments of big data appliances. Learn how clients have succeeded with big data by building confidence in their data, ability to deploy, and skills. Presenter: David Corrigan, Big Data specialist, IBM. Mer från dagen på http://bit.ly/sb13seTRANSCRIPT
© 2013 IBM Corporation
Building Confidence in Big Data
David CorriganDirector of Product Marketing, InfoSphere, IBM
2 IBM Confidential
“Data is the New Oil”
2
“We have for the first time an economy based on a key resource [Information] that is not only renewable, but self-generating. Running out of it is not a problem,
but drowning in it is.”– John Naisbitt
Harvesting any resource requires Mining, Refining and Delivering
Big Data is the next Natural Resource
The Era of Big Data Demands Confidence
Volume Variety Velocity Veracity
Data at ScaleTerabytes to
petabytes of data
Data in Many FormsStructured, unstructured,
text, multimedia
Data in MotionAnalysis of streaming data to enable decisions within
fractions of a second.
Data UncertaintyManaging the reliability and predictability of inherently
imprecise data types.
Success With Big Data Comes Down to Confidence
…Before you acton insight
…Before you start a big data project
…To maximize thevalue from big data
Confidence in Your Data
Confidence in Accelerating
Value
Confidence in Your Skills
IBM’s Latest Innovations Build Big Data Confidence
InfoSphere Integration & Governance
for Big Data
PureData System for Hadoop
Big Data Stampede
• Automated integration
• Visual context to understand data
• Agile governance to protect sensitive big data
Confidence in your Data
• Appliance simplicity for Hadoop systems
• Appliance speed - Get up and running in hours
Confidence in Accelerating Value
• All the resources needed to get value from big data quickly
• Software, expertise and skills
Confidence in your Skills
IBM’s Big Data PlatformA Holistic and Integrated Approach to Big Data & Analytics
CONSULTING and IMPLEMENTATION SERVICES
Performance Management
Content Analytics
Decision Management
Risk Analytics
Business Intelligence and Predictive Analytics
ANALYTICS
Information Integration and Governance
BIG DATA PLATFORMContent
ManagementData
WarehouseStream
ComputingHadoop System
SECURITY, SYSTEMS, STORAGE AND CLOUD
Sales Marketing Finance Risk IT Operations HR
SOLUTIONS
Watson and Industry Solutions
CONSULTING and IMPLEMENTATION SERVICES
Performance Management
Content Analytics
Decision Management
Risk Analytics
Business Intelligence and Predictive Analytics
ANALYTICSPerformance Management
Content Analytics
Decision Management
Risk Analytics
Business Intelligence and Predictive Analytics
ANALYTICS
Information Integration and Governance
BIG DATA PLATFORMContent
ManagementData
WarehouseStream
ComputingHadoop System
SECURITY, SYSTEMS, STORAGE AND CLOUD
Sales Marketing Finance Risk IT Operations HR
SOLUTIONS
Watson and Industry Solutions
Sales Marketing Finance Risk IT Operations HR
SOLUTIONS
Watson and Industry Solutions • Broadest set of capabilities across big data and analytics
• Pre-integrated components accelerate time to value
• Pre-built industry and horizontal solutions
• Delivered in multiple forms: software, appliance, and cloud
• Only vendor with embedded integration & governance capabilities
The Whole is Greater Than the Sum of the Parts
Astron uses streaming analytics to deliver insight from the world’s largest radio telescope
Need
• The institute needed to develop a resource- and energy-efficient way for astronomers to analyze an unprecedented amount of unstructured data from what is designed to become the largest radio telescope ever built
Benefits
• Accelerates the identification of relevant images and data by approximately 99%, making the information available to astronomers in minutes as opposed to several days
• Integrates data from more than 3,000 dishes and antennas that make up the largest and fastest radio telescope in the world
77 Home
By 2015, 80% Of All Available Data Will Be UncertainG
loba
l Dat
a Vo
lum
e in
Exa
byte
s
Multiple sources: IDC,Cisco
100
90
80
70
60
50
40
30
20
10 Aggr
egat
e U
ncer
tain
ty %
9000
8000
7000
6000
5000
4000
3000
2000
1000
0 2005 2010 2015
Sensors
Enterprise Data
VoIP
Social media
Internet of things
Video, Audio and Text
Rising Uncertainty = Declining Confidence
1 in 3Make decisions onuntrustworthy data
1 in 2Lack the information
that they need
60%Have too much data
Innovations in Information Integration and Governance
VisualContext
Agile Governance
Automated Integration
Information Governance DashboardImmediate, visual context for critical decisions Understand big data to leverage it better
InfoSphere Privacy & SecurityFind and protect sensitive big dataSingle point of security for traditional, NoSQL & big data
InfoSphere Data ClickSelf-service access to a growing variety of big data in traditional, NoSQL and Hadoop sources
2 ClickData
Integration
170xFaster
Imports
80%Faster
Monitoring
Clients Maximize Value from Data Confidence
Improve DecisionsAct on Insight Mitigate Risk
Visual Context Agile GovernanceAutomated Integration
100%Reduced time
to deliver reports
95%Time reductionIn Information
gathering
72%Reduction inFraudulent
Claims
Let’s Simplify Big Data: Announcing IBM PureData System for Hadoop
Designed to:• Simplify the building,
deploying and management of a Hadoop cluster
• Speed the time-to-value for Hadoop and unstructured data
• Maximize the overall analytic ecosystem
• Provide enterprise security and platform management
Flume
Jaql
Hive
Pig
MapReduceHDFS
Zookeeper
Oozie
HBase
Lucene
Sqoop
HCatalog
Hadoop
Visualization
Development Tools
Admin & Security
Network
1Based on IBM internal testing and customer feedback. "Custom built clusters" refer to clusters that are not professionally pre-built, pre-tested and optimized. Individual results may vary.
Deploy
8xFaster1
Benefits of IBM PureData System for Hadoop
1Based on IBM internal testing and customer feedback. "Custom built clusters" refer to clusters that are not professionally pre-built, pre-tested and optimized. Individual results may vary.2Based on current commercially available Big Data appliance product data sheets from large vendors. US ONLY CLAIM.
Accelerate Big Data Time to Value
Simplify Big DataAdoption & Consumption
Implement Enterprise-Class Big Data
• Deploy 8x Fasterthan custom-built solutions1
• Built-in Visualizationto accelerate insight
• Built-in Analytic Accelerators2
unlike big data appliances on the market
• Single System Consolefor full system administration
• Rapid Maintenance Updates with automation
• No Assembly Required data load ready in hours
• Only Integrated Hadoop Systemwith Built-in Archiving Tools2
• Delivered with More Robust Securitythan open source software
• Architected for High Availability
PureData for Hadoop Accelerates Big Data Use Cases
• Aggregation of data
• Ad-hoc analysis
• Simple analytics/exploration
• Explore new data
• Visualize with easy, spreadsheet-style analysis
• Identify useful information and move to other systems
• Immediate storagealternative of cold data
• Cost savings for cold data
• Simple analytics/exploration
PureData System for Analytics
PureData System for HadoopPureData
System for
Hadoop
PureData System
for Analytics
Introducing Big Data Stampede:Leading the Charge for Big Data Success
IBM Expertise Big Data Platform Skills & Knowledge TransferEnsures client self sufficiency and big data capabilities
Removes the guesswork and delivers savings in time and cost
Provides the use of unmatched capabilities
Stampede
Time to insights
Research Product Selection Services
BusinessValue
Tutorials/TrainingBigInsights Quick StartExpert/BVA
BusinessValue
IBM Expertise
Use Case Selection Education & TrainingStandardRoadmap
A Year of Leadership and Innovation
Preparing for 4.4 Million Big Data Jobs in 2015
9 New Academic Collaborations
$100,000 in Awards for Big Bata Curricula
8-25x Faster Reporting & Analytics
BIG SQL,2-10x FasterStreamProcessing
8x Faster Deployment
BIG DATA PLATFORM
DB2 with BLUACCELERATION
PUREDATA SYSTEMfor HADOOP
ImprovedVisualization, Automatically Find Relevant Data
Animated Charting,Extensible Visualization
Disclosure Management,Accelerated Internal Reporting
BUSINESSINTELLIGENCE
PREDICTIVEANALYTICSfor BIG DATA
RISK, FINANCE& CLOUD
Top 5 Big Data Use CasesEach Requires Data Confidence for Success
Big Data Exploration Enhanced 360o Viewof the Customer
Operations Analysis Data Warehouse Augmentation
Security/IntelligenceExtension
Link to the case study
Http// need to get link from ibm.com
Global aerospace manufacturer empowers staff with access to critical informationNeed• Improve operational efficiencies by providing a unified
search, discovery and navigation capability to provide fast access to relevant information across the enterprise
Benefits• Placed 50 additional aircraft into service worldwide
during the first year without a staffing increase
• Saved USD36 million/year in supporting the 24/7 aircraft-on-ground program
• Provided supply chain visibility to reduce cycle time, saving millions of dollars on critical parts deliveries
1717 Home
Elisa Corporation - Adding millions of Euros in revenue with improved information services
Need
• Elisa Corporation sought a deeper understanding of customer needs as they expanded its offerings. However, its existing information services platform could not support the data-intensive analytics required.
Benefits
• Provides a platform to drive millions of Euros in new revenue
• Supports 200 to 600 times faster data analysis and 100 times faster load performance
• Delivers direct yearly cost savings of almost EUR800,000 (USD1 million)
1818 Home
IBM Big Data & Analytics Momentum
Source: IBM. Note: All numbers used are cumulative. 3/31/2013
1100 Business Partners
1640Business Partners
2215Business Partners
9thAnalytics Solution
Center Opens in Ohio
170Big data
Clients85Info Agenda Engagements
730Big Data Clients
860Info Agenda Engagement
s
1040 Big Data Clients
2,300Info Agenda
Engagements
1550Big Data Clients30,000
GBS Information and Analytics Engagements
3,810Info Agenda Engagement
s
10,000Big Data University
Enrollments
40,000Big Data University
Enrollments
101,000Big Data University
Enrollments
2010 2011 2012 2013
40,000AnalyticsZone.com
Members