ibm: turning big data into big insights

22
1 #SmarterBiz The D e a l Turning Data Into Insights… and Insights Into Revenue About Andrew Manby Director, Marketing Big Data & Analytics, IBM Software

Upload: ibm

Post on 22-Nov-2014

444 views

Category:

Data & Analytics


3 download

DESCRIPTION

IBM's Andrew Manby on how to turn multiple incoming data points into actionable enterprise insights that drive results to the bottom line. Presented at the Smarter Business summit in Montreal, Sept 17, 2014.

TRANSCRIPT

Page 1: IBM: Turning Big Data into Big Insights

1 #SmarterBiz

Th

e Deal

Turning Data Into Insights…

and Insights Into Revenue

About

Andrew ManbyDirector, Marketing Big Data & Analytics, IBM Software

Page 2: IBM: Turning Big Data into Big Insights

2 #SmarterBiz

The Cost of Curiosity Has Been Lowered

2

“IBM gave us an opportunity to turn our plans into something that was very tangible right from the beginning. IBM had experts within data mining, Big Data, and Apache Hadoop and it was clear to use from the beginning we wanted to improve our business, not only today, but also prepare for the challenges we will face in three to five years, we had to go with IBM.” – Lars Christian Christensen VP Plant Siting & Forecasting

Page 3: IBM: Turning Big Data into Big Insights

3 #SmarterBiz

Paradigm Shifts Enabled by Big DataLeverage more of the data being captured

Traditional Approach Big Data Approach

Analyze small subsets of data

Analyze all data

Analyzedinformation

All available information

All available informationanalyzed

Page 4: IBM: Turning Big Data into Big Insights

4 #SmarterBiz

Paradigm Shifts Enabled by Big DataReduce effort required to leverage data

TRADITIONAL APPROACH BIG DATA APPROACH

Govern Data to the Highest Standard, Store

it, then use it for multiple purposes

Understand data and usage, govern to the

appropriate level, use it, and iterate

RepositoryGovern to

PerfectionUseData

DataUndersta

nd

Govern Appropriately

Use

Page 5: IBM: Turning Big Data into Big Insights

5 #SmarterBiz

Paradigm Shifts Enabled By Big DataData leads the way—and sometimes correlations are good enough

Start with hypothesis and test against

selected data

Explore all data andidentify correlations

Hypothesis Question

DataAnswer

Exploration

CorrelationInsight

Traditional Approach Big Data Approach

Data

Page 6: IBM: Turning Big Data into Big Insights

6 #SmarterBiz

Paradigm Shifts Enabled By Big DataLeverage data as it is captured

Analyze data after it’s been processed and

landed in a warehouse or mart

Analyze data in motion as it’s generated, in

real-time

Data

Insight

AnalysisRepositor

y InsightAnalysisData

Traditional Approach Big Data Approach

Page 7: IBM: Turning Big Data into Big Insights

7 #SmarterBiz

Big Data ExplorationFind, visualize, and understand all big data for improved decision making

Enhanced 360o Viewof the CustomerView all internal and external information sources to know everything about your customers

Operations AnalysisAnalyze a variety of machine data for improved business results

Data Warehouse ModernizationModernize the data warehouse with new technology: in-memory, stream computing, Hadoop, appliances, while building confidence in all data

Security Intelligence ExtensionLower risk, detect fraud and monitor cyber security in real-time

Key Uses for Big Data

Page 8: IBM: Turning Big Data into Big Insights

8 #SmarterBiz

Integrate and Govern all Data Sources

Integration, Data Quality, Security, ILM, MDM

A Big Data and Analytics Platform Manifesto

Manage Streaming Data Stream Computing

Understand and Navigate Federated Big Data Sources

Discovery and NavigationPlanning/Forecasting

Manage and Store Huge Volume of any Data

Hadoop File SystemMapReduce

Content Management

Analyze Unstructured Data Text Analytics EngineContent Analytics

In-Memory AnalyticsData Warehousing

Structure and Control Data

IBM WATSON

FOUNDATIONS

Page 9: IBM: Turning Big Data into Big Insights

© 2013 IBM Corporation9

• Depart faster – finish slower• Backtracking• Higher cost• End up somewhere else

• Direct• Faster • Cheaper

Because you had a plan

InfoSphere Guardium

InfoSphere Optim

Page 10: IBM: Turning Big Data into Big Insights

10 #SmarterBiz

Complete Integration of Data Privacy and Security

De-indentify sensitive data on

demand

Deploy centralized controls for real-time monitoring

Encrypt data with negligible

performance impact

Remove sensitive data from

documents

Automate detection of

sensitive data

Mask with pre-build functions or customize

Mask consistently across systems

Policy-based controls to detect unauthorized activity

Vulnerability assessment & change auditing

Encrypt files and structured data

Unify policy and key management for central administration

Increase efficiency via automation and reduce cost of manual redaction

Control the data viewed by each user

Classify sensitive data types

Discovery hidden data relationships

Optim Discovery & Guardium

Optim Data Masking & Data Privacy for Hadoop

Guardium Activity Monitoring

Guardium Data Encryption

Guardium Data Redaction

Discover & classify sensitive data

Mask structured & unstructured data

Monitor database & hadoop activity to

assess vulnerabilities

Encrypt structured and unstructured

data

Redact data in documents & forms

Page 11: IBM: Turning Big Data into Big Insights

© 2014 IBM Corporation

11

Multimedia

Data Warehouse

Web Logs

Social Data

Sensor data:images

RFID

Internal AppData

TransactionData

MainframeData

OLTP System Data

Traditional Sources

ERP Data

StructuredRepeatable

Linear

UnstructuredExploratory

Dynamic

Text Data:emails

Hadoop andStreams

NewSources

InfoSphere Information Server and MDM Server

Page 12: IBM: Turning Big Data into Big Insights

What Differentiates IBM’s Hadoop Offering?

BigInsights(Blue Suit Hadoop)

Pure Open Source Code

+Optional Enterprise

Class Closed IP Extensions

IBM Support

+=

Analysis– Native SQL interface– Native R interface– Text analysis toolkit– Social analysis toolkit– Spreadsheet style analysis GUI

Development lifecycle– Cluster aware Eclipse plug-ins– App Store for Hadoop

Data Exploration– Indexing and faceted search– Search-based applications

Management– Enterprise file system

• Advanced replication• Multi-temp storage• POSIX controls

– Grid management• Mature resource manager• Multi-tenant workload support

Baked-in security– LDAP– Role-based authorization– Perimeter security with reverse-proxy

Page 13: IBM: Turning Big Data into Big Insights

BigSQL

BigInsights is More than Hadoop

Full Application Platform

BigSheets

HA

GP

FS

-FP

O

Ad

ap

tiv

e M

R

SECURE

Page 14: IBM: Turning Big Data into Big Insights

DataClick

Match

of recordsMillions

BigMatch

BigInsights is More than Hadoop

2 Click Data

Access

Page 15: IBM: Turning Big Data into Big Insights

15

Page 16: IBM: Turning Big Data into Big Insights

16 #SmarterBiz

Simplify: Turnkey Analytics

Integrate the server, storage and database into one optimized package

Move complex analytics into the database

Integrated, high performance analytics within the data warehouse ServerServer

StorageStorage

DatabaseDatabase

AnalyticsAnalytics

Page 17: IBM: Turning Big Data into Big Insights

001101010010010010011010010101001110010100111100100010010001001000100010010101011001100011101001001001001110001001010010010110010010100110010010100100101010001001001100100101001001010100010010110001001010010010110010010100110010010100100101010001001001100100101001001010100010010

Opp

ortu

nity

Cos

t Sta

rts

Her

e

01100100101001001010100010010011001001010010010101000100101100010010100100101100100101001100100101001001010100010010011001001010010010101000100100110010010100100101010001001001100100101001001010100010010011001001010010010101000100101100010010100100101100100101001100100101001001010100010010011001001010010010101000100100110010010100100101010001001011000100101001001011001001010

AdaptiveAnalytics

Model

BootstrapEnrich

Data Ingest

Page 18: IBM: Turning Big Data into Big Insights

Chicken Dinner Demo

Page 19: IBM: Turning Big Data into Big Insights

IBM delivers a governable, consumable Big Data platform

that’s steeped in analytics for data in-motion and data at-rest.

Page 20: IBM: Turning Big Data into Big Insights

20 #SmarterBiz

90%Increased

Transaction Capacity

90%Increased

Transaction Capacity

$1BSavings from accurately

predicting ice flows

$1BSavings from accurately

predicting ice flows

98%Decrease timeto analyze data98%

Cut in StorageRequirements

98%Cut in StorageRequirements

$1M Estimated Cash

Savings

$1M Estimated Cash

Savings

72%Reduction in

Fraudulent Claims

72%Reduction in

Fraudulent Claims 60XFaster Query Performance

The Opportunities from Big Data & Analytics are Infinite

40X Analysis

Performance Gain

40X Analysis

Performance Gain

Page 21: IBM: Turning Big Data into Big Insights

© 2014 IBM Corporation21

Page 22: IBM: Turning Big Data into Big Insights

Got Questions?

Stop by the Social Café

Visit: – IBM Big Data & Analytics – ibm.com/bigdata&analytics

– IBM Big Data Hub - ibmbigdatahub.com

Andrew ManbyDirector, Marketing Big Data & Analytics, IBM [email protected]@andrewmanby