big data and analytics - turning data into insights

35 #SmarterEnterprise

The D

eal

Turning Data Into Insights…

and Insights Into Revenue

About

David CorriganDirector, Product Marketing InfoSphere [email protected]


Four Technologies Help Define the Smarter Enterprise

BIG DATA & ANALYTICS

SOCIAL BUSINESS

ENTERPRISEMOBILITY

CLOUD COMPUTING

Client-centricDigitally-savvy

Insight-drivenEmbracing All Data

ForgeDeeper Relationships Constantly Adapt


Only

Of Available Data is UsedForrester Research: Can You Give The Business The Data That It Needs?by Michele Goetz, November 13, 2013


Paradigm Shifts Enabled by Big DataLeverage more of the data being captured

Traditional Approach Big Data Approach

Analyze small subsets of data Analyze all data

Analyzedinformation

All available information

All available informationanalyzed


Paradigm Shifts Enabled by Big DataReduce effort required to leverage data

TRADITIONAL APPROACH BIG DATA APPROACH

Govern Data to the Highest Standard, Store

it, then use it for multiple purposes

Understand data and usage, govern to the

appropriate level, use it, and iterate

RepositoryGovern to Perfection

UseData

DataUndersta

nd

Govern Appropriately

Use


Paradigm Shifts Enabled By Big DataData leads the way—and sometimes correlations are good enough

Start with hypothesis and test against

selected dataExplore all data andidentify correlations

Hypothesis Question

DataAnswer

Exploration

CorrelationInsight


Data


Paradigm Shifts Enabled By Big DataLeverage data as it is captured

Analyze data after it’s been processed and

landed in a warehouse or mart

Analyze data in motion as it’s generated, in

real-time

Data

Insight

AnalysisRepository InsightAnalysisData



90%Increased

Transaction Capacity

$1BSavings from

accurately predicting ice flows

98%Decrease timeto analyze data98%

Cut in StorageRequirements

$1MEstimated Cash

Savings

72%Reduction in

Fraudulent Claims 60XFaster Query Performance

The Opportunities from Big Data & Analytics are Infinite

40XAnalysis

Performance Gain


Invest in a big data & analytics platform

Be confident with privacy, security and governance

Imagine It. Realize It. Trust It.

Build a culture that infuses

analytics everywhere

Three Key Imperatives for Big Data & Analytics Success

44 #SmarterEnterprise*More than 20 percent increase in analytics-based jobs between now and 2018.

20%Skills Roles Mastery

Nov

ice

Bui

lder

Lead

er

Mas

ter

Imagine It. Start with your people.

U.S. Department of Labor Forecasts*


Big Data Exploration

Enhanced 360o Viewof the Customer

Operations Analysis

Data Warehouse Modernization

Security Intelligence Extension

Imagine It. Key Uses for Big Data


Information Integration & Governance

Systems SecurityOn premise, Cloud, As a service

Storage

IBM Watson Foundations

IBM Big Data & Analytics Infrastructure

New/Enhanced ApplicationsAll Data

What action should I take?

Decision management

CognitiveFabric

Realize It. Modernize Your Big Data & Analytics Architecture.

Landing, Exploration and Archive data zone

EDW and data mart

zone

Operational data zone

Real-time Data Processing & Analytics What is happening?Discovery and

exploration

Why did it happen?

Reporting and analysis

What could happen?Predictive

analytics and modeling

Deep Analytics data zone


Integrate and Govern all Data Sources

Integration, Data Quality, Security, ILM, MDM

CO

GN

ITIV

E A

NA

LYTI

CS

(Wat

son)

Realize It. A Big Data and Analytics Platform Manifesto

Manage Streaming Data Stream Computing

Understand and Navigate Federated Big Data Sources

Discovery and NavigationPlanning/Forecasting

Manage and Store Huge Volume of any Data

Hadoop File SystemMapReduce

Content Management

Analyze Unstructured Data Text Analytics EngineContent Analytics

In-Memory AnalyticsData WarehousingStructure and Control Data


© 2014 IBM Corporation48

Multimedia

Data Warehouse

Web Logs

Social Data

Sensor data:images

RFID

Internal AppData

TransactionData

MainframeData

OLTP SystemData

Traditional Sources

ERP Data

StructuredRepeatable

Linear

UnstructuredExploratory

DynamicText Data:

emails

Hadoop andStreams

NewSources

InfoSphere Information Server and MDM Server


BigInsights(Blue Suit Hadoop)

Pure Open Source Code

+Optional Enterprise

Class Closed IP Extensions

IBM Support

+=

Analysis– Native SQL interface– Native R interface– Text analysis toolkit– Social analysis toolkit– Spreadsheet style analysis GUI

Development lifecycle– Cluster aware Eclipse plug-ins– App Store for Hadoop

Data Exploration– Indexing and faceted search– Search-based applications

Management– Enterprise file system

• Advanced replication• Multi-temp storage• POSIX controls

– Grid management• Mature resource manager• Multi-tenant workload support

Baked-in security– LDAP– Role-based authorization– Perimeter security with reverse-proxy

Realize It. What Differentiates IBM’s Hadoop Offering?


DataClick

Match

of recordsMillions

BigMatch

Realize It. BigInsights is More than Hadoop

2 Click Data

Access


Realize It. Simplify: Turnkey Analytics

Integrate the server, storage and database into one optimized package

Move complex analytics into the database

Integrated, high performance analytics within the data warehouse Server

Storage

Database

Analytics


001101010010010010011010010101001110010100111100100010010001001000100010010101011001100011101001001001001110001001010010010110010010100110010010100100101010001001001100100101001001010100010010110001001010010010110010010100110010010100100101010001001001100100101001001010100010010

Opp

ortu

nity

Cos

t Sta

rts H

ere

01100100101001001010100010010011001001010010010101000100101100010010100100101100100101001100100101001001010100010010011001001010010010101000100100110010010100100101010001001001100100101001001010100010010011001001010010010101000100101100010010100100101100100101001100100101001001010100010010011001001010010010101000100100110010010100100101010001001011000100101001001011001001010

AdaptiveAnalytics

ModelFo

reca

st

Now

cast

Fore

cast

BootstrapEnrich

Data Ingest


Source: Gartner “12 Ways to Improve your Data Quality”, 2014


Trust It. Complete Integration of Data Privacy and Security

De-indentify sensitive data on

demand

Deploy centralized controls for real-time monitoring

Encrypt data with negligible

performance impact

Remove sensitive data from

documents

Automate detection of

sensitive data

Mask with pre-build functions or customize

Mask consistently across systems

Policy-based controls to detect unauthorized activity

Vulnerability assessment & change auditing

Encrypt files and structured data

Unify policy and key management for central administration

Increase efficiency via automation and reduce cost of manual redaction

Control the data viewed by each user

Classify sensitive data types

Discovery hidden data relationships

Optim Discovery & Guardium

Optim Data Masking & Data Privacy for Hadoop

Guardium Activity Monitoring

Guardium Data Encryption

Guardium Data Redaction

Discover & classify sensitive data

Mask structured & unstructured data

Monitor database & hadoop activity to

assess vulnerabilities

Encrypt structured and unstructured

data

Redact data in documents & forms


Trust It. Information Governance Delivers Confidence in Big Data & Analytics

Find It - Integrate All Sources to Leverage All Data

Secure It - Integrate All Sources to Leverage All Data

Trust It – Calculate and improve confidence

Information Integration & Governance


Trust It. Make Data Available to Everyone with A Data Refinery

Business User

Application Developer

All DataNew/Enhanced

Applications

IT & Data Stewards

Find, use, and contribute data for analysis

Embed data services into new applications

Data Refinery

Make Data Useful and Available to Everyone

Enable self-service data access and instill confidence to act on data across the enterprise


Chicken Dinner Demo


IBM delivers a governable, consumable Big Data platformthat’s steeped in analytics for data

in-motion and data at-rest.

Join us at IBM Insight 2014.

the largest big data conference in the world

sessions and innovativeStreams on Business Analytics,Enterprise Content ManagementAnd Information Management

foundnetworkingopportunitiesinvaluable

business- and industry-focused sessions featuringtop experts from around the world

technical sessions, hands- on labs and developer activities that include cloud, mobile, security, social, Watson and more

exhibitors at the EXPOIncluding showcasesfrom 250+ Business Partners

in training, certification, hands-on labs,networking, executive one-on-one meetings,expert talks and food and entertainment

client andBusiness Partner speakers fromacross all industries

IBM, the IBM logo, and ibm.com are trademarks of IBM Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at “Copyright and trademark information” at ibm.com/legal/copytrade.shtml.© Copyright IBM Corporation 2014.

attendees at the one-day Business Partner Summit

Attend IBM Insight to learn how big data and analytics can help you outperform your peers. With IBM business and technical solutions forbig data and analytics, you can turn cloud,mobile and social into competitive advantage.


Got Questions?

• Stop by the Social Café

• Download additional content from the tablets in the Social Café

• Visit: IBM Big Data & Analytics – ibm.com/bigdata&analytics

IBM Big Data Hub - ibmbigdatahub.com

David CorriganDirector, Marketing [email protected]