technology trends for big data analytics · sas analytics refers to features of sas software that...

39
Copyright © 2012, SAS Institute Inc. All rights reserved. TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS

Upload: others

Post on 12-Mar-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

TECHNOLOGY TRENDS FOR

BIG DATA ANALYTICS

Page 2: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

WHAT IF YOU

COULD…

. . . predict the buying behavior and decision criteria of your prospects

weeks before your competition

. . . gain first-mover advantage by introducing new products and

services to micro market segments that haven't been identified by

anyone

. . . evaluate the impact of your marketing campaigns hourly and

make adjustments in real-time

Page 3: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

ANALYTICS INSIGHTS DATA

INFORMATION MANAGEMENT

DECISIONS

Page 4: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

INFORMATION

MANAGEMENT CAPABILITY VIEW

DATA SERVICES

Analytics

Management

Data

Management

DATA & ANALYTIC SERVICES

DATA GOVERNANCE ANALYTICS GOVERNANCE

DATA

INTEGRATION

ENTERPRISE DATA ACCESS

Infrastructure

Support

INFRASTRUCTURE SUPPORT:

Text & Unstructured Data Support, Events, Security, Meta-data & Lineage, Monitoring & Deployment

DATA

QUALITY MDM

DECISION

MANAGEMENT

MODEL

MANAGEMENT

&

MONITORING

MODEL

DEPLOYMENT

&

INTEGRATION

Page 5: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions.

SAS Analytics encompasses a range of techniques for collecting, analyzing, and interpreting data in order to reveal patterns, anomalies, key variables, and relationships.

We offer a comprehensive suite of analytics software to help you reduce uncertainty, to predict with precision, and to optimize performance.

SAS ANALYTICS - DEFINITION OUR PERSPECTIVE

Page 6: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

Page 7: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

Copyright © 2012, SAS Institute Inc. All rights reserved.

FORECASTING

DATA MINING

TEXT ANALYTICS

OPTIMIZATION

STATISTICS

Finding treasures in unstructured data

like social media or survey tools

that could uncover insights

about consumer sentiment

Mine transaction databases

for data of spending patterns

that indicate a stolen card

Leveraging historical data

to drive better insight into

decision-making

for the future

Analyze massive

amounts of data in

order to accurately

identify areas likely to

produce the most

profitable results

ANALYTICS

INFORMATION

MANAGEMENT

Page 8: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

EXTERNAL

VIEWPOINT CHALLENGES IN

ANALYTICS ADOPTION

Source: The Current State of Business Analytics: Where Do We Go From Here?

Prepared by Bloomberg Businessweek Research Services, 2011

Page 9: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

VOLUME

VARIETY

VELOCITY

VALUE

TODAY THE FUTURE

DA

TA

SIZ

E

THE CHALLENGE?

Page 10: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

OUR PERSPECTIVE

Big Data is RELATIVE not ABSOLUTE

Big Data

When volume, velocity and variety of data exceeds an organization’s storage or compute capacity for accurate and timely decision-making

Page 11: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

TRADITIONAL

ARCHITECTURE

ENTERPRISE ARCHITECTURE APPROACH OFTEN

NOT APPLIED TO ANALYTICS INFRASTRUCTURE

Page 12: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

Domain Expert

Makes Decisions

Evaluates Processes and ROI

BUSINESS

MANAGER

Model Validation

Model Deployment

Model Monitoring

Data Preparation

ANALYTICAL

DBA

Data Exploration

Data Visualization

Report Creation

DATA

SCIENTIST

Exploratory Analysis

Descriptive Segmentation

Predictive Modeling

DATA MINER /

STATISTICIAN

IDENTIFY /

FORMULATE

PROBLEM

DATA

PREPARATION

DATA

EXPLORATION

TRANSFORM

& SELECT

BUILD

MODEL

VALIDATE

MODEL

DEPLOY

MODEL

EVALUATE /

MONITOR

RESULTS

NEW ANALYTICS LIFECYCLE

Page 13: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

Technology

Checklist for

Big Data

Analytics

• A flexible architecture that supports many data types and usage patterns

• Upstream use of analytics to optimize data relevance

• Real-time visualization and advanced analytics to accelerate understanding and action

• Collaborative approaches to align Business and IT executives

Page 14: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

Analytic Data

Warehouse / Marts

Relational

Data Store

SAS Analyst’s

Desktops

SAS Web Reporting

Clients

SAS Metadata

Server

SAS Compute

Server

Web Application

Server

SAS BUSINESS ANALYTICS FRAMEWORK

Server Tier Web Tier Client Tier Metadata Tier Data Tier

Page 15: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

HIGH-

PERFORMANCE

ANALYTICS

KEY COMPONENTS

Page 16: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

HIGH-

PERFORMANCE

ANALYTICS

SAS® GRID COMPUTING

Page 17: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

Server Tier Web Tier Client Tier Metadata Tier Data Tier

Analytic Data

Warehouse / Marts

Relational

Data Store

SAS Analyst’s

Desktops

SAS Web Reporting

Clients

Primary

Failover

SAS Compute Nodes Web Application

Server(s)

SAS BUSINESS ANALYTICS FRAMEWORK (ADD GRID)

Page 18: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

HIGH-

PERFORMANCE

ANALYTICS

SAS® IN-DATABASE

Page 19: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

Analytic Data

Warehouse / Marts

Relational

Data Store

SAS Analyst’s

Desktops

SAS Web Reporting

Clients

Primary

Failover

SAS Compute Nodes Web Application

Server(s)

Enterprise Data Warehouse

with SAS In-Database

Analytics

SAS BUSINESS ANALYTICS FRAMEWORK (ADD IN-DATABASE)

Server Tier Web Tier Client Tier Metadata Tier Data Tier

Page 20: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

HIGH-

PERFORMANCE

ANALYTICS

SAS® IN-MEMORY ANALYTICS

Page 21: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

SAS BUSINESS ANALYTICS FRAMEWORK (ADD IN-MEMORY)

Server Tier Web Tier Client Tier Metadata Tier Data Tier

Analytic Data

Warehouse / Marts

Relational

Data Store

SAS Analyst’s

Desktops

SAS Web Reporting

Clients

Primary

Failover

SAS Compute Nodes Web Application

Server(s)

Enterprise Data Warehouse

with SAS In-Database

Analytics

Dedicated Analytics Data Warehouse with

SAS In-Memory Analytics

Page 22: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

REQUIRES ENTERPRISE

ARCHITECTURE APPROACH

BIG DATA

ANALYTICS

MARKETING

IN-MEMORY

EDW

ADW

SALES

FINANCE

SUPPLY

CHAIN

RISK

HR

Page 23: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

SAS

Enterprise Analytic

Architecture IT Value

• Superior performance and scalability

• Better data governance

• Optimal IT Resource usage

Business Value

• Highly accurate & decisive results

• Derive faster time-to-insights

• Expedite time-to-decision for

competitive advantage

Page 24: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

INFORMATION

MANAGEMENT

DECISIONS / ACTIONS / DATA

RAW RELEVANT DATA

LOW COST STORAGE

ENTERPRISE

STREAM IT, SCORE IT, STORE IT

Page 25: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

CUSTOMER

CASE STUDY TRADITIONAL ANALYTICS PROCESS

DATA EXPLORATION

MODEL DEVELOPMENT

MODEL DEPLOYMENT

3 HRS

Page 26: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

DA

TA

EX

PL

OR

AT

IO

N

MO

DE

L

DE

VE

LO

PM

EN

T

MO

DE

L

DE

PL

OY

ME

NT

CUSTOMER

CASE STUDY HIGH-PERFORMANCE ANALYTICS PROCESS

12 minutes

Past Approach • Daily process begins

with flat file creation at

6:30am – SLA delivered

at ~9:30am.

In-Database Approach • Daily process begins

at 4:00am with EDW load.

• File transferred to SQL Server,

limited to ~350K

customer records based on

specific criteria.

• All operational data loaded

directly to EDW. No flat file or

intermediate processing is

needed.

• 300 step process to support

data mining life cycle.

30 MINUTES TO SCORE ~350k

customers

• 10 step process

• Scoring and customer selection

done in-database against ALL

customer rows

4 MINUTES TO SCORE ~40M

customers

- Scope of customer analysis: 350K vs. 40M

- Monthly collections: $1M-$3M per month

Business Value

Page 27: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

CUSTOMER

CASE STUDY TRADITIONAL ANALYTICS PROCESS

DATA EXPLORATION

MODEL DEVELOPMENT

MODEL DEPLOYMENT

167 Hours

Page 28: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

84 SECONDS

DA

TA

E

XP

LO

RA

TIO

N

MO

DE

L

DE

VE

LO

PM

EN

T

MO

DE

L

DE

PLO

YM

EN

T

167 Hours CUSTOMER

CASE STUDY IN-MEMORY ANALYTICS PROCESS

Bottom-line Impact:

Tens of Millions of

Dollars

DA

TA

EX

PL

OR

AT

IO

N

MO

DE

L

DE

VE

LO

PM

EN

T

MO

DE

L

DE

PL

OY

ME

NT

MO

DE

L

DE

PLO

YM

EN

T

MO

DE

L

DE

VE

LO

PM

EN

T

DA

TA

E

XP

LO

RA

TIO

N

Page 29: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

CONCLUSION

Page 30: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

WHY DO WE CARE?

YOUR COMPETITIVE ADVANTAGE

Orient

Observe

Act

Act

Orient

Decide MARKET

OPPORTUNITY

Decide

Page 31: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

Copyright © 2012, SAS Institute Inc. All rights reserved.

Page 32: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

SAS HIGH-

PEFORMANCE

ANALYTICS

Page 33: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

SAS HIGH-

PEFORMANCE

ANALYTICS

Page 34: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

SAS HIGH-

PEFORMANCE

ANALYTICS

Page 35: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

SAS HIGH-

PEFORMANCE

ANALYTICS

Page 36: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

Trusted, analytical-based decisions are needed across the organization

IMPACT OF ANALYTICS SPANS THE ENTERPRISE

Page 37: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

HIGHEST

PRECISION

UNRIVALED

PERFORMANCE

GREATEST

DEPTH AND

BREADTH

BEST

BUSINESS

OUTCOMES

SAS® HIGH-PERFORMANCE ANALYTICS

Page 38: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyright © 2012, SAS Institute Inc. All rights reserved.

CONCLUSION Final Thoughts

Big Data represents opportunity to enhance market

leadership – how do we leverage this medium for timely

decisioning?

The analytical life cycle is accelerating – how do we help

our customers keep pace?

High-Performance Analytics is THE enabling technology

Business and IT alignment is critical to success – how

do we facilitate the establishment of common objectives

and priorities?

Page 39: TECHNOLOGY TRENDS FOR BIG DATA ANALYTICS · SAS Analytics refers to features of SAS software that offer data-driven insight for better decisions. SAS Analytics encompasses a range

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d . www.SAS.com

[email protected]