QUANTIFYING THE VALUE OF DATA

H E M A L G A N D H I D I R E C T O R O F D ATA E N G I N N E R I N G

What is your Data ROI?

If you are brave enough to answer

How do you know?

We need to measure data.

Challenges

Process and Organization

Process and Organization

Investments

Compliance Issues

Missing Framework

Technology

Technology

Collection Silos

Limited Usage Patterns

Tightly coupled to data

structures

Strategic Value

Compliance

Time Value

Dependencies

Business Impact of Data

Cost of Data

Storage Finding Insights Integration Maintenance

Treat Data as a Strategic Asset

Data Identity

Categorize Data

Direct Value

Real Time Pricing

Real Time Bidding

Marketing Campaigns

Personalization

Item Availability

Relevance

Indirect Value Vs.

Inventory Optimization

Sales Transaction

Fraud Resolution

Product Management

Top Sellers

•  Does it have revenue impact : Yes/No

•  Is it critical for business : Yes/No

•  Is it compliance related data : Yes/No

•  Does it have external dependency: Yes/No

Categorize Data

Categorize Data

Compliance/Security

Strategic/ Business Critical

Revenue Impacting

Customer Impact

Impact Type

Last Access Metrics

Cost/Year …..

Customer Data Y Y Y Y Direct 1 Day $10000

Sales Transaction

Clickstream

Social

Sensor

Geo Spatial

Product Information

………

Collecting Patterns

Data Platform : Architecture

May 21, 2015 19

Data Quality Service (Data Lineage & Profiling)

Security Scheduling & Cluster Monitoring

Applications & Visualization Tools

Dredge

Collection

• Apache Flume • Sqoop

Flow

• Kafka • Spark

Processing

• PIG • Spark • Map Reduce

Storage

• Hive • HBase • Vertica

Delivery

• Looker • Tableau • Visualization (d3.js) •  Email/FTP

Data Platform

Data Access Abstraction

DAA is a abstraction layer for collecting data access patterns, enabling loosely coupled access to data.

WHAT IS DATA ACCESS ABSTRATION

DAA Logical Flow & Architecture

Data Storage

Data Access API Data Ingestion Framework

Data Producers

Usage Patterns Storage

Data Consumers Usage Pattern Viewer

Data Telemetry

DAA

Data Access API

Request Manager

Data Formatter Query Service

Source End

Points Dredge

Events Management Log Streaming Configuration Abstraction

Delivery Service

Data Ingestion Framework

End Point Adapter Data Adapter

Data Consumers/ Producers

Data Consumers

What is your Data ROI?

Now You can answer…

Collect Patterns

Categorize Data

Data Identity