business intelligence in the era of big data

28
BI in the Era of Big Data JC Raveneau March 2014

Upload: jc-raveneau

Post on 30-Jun-2015

180 views

Category:

Software


1 download

DESCRIPTION

Learn about the challenges of big data, common use cases and the SAP BI Solutions for big data

TRANSCRIPT

Page 1: Business intelligence in the era of big data

BI in the Era of Big Data JC Raveneau

March 2014

Page 2: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 2

Companies are missing new signals

Page 3: Business intelligence in the era of big data

Big Data Today GE engines in 2013

“These engines

generate 1Tb of data

per aircraft per day”

Jeff Immelt – CEO GE

Keynote for Minds +

Machines 2012 talking

about the new LEAP

engine

Page 4: Business intelligence in the era of big data

Primary Big Data Platform Scenarios

Providing insight from machines, assets,

and devices for better real-time decisions,

predictions, and operational performance

Machine Data Insight Omnichannel Data

Insight

Sensors M2M

Mobile IoT

Assets Processes

Unstructured Multi-media

Real-time

Geospatial Voluminous Data

Enterprise Data

Social

Providing insight from high volume and high

variety data for real-time analytics &

actionable intelligence

Page 5: Business intelligence in the era of big data

Big Data Examples

Instantly predict market trends

and customer needs

Predict how market price volatility

will impact your production plans

See changes in demand or supply

across your entire Supply Chain

immediately

Monitor and analyze all deviations

and quality issues in your

production process

Provide exactly the right offers

and service levels to every

customer

Have a continuously-updated

window into future sales, showing

changes in real time

Understand what your customers

and potential customers are

saying about you, right now

Predict cash flows to manage

collections, risk and short-term

borrowing in real time

5

Page 6: Business intelligence in the era of big data

BIG DATA GIVES SHOPPERS FASHION ADVICE TO FIT THEIR STYLE

Page 7: Business intelligence in the era of big data

7 © 2013 SAP AG or an SAP affiliate company. All rights reserved.

REAL-TIME OFFERS. INCREASE REVENUE WITH OFFERS BASED ON RECENT USER BEHAVIOUR

Page 8: Business intelligence in the era of big data

8 © 2013 SAP AG or an SAP affiliate company. All rights reserved.

LISTEN. TAP INTO THE STREAMING VOICES OF PEOPLE, PROCESSES, AND THINGS

Page 9: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 9

SAP Sentiment Intelligence

http://www.youtube.com/watch?v=ERcy0YyHmts&feature=youtu.be&t=30s

Value Proposition • Understand the local demand for products and services

• Evaluate impact of marketing campaigns and events

• Get early warning of product defects and shortfalls

• Channel and market-specific customer concerns and delights

Result • Creation of promotional campaigns to shape customer demand

• Intelligence about new product development, design, cross-sell , bundling

and product introduction

• Selection, localization, allocation, distribution, and pricing of merchandise in

all commerce channels

Page 10: Business intelligence in the era of big data

Infrastructure / Platform

Page 11: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 11 1

1

Cobbling Disparate Tools together is NOT the Answer!

David Feinleib. The Big Data Landscape

Page 12: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 12

SAP HANA Platform for Big Data

Applications Analytics

La

nd

sc

ap

e m

an

ag

em

en

t & o

rch

es

tratio

n

HANA In Memory

Mo

delin

g &

lifecycle

man

ag

em

en

t

HADOOP

SAP IQ

Ro

les, s

ecu

rity, go

vern

an

ce, c

om

plia

nce, a

ud

its

Analyze

& Apply

Accelerate

Acquire

Transactional Planning &

Simulation

Graph Analytical

SAP Industry &

LoB Apps

Partner &

Custom Apps

Spatial

Consume

Process ESP

Extended

Storage (IQ) Tiered Storage (Hot-warm-cold)

Smart Data Access

Text, Social Media Processing

Visualizations Predictive Mobile

Replication

Framework Data Services IM / MDW

Business

Intelligence

Page 13: Business intelligence in the era of big data

Big Data is Strategic to SAP

13

Page 14: Business intelligence in the era of big data

Current Solutions

SAP HANA as a Big Data Platform

Page 15: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 15

Instant Result and Infinite Storage with SAP HANA

Value Proposition

One enterprise-class platform for Big Data applications and Analytics

Real-time like never before

Federated: bring all data together under one model

Near-line and infinite storage with Sybase IQ and Hadoop

Use Cases

Real-time analysis and dashboards on transactional data or event streams (Customer testimonial)

Analyze data from different systems (ex: Optimize genome analysis with HANA, R and Hadoop at MKI)

Compute statistical models on large volumes (ex: Detect critical signals from 100 PBs of data in eBay EDW)

Page 16: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 16

HANA and SMART Data Access

Access remote information from SAP

HANA using smart data virtualization

techniques

Leverage HANA Predictive engines

Load high-value data from Hadoop rapidly

into SAP HANA for real-time analysis

Remote caching & optimized performances

Combine unstructured and structured data for

insights never seen before

Page 17: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 17

Analytics on HANA

Benefits

Simple IT landscape

ONE place for data modeling

ONE platform

Lower cost of ownership

Native access to HANA

dimensional models and

predictive capabilities

Add details

HANA Tables &

SMART DATA

Access

Information

Models

Direct access

Dashboarding and

Apps: Design Studio

Agile Visualization

Lumira, Explorer SAP HANA

Reporting:

Crystal Reports

Advanced Analytics

Analysis, Predictive

Page 18: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 18

Analytics with HANA

Benefits

Supercharge an existing SAP

BusinessObjects footprint

Speed and richness of HANA models

Real-time & CEP

Large volumes

Familiar tools and semantic layer

Short time-to-value

No additional training required

HANA Tables &

SMART DATA

Access

Information

Models

SAP HANA

UN

IVE

RS

E

Dashboarding and

Apps: Dashboards

Reporting:

Web Intelligence

Crystal Reports

Page 19: Business intelligence in the era of big data

SAP HANA: Text Analysis for Big Data

File Filtering

Unlock text from binary documents

Ability to extract and process unstructured text

data from various file formats (txt, html, xml, pdf,

doc, ppt, xls, rtf, msg)

Load binary, flat, and other documents directly

into HANA for native text search and analysis

Native Text Analysis

Give structure to unstructured textual content

Expose linguistic markup for text mining uses

Classify entities (people, companies, things, etc.)

Identify domain facts (sentiments, topics,

requests, etc.)

Supports up to 31 languages for linguistic mark-

up and extraction dictionary and 11 languages for

predefined core extractions

SAP HANA Text & Sentiment

Analysis

Search Analyze Predict

19

Page 20: Business intelligence in the era of big data

SAP ESP: Streaming Big Data

20

Analyse and act on events as they happen – by relying on real-time event-driven analytics.

With our award-winning complex event processing (CEP) platform, you can develop and

deploy business-critical applications that give you the agility you need to make quick,

profitable decisions.

Process and analyse multiple streams of high-speed,

high-volume complex event data in real time

Get actionable information from event streams and

generate alerts for events needing quick action

Initiate automatic responses to changing conditions

based on one or a combination of events

Develop applications quickly for fast ROI with the

high-performance CEP engine

Page 21: Business intelligence in the era of big data

SAP HANA: Predictive & Machine Learning

SAP HANA platform converges Database, Data Processing and Application Platform

capabilities & provides Libraries for predictive, planning, text, spatial, and business analytics

so businesses can operate in real-time.

Provide Business Analysts with sophisticated

algorithms to take the next step in

understanding their business and modeling

outcomes.

Perform statistical analysis on your data to

understand trends and detect outliers in your

business.

Build models and apply to scenarios to forecast

potential future outcomes

Combine, manipulate and enrich data to apply

it to your business scenarios. Self-service

visualizations and analytics to tell your story

21

Page 22: Business intelligence in the era of big data

Current Solutions

SAP BusinessObjects solutions on Hadoop

Page 23: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 23

Stand Alone Big Data Analytics

Value Proposition

Expand your BI Platform to Big Data

Immediate and familiar access via the semantic layer

Enable all BI clients

Leverage the modeling power of the Universe

Use Cases

Anything SQL-Like.

Page 24: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 24

The BI Portfolio and Hadoop

Universe access to Apache Hadoop & EMR

Hive supported via JDBC drivers

Enables Hadoop access to all BI Clients in

the suite

Crystal Reports 2013 offers additional direct

connectivity to Apache Hive JDBC and

Simba HIVE ODBC

SAP Lumira 1.13+ offers direct connectivity

to HIVE via the Apache JDBC driver

See the PAM for version details

Via

HIV

E 0

.10

with

Lu

mira

1.1

3 C

rysta

l Rep

orts

via

JD

BC

& O

DB

C

Page 25: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 25

Access functionality in BI 4

Hive is seen as a relational database

A Universe is built using HiveQL language

Ability to:

Retrieve data in the report of server memory and run local calculations

Push calculations down to the HIVE engine

Build multi-source universes (federation between HIVE and other sources)

Page 26: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 26

CURRENT SOLUTIONS OVERVIEW

Data Integration

Log Files

Text Data

Sources

Structured Data

Sources

SAP HANA Platform

SAP

BusinessObjects BI

SAP Sources Non-SAP Trans 1

Non-SAP Trans 2

BI Universe

Available with DS 4.1

SAP HANA smart data access

Available with SAP HANA SPS6

Available with BI 4.0 FP3*

Hadoop

* BI 4.0 FP3 for single-source universe

BI 4.0 FP5 for multi-source universe

SAP Lumira Desktop

Via HIVE 0.10 with Lumira 1.13

Page 27: Business intelligence in the era of big data

© 2013 SAP AG or an SAP affiliate company. All rights reserved. 27

Roadmap

Build on the Big Data Platform Leverage SQL-Like Access Self-Service Big Data

Thanks to in-memory, predictive,

federation and more, SAP HANA

offer un-preceded opportunities for

big data analytics.

SQL-like access via *DBC drivers

offer opportunities to embrace

emerging big data sources with

existing investments.

The variety of big data also means

new formats, new paradigms and

new opportunities.

We’ll keep driving innovation end-

to-end, from data to analytics in

order to help customers get the

most value out of their big data

We’ll selectively extend the support

to big data sources based on their

technical maturity and market

demand

Our research projects are driven by

the objective to mine big data for

more value, quicker and at a lower

cost

Page 28: Business intelligence in the era of big data

28

http://www.sapbigdata.com/analytics/

http://www.sapbusinessobjectsbi.com

For More Information

Contact information:

JC Raveneau

Sr. Director, Big Data Analytics