real-time analytics with azure, datazen, powerbi & stream...

19
Data Platform Airlift 21 de Outubro \\ Microsoft Lisbon Experience Real-time Analytics with Azure, DataZen, PowerBI & Stream Analytics Rui Quintino

Upload: others

Post on 20-May-2020

30 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

Data Platform Airlift21 de Outubro \\ Microsoft Lisbon Experience

Real-time Analytics with Azure, DataZen, PowerBI& Stream Analytics

Rui Quintino

Page 2: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

Real-Time Analytics & Business Intelligence

•Why?•How?

Real-Time Analytics in Microsoft Data Platform:#Azure#PowerBI#StreamAnalytics#Datazen #SqlServer#SignalR #EventHubs #ServiceBus(note: also very relevant , but not covered : AzureML, APS,Storm, Spark, HDInsight,…)

•Q&A

Page 4: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

Information

explosion,

new insights

90%of the world’s data has been created

over the last two years alone1

Shift to cheaper,

faster computing,

on demand

45%of total IT spend will be

cloud-related by 20202

Increasingly

data-savvy

workforce

5XCompanies that use analytics

are 5x more likely to make decisions

faster than competitors3

Transformative opportunity

41. IDC. 2. Josh Waldo Senior Director, Cloud Partner Strategy, Microsoft. 3. Bain & Company, The Value of Big Data: How Analytics Differentiates Winners, 2013.

Page 5: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

The ROI of Data

Source: IDC Study: Realizing the Data Dividend, 2014.

The formula

[data + analytics + people ]

@

speed

Key Opportunity

AreasOrganizations can realize

Return on Data in several

key areas…

Productivity

Includes strategic

planning, human

capital management,

IT optimization

Operations

Includes demand

and supply chain

management,

logistics

Return

on Data

$674

billion

Return

on Data

$486

billion

Return

on Data

$158

billion

$235

billion

$1.6 trillionReturn on Data

5

Return

on Data

Customer

Facing

Includes customer

acquisition, retention,

support and pricing

Innovations

Includes service,

research and

development

innovation

Page 6: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

What are customers wanting to do?

Page 7: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

Who is using Real-Time Analytics

http://tdwi.org/research/2014/09/best-practices-report-real-time-data-bi-and-analytics/asset.aspx?tc=assetpg

Page 8: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

Partners / Subscribers

Microsoft Botnet Analytics – Architecture

• Processing 200M+ transactions per day and growing

• 566,773,255 calls a day from over 25 million distinct IP address

• Query results returned in under 2 seconds

[Sinkhole]

SQL Server

Internet with

billions of devices

Microsoft

Analytics

Platform System

Visualizations

& insights

Certs

ISPs

Others

Excel & Power BI

Azure

HDInsight

Azure

Machine LearningInternet with

billions of devices

Page 9: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

Real-Time Analytics at Microsoft Microsoft Xbox team enhances game for HALO customers

The situationThe HALO contest promotion

team wanted to use data to

create a better gamer experience

for customers playing the new

HALO 4.

The solutionNon-technical employees

processed & analyzed raw data in

Real-Time to answer their

questions, using familiar and

powerful tools

The benefitsThe team quickly uncovered and

addressed the unexpected

(cheating), while also using

insights to update and improve

gamer experience.

The process

Analyze raw data

Identify trends

Make updates

Improve CSAT

The toolsExcel SQL Server

Windows Azure HD Insight

Page 10: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT
Page 11: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT
Page 12: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT
Page 13: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

1-Real-time Analytics with #Azure #Datazen

•Elastic Scale & Load• the *amazing* Azure platform

•Datazen platform• Powerfull /easy to build Dashboards• Public viewer available•Multi platform /device render engine• Licensing

•Challenges• Closed product, no Real-time support, scale

Page 14: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

2-#PowerBI real-time dashboards

•#PowerBI-State of art analytics platform

•Rest API enabled

•Near zero-development realtime dashboards

•Low throughput scenarios, •~hundred/rows /sec

•Team/Enterprise-no public sharing (yet)

Page 15: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

3-Real-time #PowerBI #Azure #StreamAnalytics

• IoT

•Huge capacity for ingestion: event hubs

•Huge capacity for live stream analytics

•Rapid Development, configure in minutes

•Elastic scale with Azure, Fully managed

•Realtime dashboards with PowerBI

•Realtime dashboards with SignalR/HTML5

Page 16: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT
Page 17: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT
Page 18: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT

Free Azure

Trial

Try SQL Server

2016 CTP2http://aka.ms/trysql2016

http://aka.ms/tryazureUse Power BI for Free

http://powerbi.microsoft.com

Page 19: Real-time Analytics with Azure, DataZen, PowerBI & Stream ...download.microsoft.com/.../Data-Platform-AirLift-RealTime-Analytics.pdf3-Real-time #PowerBI #Azure #StreamAnalytics •IoT