azure services for iot, big data and predictive analytics · azure services for iot, big data and...

17
Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi Data Service Solution Architect 20+ years in Software Industry 7+ years in Cloud Platforms MSCS, MSIS, MBA, MCA 50+ professional certs

Upload: others

Post on 12-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Azure Services for IoT, Big

Data and Predictive Analytics

Damodar Panigrahi – Data Service Solution Architect

• 20+ years in Software Industry

• 7+ years in Cloud Platforms

• MSCS, MSIS, MBA, MCA

• 50+ professional certs

Page 2: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

• Why now?

• What’s available?

• How to execute an IoT project?

• What’s next?

Agenda

Page 3: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Why now?

• Customers are Ready

• Businesses are Ready

• Cloud Infrastructure is available

Page 4: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Customers are Ready

• Customers are ready to share data

• Individual: Wearables (Bands, Watches, self-driving cars, etc.)

• Healthcare: sensors that provide patients’ real-time vital signs

• Family: IoT enabled refrigerators

• …The Internet of Things Will Thrive by 202583% say yes (~2000 experts interviewed)

Sources - Zacks Equity Research. (Jan 5, 2016). Samsung Unveils IoT-Enabled Next-Gen Smart Refrigerator. https://www.zacks.com/stock/news/202854/samsung-unveils-iotenabled-nextgen-smart-refrigerator- Anderson, Janna; Rainie, Lee (May 14, 2014). The Internet of Things Will Thrive by 2025. http://www.pewinternet.org/2014/05/14/internet-of-things/

Page 5: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Businesses are Ready

Sources - Ransbotham, Sam. (Dec 22, 2015). Ready or Not, Here IoT Comes. MIT Solan Management Review. http://sloanreview.mit.edu/article/ready-or-not-here-iot-comes/- Burt, Jeffery. (May 9, 2015). Businesses Are Getting Ready for the IoT, Survey Finds. http://www.eweek.com/networking/slideshows/businesses-are-getting-ready-for-the-iot-survey-finds.html- Heath, Nic. (Mar 16, 2015). From connected cows to everlasting elevators: How businesses are using machine learning. http://www.techrepublic.com/article/from-connected-cows-to-everlasting-elevators-how-businesses-are-using-machine-learning/

• “Ready or Not, Here IoT Comes”

• “IoT is here, it's growing and it's going to have a significant impact on business going forward.”

• Fujistu’s “Connected Cow” IoT

• German-based ThyssenKrupp’s “Keeping elevator’s running”

• Kaiser Permanente’s “Anywhere, anytime patient care”

• Swedish-based Aerocrine’s “IoT Helps Asthma Patients Breathe Easily”

• Take first mover advantages!!!

Page 6: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Cloud Infrastructure is available

Source - Microsoft. (July 19, 2016). Earnings Release FY16 Q4. https://www.microsoft.com/en-us/Investor/earnings/FY-2016-Q4/press-release-webcast

• IDC predicts that by 2020, 90% or more of all IoT data will be on cloud platforms

• Microsoft’s Azure, other cloud providers.

– Revenue grew 102%, doubling, year-over-year

– Commercial cloud annualized revenue run rate exceeds $12.1 billion

Page 7: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

What’s available?

• Characteristics of IoT

• IoT Architectural patterns & design considerations

–Lambda

–Service Assisted Communication

• Azure Data Services

• Cortana Intelligent Suite

Page 8: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Lambda Architecture

http://lambda-architecture.net/

All datadispatched to the

batch layer and the speed layer

1

I. manages the master datasetII. pre-computes the batch views.

2

Indexes the batch views

Compensates latency.Deals with latest data only.

3

4

Merge results from batch view and real-

time view

5

Page 9: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Service Assisted Communication (SAC)

(CG)NATFirewall

Router

Isolated Network

Service Gateway

Client

Port Mapping is automatic, outbound

Device does notactively listen for unsolicited traffic

No inbound ports open, attack surface is

minimized

Public address, full and well defendable server

platform

Q

Q

Device Identity Registry/Directory

Connections are device-initiated and outbound

Field Gateway

Access Control Policies

http://blogs.msdn.com/b/clemensv/archive/2014/02/10/service-assisted-communication-for-connected-devices.aspx

Page 10: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

How to execute an IoT Project?

Activities/Components• Device registration

• Device identity management

• Bi-directional/Multiplex

• High Scale Ingestion

• Hot Path/Cold Path/Interactive Path

• Report/Publish

• Message Feedback and Monitoring

Tasks

Solution

Approach

Build Hybrid BuyOROR

Strategy – How?

Strategy – What?

Page 11: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Build – Device Reg/Process/Store/Publish/Mgmt/etc

Webapp

(PaaS)

VM

(IaaS)

OR

Event Hub

ASA

OR

Storm

SA

SA

Webapp

(PaaS)

VM

(IaaS)

ORBackup

Message Feedback

Scale - Management

High Availability

Etc…

OR

Page 12: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

What next?

Page 13: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

IoT + BigData + Predictive Analysis…Huh???

BigData Science???

Page 14: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Data is a key strategic asset

$1.6TAdditional business value captured

by companies that are leaders in

using data assets to their advantage

Source: IDC, 2014

10%Percent of organizations expected

to have a highly profitable business

unit specifically for productizing and

commercializing their data by 2020

Source: Gartner, 2016

Page 15: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Here is how successful companies

are staying ahead…

Exploring new business opportunities with data-driven services

Improving visibilityand making accurate predictions with remote monitoring

Getting the right products to the right places with inventory management

Offering customers exactly what they want, when they want it, with personalization

Fixing problems proactively before they start with predictive maintenance

Page 16: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+

Get the right products to

the right places

JJ Food Service optimizes theirsupply chain

“With Azure Machine Learning, the wow factoris huge. Customers are amazed that we can

predict so accurately what they need.”

Mushtaque Ahmed,COO, JJ Food Service

ScenarioOutdated legacy systems | Manual processes |Lack of supply chain visibility

Solution

Dynamic AX end-to-end with Azure Machine Learning analyzing real-time and historical customer data to create predictive shopping lists and provide product recommendations based on cart contents

Result

• Accurate predictions of customers’ needs• IoT-enabled cab sensors• Arrival of foods in peak condition• Increase in basket value through upsell with decreased

checkout times

https://www.youtube.com/watch?v=q2Ebn9TSK-I

Page 17: Azure Services for IoT, Big Data and Predictive Analytics · Azure Services for IoT, Big Data and Predictive Analytics Damodar Panigrahi –Data Service Solution Architect • 20+