Microsoft’s IoT Platform….. why it matters to the data platform

Gary Hope Data Platform Technologist Microsoft South Africa

Large datavolumes

Multiple data types

Real-time data creation

User expectations

MobilityHardware and storage economics

Data Platform Tipping Points

+ +

ThingsPeopleBusine

ss

Microsoft’s IoT Platform

Is IoT even a new thing?

Command and control scenarios have much in common with some parts of IoT

But falling hardware costs, cloud services and relatively ubiquitous communications do enable new approaches and applications

Depending on who you ask, IoT is either:

Nothing new

A unicorn

1

2

Magic, and will soon change everything.

We’ve been doing this for 40 years

Cloud Based IoT Solutions

Three parts of an IoT solution

1 Device connectivity & management

2 Analytics & operationalized insights

3 Presentation & business connectivity

Easy to provision, use and manage

Pay as you go, scale as you need

Global reach, hyper scale

End to end security & privacy

Azure IoT

Windows 10 IoT Core preview available for Minnowboard Max and Raspberry Pi 2

www.windowsondevices.com

Field Gateway

Device Connectivity & Management

IoT Device & Cloud PatternsD

evi

ces

RTO

S, L

inux,

Win

dow

s, A

ndro

id, i

OS

Cloud Gateway

Event Hubs

Field Gateway

Protocol Adaptation

Event Hubs• High scale telemetry ingestion

service• HTTP/AMQP protocol support• Each Event Hub supports

• 1 million publishers• 1GB/s ingress

• Generally available worldwide• 18 Billion messages per day• 60+ TB ingested per day

Field Gateway

Device Connectivity & Management

IoT Device & Cloud PatternsD

evi

ces

RTO

S, L

inux,

Win

dow

s, A

ndro

id, i

OS

Cloud Gateway

Event Hubs

Field Gateway

Protocol Adaptation

Additional IoT Needs• Command & control• Device identity• Device registry• Device management

Coming with the Azure IoT Suite…

Field Gateway

Device Connectivity & Management

IoT Device & Cloud PatternsD

evi

ces

RTO

S, L

inux,

Win

dow

s, A

ndro

id, i

OS

Protocol Adaptation

Cloud Gateway

Event Hubs&IoT Hub

Field Gateway

Protocol Adaptation

IoT Hub• Capability of the Azure IoT Suite• Bi-directional device <-> cloud • Up to 10 million devices• Telemetry ingestion• Command & control• Device registry & identity• Device Management• HTTP/AMQP• Extensible protocol support / MQTT

Field Gateway

Device Connectivity & Management

IoT Device & Cloud PatternsD

evi

ces

RTO

S, L

inux,

Win

dow

s, A

ndro

id, i

OS

Protocol Adaptation

Cloud Gateway

Event Hubs&IoT Hub

Field Gateway

Protocol Adaptation

Cross-Platform Device Support• Open source “agent” framework• Simple, secure device <-> cloud

connectivity & management• RTOS, Linux, Windows, Android, iOS• Easy to use, not required

Cross Platform C Code

OS Abstraction Layer / OS Bindings

C API .NET API Java API Javascript API

Field Gateway

Device Connectivity & Management

Analytics & Operationalized Insights

IoT Device & Cloud PatternsD

evi

ces

RTO

S, L

inux,

Win

dow

s, A

ndro

id, i

OS

Protocol Adaptation

Cloud Gateway

Event Hubs&IoT Hub

Field Gateway

Protocol Adaptation

Operationalize your insightsSQL

Field Gateway

Device Connectivity & Management

Analytics & Operationalized Insights

IoT Device & Cloud PatternsD

evi

ces

RTO

S, L

inux,

Win

dow

s, A

ndro

id, i

OS

Protocol Adaptation

Batch Analytics & Visualizations

Azure HDInsight, AzureML, Power BI,

Azure Data Factory

Hot Path Analytics

Azure Stream Analytics, Azure HDInsight Storm

Hot Path Business Logic

Service Fabric & Actor Framework

Cloud Gateway

Event Hubs&IoT Hub

Field Gateway

Protocol Adaptation

Find insights to• Power new services• Improve your

“things”

Operationalize your insights in real timeIoT Scale Object Models & Business Logic

PresentTime of interest

Web Analytics – Ad placement,Financial Services, Smart Grids,

Monitoring – Systems mgmt, Health Care, Manufacturing, etc.

years months days hrs min sec

$ value of analytics

Forecasting in Enterprises

Historical Trend Analysis

The Value of Timely Analytics

Current Products for Analytics

Traditional DW Analytics

Active DW analytics

Present

Time of interest

100000

10000

1000

100

Custom-built solutions that carry huge development and customization costs

Facts/sec.

years months days hrs min sec

Load time in ETLET time in ETL

Understanding Streaming DataQuestion: “how many red cars are in the parking lot”.

Field Gateway

Device Connectivity & Management

Analytics & Operationalized Insights

Presentation & Business Connectivity

IoT Device & Cloud PatternsD

evi

ces

RTO

S, L

inux,

Win

dow

s, A

ndro

id, i

OS

Protocol Adaptation

Batch Analytics & Visualizations

Azure HDInsight, AzureML, Power BI,

Azure Data Factory

Hot Path Analytics

Azure Stream Analytics, Azure HDInsight Storm

Presentation &

Business Connectivity

App Service, Websites

Dynamics, BizTalk Services, Notification Hubs

Hot Path Business Logic

Service Fabric & Actor Framework

Cloud Gateway

Event Hubs&IoT Hub

Field Gateway

Protocol Adaptation

Microsoft Azure IoT services

Devices Device Connectivity Storage Analytics Presentation & Action

Event Hubs SQL Database Machine Learning App Service

Service Bus Table/Blob Storage Stream Analytics Power BI

External Data Sources DocumentDB HDInsight Notification Hubs

External Data Sources Data Factory Mobile Services

BizTalk Services

{ }