a pragmatic reference architecture for the internet of things
TRANSCRIPT
![Page 1: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/1.jpg)
A Pragmatic Reference
Architecture for the Internet
of Things
Rick G. GaribaySenior SDM,
Amazon.comLevel: Beginner
![Page 2: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/2.jpg)
Agenda• What is the Internet of Things?
• IoT Problem Space
• IoT Value Chain (A Pragmatic Reference Architecture)
• Wrap Up
![Page 3: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/3.jpg)
About Me• Senior Manager, Software Development @ Amazon.com
• Distributed Systems Nerd
• Published author and frequent contributor to CODE Magazine
• 8X Microsoft MVP
• Co-Author, “Windows Server AppFabric Cookbook” by Packt Pub.
• twitter: @rickggaribay
• blog: http://rickgaribay.net
• email: [email protected]
We’re hiring!
![Page 4: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/4.jpg)
The Internet of Things: By the
Numbers
B5075212
![Page 5: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/5.jpg)
This change is happening more rapidly than anyone imagined.
![Page 6: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/6.jpg)
This change could bring tremendous opportunity to your employer, customers, industry and you as a
technologist.
![Page 7: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/7.jpg)
The Internet of Things is the network of physical objects that contain embedded technology to
communicate and interact with their internal statesor the external environment.
![Page 8: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/8.jpg)
OEM Revenue Opportunity |
Market Forecast CY17
Source: IDC Sept 2013 and Microsoft
Auto & Trans Retail Manufacturing Healthcare Energy Computing Telecom Consumer
$7 B $16 B $197 B $3 B $27 B $908 B $179 B $356 B System Revenue
IntelligentSystems
1.7T$
![Page 9: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/9.jpg)
Smart Products
Grid
Renewables
Oil/Gas/Coal
Recovery and
Distribution
Points
of Sale
Restaurants
Hotels
Fuel
Stations
Patients
Clinics
Hospitals
Nursing
Homes
Mobile
Care
SafetySecurity
ComfortLighting
Automation
Manufacturing
Integration and
AutomationRemote
Servicing
Predictive and
Reactive
Maintenance
Water
Waste
Pollution
Control
Fire
Emergency
Public
Safety
Law
Enforcement
Letters
Packages
Containers
Tanks Bulkware
Games
Events
Sports
TelevisionStreaming
Traffic Buses
Cars
Trucks
Trains
Vessels
Aircraft
Bikes
Smart
Energy
Smart
Retail
Smart
Mobility
Smart
Logistics
Smart
Factory
Smart
Cities
Smart
Entertain-
ment
Smart
Health-
care
Smart
Building
Home
![Page 10: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/10.jpg)
![Page 11: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/11.jpg)
11
LA Express Park
![Page 12: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/12.jpg)
CGM in the Cloud
![Page 13: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/13.jpg)
13
What is IoT About?
Things (Devices)
Connectivity Data Analytics
![Page 14: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/14.jpg)
IoT Device Taxonomy
Large
Mobile
Micro
Small
POS terminal, ATM, MRI
x86, PC-like, apps
Industry handheld, POS tablet
ARM and x86, shell experience, apps
Gateways, wearables, panels, cars
ARM and x86, diverse hardware, no shell
Controllers, fixed-use, sensors, actuators
ARM, constrained hardware, headless
![Page 15: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/15.jpg)
Raspberry Pi
![Page 16: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/16.jpg)
Intel Galileo
![Page 17: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/17.jpg)
Gadgeteer Fez Spider
![Page 18: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/18.jpg)
Arduino Uno
![Page 19: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/19.jpg)
Netduino Plus 2
![Page 20: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/20.jpg)
Spark
![Page 21: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/21.jpg)
5mm 5mm
![Page 22: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/22.jpg)
Pebble Smart Watch
![Page 23: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/23.jpg)
![Page 24: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/24.jpg)
What is the Internet of
Things?
Things (Devices)
Connectivity Data Analytics
![Page 25: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/25.jpg)
Various Protocols
![Page 26: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/26.jpg)
Canonical Message Types
Voluntary information flow
from device to another system.
Telemetry
Requests for information from device to other
systems.
Inquires
Instructions from other systems to
a device.
Commands
Information flow from other
systems to the device.
Notifications
![Page 27: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/27.jpg)
Cloud Gateways
Connections are device-initiated and
outbound
NAT/Firewall Device (Router)
IP NAT
Cloud GatewaySource
Port mapping is automatic, outbound
Device does not listen for unsolicited traffic
No inbound ports open, attack surface is
minimized
Access-controlled command API
Secure, managed hosting platform
DNSmyapp.cloudapp.net
![Page 28: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/28.jpg)
What is the Internet of
Things?
Things (Devices)
Connectivity Data Analytics
![Page 29: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/29.jpg)
Event Velocity
Device telemetry• Thermostats report data
every 15 minutes
• Cars send telemetry data every minute
Application telemetry• Application perf counters are measured
every second per server
• Mobile app telemetry is captured for
every action on your app!
App and operational events• Halo game engine estimate 1,000,000
messages/second
![Page 30: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/30.jpg)
What is the Internet of
Things?
Things (Devices)
Connectivity Data Analytics
![Page 31: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/31.jpg)
The true significance of IoT is the
foundation it provides for enabling new
insights and unlocking new
opportunities.
![Page 32: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/32.jpg)
The Vs of Big Data
Volume: Scale of Data
• 40 Zettabytes (43 Trillion Gigabytes) of data will be created by 2020. 300 Times increase from 2005
• 6B people have mobile phones
• Most companies in the U.S have at least 100Tb of data
Velocity: Streams of Data
• NYSE captures 1TB of trade information every day
• The average modern car has over 100 sensors
• 18.9 billion network connections by 2016
Variety: Endless forms of Data
• Nearly 420 Million wearable health monitors
• Over 4 Billion hours of video watched on YouTube everyday
Source: McKinsey Global, Twitter, Cisco, Gartner
![Page 33: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/33.jpg)
IoT Value Pipeline
Ingest Staging Insight Action
![Page 34: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/34.jpg)
Reference Architecture
Ingest & Staging Insight & Action
+
![Page 35: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/35.jpg)
Reference Architecture
Ingest
HTTP MQTT AMQP CoAP …
Brokered Streamed
StagingBlob KVP Document
Insight
OLTP ETL CEP Big Data
Action
Custom APIs Brokered 3rd Party APIs
Security, M
anagem
ent, M
on
itorin
g
![Page 36: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/36.jpg)
Brokered Communication
• Each device has a dedicated
Inbox/Outbox on the Gateway
– Device sends telemetry/alerts and routes
service invocations via its Outbox
– Device receives commands and queries from
its Inbox
– Correlated request/reply patterns can be
implemented on top of these two messaging
channels
– The device knows, and has access to, only its
own specific inbox/outbox endpoints (URI’s)
Backend Components
Cloud Gateway
Inbox
Outbox
Co
mm
and
AP
I
Pro
toco
l Hea
d
![Page 37: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/37.jpg)
Streamed Communication
• Read (forward) and Rewind (go back)
data access
– Partition/shard-based
– Sequence of events, akin to a commit log
– Designed for high volume, high density ingest
– Typically (but not always) real-time use cases
![Page 38: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/38.jpg)
Reference Architecture
Ingest
HTTP MQTT AMQP CoAP …
Brokered Streamed
StagingBlob KVP Document
Insight
OLTP ETL CEP Big Data
Action
Custom APIs Brokered 3rd Party APIs
Security, M
anagem
ent, M
on
itorin
g
![Page 39: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/39.jpg)
Staging
Blob
•Any binary data
• Images, streams, big text files, etc.
KVP
•Any string
• JSON, XML
Document
• Typically JSON
![Page 40: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/40.jpg)
Staging Considerations
Commands & Inquiries
• The capability provides transient staging typically tied to a retention period and/or TTL
• A worker typically consumes and processes work message by message
Telemetry & Notifications
• The capability provides high-throughput backing to be consumed by either durable or stream-based consumers
• Typically bulk writes or stream based readers
![Page 41: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/41.jpg)
Reference Architecture
Ingest
HTTP MQTT AMQP CoAP …
Brokered Streamed
StagingBlob KVP Document
Insight
OLTP ETL CEP Big Data
Action
Custom APIs Brokered 3rd Party APIs
Security, M
anagem
ent, M
on
itorin
g
![Page 42: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/42.jpg)
Insight
OLTP
• Structured queries
ETL
• Moving data from one staging area to another
CEP
• Reading and analyzing streams in real-time
Big Data
• Analyzing large amounts of data at rest
![Page 43: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/43.jpg)
Reference Architecture
Ingest
HTTP MQTT AMQP CoAP …
Brokered Streamed
StagingBlob KVP Document
Insight
OLTP ETL CEP Big Data
Action
Custom APIs Brokered 3rd Party APIs
Security, M
anagem
ent, M
on
itorin
g
![Page 44: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/44.jpg)
Action
Your APIs
• Commands & Notifications
• Business Scenarios
• Cloud hosted
• Behind the firewall
• Synchronous & Asynchronous
Brokered
• Commands & Notifications
• Devices you own, control
• Asynchronous by design
3rd Party APIs
• Commands & Notifications
• Typically commercial devices or devices supported by a vendor
![Page 45: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/45.jpg)
Wrapping Up
• Model your solution across the four stages
• Evaluate the capability that’s right for you
based on your needs, team skills and
perhaps most important, the cost.
• Cloud providers are competing vigorously
which is great for customers!
![Page 46: A Pragmatic Reference Architecture for The Internet of Things](https://reader033.vdocument.in/reader033/viewer/2022042701/55c0cdfebb61ebe5528b4611/html5/thumbnails/46.jpg)
A Pragmatic Reference
Architecture for the Internet
of Things
Rick G. GaribaySenior SDM,
Amazon.comLevel: Beginner