internet of things, from datastream to insight · your internet of things: from data stream to...
TRANSCRIPT
Your Internet of Things: from data stream to insight
Technology Day 2015
Tim Jacobs Geert Baeke
Presenting the presenters
Machine Learning
Structure of today’s talk
GenerateData
CaptureData
AnalyzeData
VisualizeData
Agenda
•Data Generation & Capturing
•Data Analytics & Visualization
•Machine Learning
•Conclusions
We will be flooded by huge amounts of devices, generating even bigger amounts of data.
Internet of Things
Source: ITU-T Y.2060 / Internet of Things Global Standards Initiative – http://www.itu.int/en/ITU-T/gsi/iot/
The Internet of Things (IoT) is the [dynamic] network of physical objects or "things" embedded with electronics, software, sensors, and network connectivity,
which enables these objects to collect and exchange data.
Place
Time
Thing
Devices, protocols, OS’s & standards
Device Types
• Specific(“Industrial”)
• Generic (“Consumer”)
Protocols
• WiFi
• RF (ZigBee, Z-Wave, …)
• Bluetooth (BLE, iBeacon, Eddystone)
• Cellular
• Sigfox/Neul/LoRaWAN
OS’s
• Device specific
• *nix variants
• Windows 10 IoT Core
Standards
• HTTP
• XMPP
• CoAP
• AMQP
• MQTT
• STOMP
• DDS
• VSCP
• …
communication application
IoT deployment architectures
Communication Endpoint
Device 1
Device 2
Device 3
disconnected mode gateway mode standalone mode
Device 1
Device 2
Device 3
Device 1
Device 2
Device 3
Local Gateway
IoT data reception
• Third party on-premises platforms
• Your own platform
•Public Cloud-based offerings:• Azure IoT/Event Hubs & Stream Analytics• Amazon Kinesis• Citrix Octoblu• …
Let’s see if this gets you excited…
Demo: data generation & capturing
Demo: data generation & capturing
RPi2 Weather Station
Blob Storage
Advanced Analytics
PowerBIEnd-user Analytics
Stream Analytics
IoT/Event Hub
Microsoft Azure
Service Bus
Queue
Custom Applications
Agenda
•Data Generation & Capturing
•Data Analytics & Visualization
•Machine Learning
•Conclusions
Data: from BI to analytics
Standard reports
Ad-hoc reports
Query & drilldown
Alerts
Statistical analysis
Forecasting/extrapolation
Predictive modeling
Optimization
Degree of intelligence
Va
lue
Sta
nd
ard
An
aly
tics
Ad
van
ced
An
aly
tics
What happened?
How many? How often? Where?
Where exactly is the problem?
What actions are needed?
Why is this happening?
What if these trends continue?
What will happen next?
What is the best that can happen?
Traditional BI questionsTraditional tooling:
ETL Tools, SQL, Reporting Services & friends
New type of questionsNew tooling: NoSQL,
NewSQL, MapReduce, statistical software, ...
How to store?
How to capture?
How to process?
How to visualize?
How to analyze?
How to report on?
Azure Data Lake
Demo: data analytics & visualization
Providing insights…. Minion style
Demo: data analytics & visualization
RPi2 Weather Station
Blob Storage
Service Bus
Queue
Advanced Analytics
Custom Applications
Stream Analytics
Microsoft Azure
IoT/Event Hub
PowerBIEnd-user Analytics
Agenda
•Data Generation & Capturing
•Data Analytics & Visualization
•Machine Learning
•Conclusions
Computer
Input Data
Program
Output
Computer
Input Data
Output
Program
TraditionalProgramming
Machine Learning
Machine Learning Paradigm
SELECT customers.ID
FROM customers
LEFT JOIN orders ON customers.ID = orders.customer
LEFT JOIN products ON products.id = orders.product
GROUP BY customers.ID
HAVING orders.date > GETDATE() – 30
AND orders.category = ‘MOVIES’
AND SUM(orders.price) > 100
OR products.description LIKE ‘%MINION%’
OR products.category LIKE ‘%ANIMATION%’
Hey Geert, the new “Minions” movie is available on BluRay with a 40% discount!“ ”
SELECT customers.ID
FROM customers
LEFT JOIN orders ON customers.ID = orders.customer
LEFT JOIN products ON products.id = orders.product
GROUP BY customers.ID
HAVING orders.date > GETDATE() – 30
AND orders.category = ‘MOVIES’
AND SUM(orders.price) > 100
OR products.description LIKE ‘%MINION%’
OR products.category LIKE ‘%ANIMATION%’
Hey Geert, the new “Minions” movie is available on BluRay with a 40% discount!“ ”
90
Use Machine Learning to identify your business logic in your data!
Demo: Machine Learning
Dunno what that guy is talking about, but after this we can have a drink!
Demo: Machine Learning
Blob Storage
Service Bus
Queue
Advanced Analytics
Custom Applications
Microsoft Azure
PowerBIEnd-user Analytics
RPi2 Weather Station
Stream Analytics
IoT/Event Hub
Agenda
•Data Generation & Capturing
•Data Analytics & Visualization
•Machine Learning
•Conclusions
Conclusions
• IoT is more than just hardware, it’s an entire ecosystem.
• Value in data is both in:• Aggregated / historical data
• Realtime data
• Machine Learning helps to go from reactive to proactive decision making based on your data
• Time to value is shorter in the public cloud
How can Xylos help?
Data Strategy
Data Architecture
Data Analytics
Data Platform
Xylos Cloud ServicesXylos Cloud Services
Xylos Cloud Services