technical computing camp 2018
TRANSCRIPT
![Page 1: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/1.jpg)
1© 2015 The MathWorks, Inc.
Are you ready for AI?
Is AI ready for you?
Gareth Thomas
Technical Computing
Camp 2018
![Page 2: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/2.jpg)
2
Alexa –
Write my TCC
keynote for me
![Page 3: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/3.jpg)
3
Alexa –
Play soothing jazz
![Page 4: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/4.jpg)
4
Source: Gartner, Real Truth of Artificial Intelligence by Whit Andrews
Presented at Gartner Data & Analytics Summit 2018, March 2018
![Page 5: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/5.jpg)
5
Source: Gartner, Real Truth of Artificial Intelligence by Whit Andrews
Presented at Gartner Data & Analytics Summit 2018, March 2018
![Page 6: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/6.jpg)
6
![Page 7: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/7.jpg)
7
![Page 8: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/8.jpg)
8
Artificial Intelligence
The capability of a machine to imitate
intelligent human behavior
![Page 9: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/9.jpg)
9
Artificial Intelligence
The capability of a machine to match or exceed
intelligent human behavior
![Page 10: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/10.jpg)
10
Artificial Intelligence Today
The capability of a machine to match or exceed
intelligent human behavior
by training a machine to learn the desired behavior
![Page 11: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/11.jpg)
11
There are two ways to get a computer to do what you want
Traditional Programming
COMPUTER
Program
Output
Data
Program
Data
![Page 12: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/12.jpg)
12
There are two ways to get a computer to do what you want
Machine Learning
COMPUTERProgram
Output
Data
![Page 13: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/13.jpg)
13
There are two ways to get a computer to do what you want
Machine Learning
COMPUTERModel
Output
Data
Artificial Intelligence Machine Learning
![Page 14: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/14.jpg)
14
Are you ready for AI?
Data
Model
Output
![Page 15: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/15.jpg)
15
Are you ready for AI?
Data
Model
Output
![Page 16: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/16.jpg)
16
Are you ready for AI?
Data
Model
Output
Access Data
Analyze Data
![Page 17: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/17.jpg)
17
Are you ready for AI?
Data
Model
Output
Access Data
Analyze Data
Develop
Deploy
![Page 18: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/18.jpg)
18
Are you ready for AI?
EVERYTHING
ELSE
Data
Model
Output
Access Data
Analyze Data
Develop
Deploy
![Page 19: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/19.jpg)
19
Are you ready for AI?
DevelopAnalyze DataAccess Data Deploy
Data
Model
Output
AI model
Modeling &
simulation
Algorithm
development
![Page 20: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/20.jpg)
20
Develop
AI model
Modeling &
simulation
Algorithm
development
Are you ready for AI?
Data
exploration
Preprocessing
Analyze Data
Domain-specific
algorithms
Sensors
Files
Access Data
Databases
Deploy
![Page 21: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/21.jpg)
21
Are you ready for AI?
Develop
Data
exploration
Preprocessing
Analyze Data
Domain-specific
algorithms
Sensors
Files
Access Data
Databases
Desktop apps
Enterprise
systems
Deploy
Embedded
devices
AI model
Modeling &
simulation
Algorithm
development
![Page 22: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/22.jpg)
22
Do you need AI?
![Page 23: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/23.jpg)
23
![Page 24: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/24.jpg)
24
AI for Predictive Maintenance
• Measure the wear of each robot
• Predict and fix failures before they happen
• AI handles uncertainty and variability
![Page 25: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/25.jpg)
25
Are you ready for AI if …
You’ve never used machine learning?
![Page 26: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/26.jpg)
26
![Page 27: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/27.jpg)
27
What is crispiness?
Crispy
Crushing Sound
+Crispy Enough
Soggy
=Crushing Force
![Page 28: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/28.jpg)
28
Replicating human perception with machine learning
Technical University of Munich
Feature extraction Classification
Crispy
Crispy enough
Soggy
Data
Machine Learning Workflow
![Page 29: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/29.jpg)
29
Replicating human perception with machine learning
Technical University of Munich
Classification Learner
![Page 30: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/30.jpg)
30
Fresh
Soggy
SoggyFresh
Tru
e C
las
s
Predicted Class
93%
91%
91%
91%
89%
95%
![Page 31: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/31.jpg)
31
Are you ready for AI if you’ve never used machine learning?
No experience required
Use apps to try out all possible models
Use domain expertise and familiar tools to prepare data
![Page 32: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/32.jpg)
32
Are you ready for AI if …
You can’t identify features in your data?
![Page 33: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/33.jpg)
33
Use deep learning to identify features automatically
Feature extraction Classification
Crispy
Crispy enough
Soggy
Data
Machine Learning Workflow
![Page 34: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/34.jpg)
34
Use deep learning to identify features automatically
Feature extraction Classification
Crispy
Crispy enough
Soggy
Data
Machine Learning Workflow
Crispy
Crispy enough
Soggy
Deep neural network
95%
3%
2%
..
.…
Data
Deep Learning Workflow
![Page 35: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/35.jpg)
35
![Page 36: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/36.jpg)
36
![Page 37: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/37.jpg)
37
Traditional Approach
• Geologists assess seven different metrics
• Can take hours to analyze one site
• Critical shortage of geologists
New Approach
• Use deep learning to automatically
recognize metrics based on images
• On-site evaluators decide with support
from deep learning
![Page 38: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/38.jpg)
38
Efficient tunnel drilling with deep learning
Obayashi Corporation
Label each
sub-image
Split into
sub-images
Image
Weathering
Alteration
(1-4)
Fracture
Spacing
(1-5)
Fracture
State
(1-5)
3 3 2
4 1 1
2 3 2
3 3 2
⋮ ⋮ ⋮ ⋮
![Page 39: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/39.jpg)
39
Efficient tunnel drilling with deep learning
Obayashi Corporation
AlexNetPRETRAINED MODEL
Ice cream Teapot Goose
Transfer learning
Custom Network
![Page 40: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/40.jpg)
40
MATLAB Production Server
Efficient tunnel drilling with deep learning
Obayashi Corporation
Weathering alteration: 4
Fracture spacing: 3
Fracture state: 2
AlexNetPRETRAINED MODEL
Ice cream Teapot Goose
Transfer learning
87%
69%
89%
Custom Network
![Page 41: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/41.jpg)
41
Are you ready for AI if you can’t identify features in your data?
Deep learningDeep learning in 5 lines of code
nnet = alexnet;
cam = webcam;
picture = snapshot(cam);
picture = imresize(picture,[227 227]);
label = classify(nnet, picture)
![Page 42: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/42.jpg)
42
Are you ready for AI if you can’t identify features in your data?
Deep learning
Transfer learning
![Page 43: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/43.jpg)
43
Are you ready for AI if you can’t identify features in your data?
Deep learning
Transfer learning
Automation and AI to label data
Point cloud semantic segmentation
Classification
Car
Truck
Ground
Background
![Page 44: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/44.jpg)
44
Are you ready for AI if you can’t identify features in your data?
Deep learning
Transfer learning
Automation and AI to label data
Point cloud semantic segmentation
Classification
Car
Truck
Ground
Background
![Page 45: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/45.jpg)
45
Are you ready for AI if …
If you don’t have the right data?
![Page 46: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/46.jpg)
46
AI for Predictive Maintenance
• Measure the wear of each blade
• Predict and fix failures before they happen
• Can’t rely on failures in the field
![Page 47: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/47.jpg)
47
Predictive maintenance with synthetic failure data with
MATLAB & Simulink
Simulink model
![Page 48: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/48.jpg)
48
Predictive maintenance with synthetic failure data with
MATLAB & Simulink
Measured data
Inject failures
Refine model
Simulink model
Failure data
Failure conditions
![Page 49: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/49.jpg)
49
Are you ready for AI if you don’t have the right data?
Generate data with simulations
Simulation environment for
reinforcement learning
![Page 50: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/50.jpg)
50
Low-carbon homes
• Generate power with fuel cell and solar panels
• Store power in battery
• Buy power when needed; sell when extra
• Record data on environment and energy usage
![Page 51: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/51.jpg)
51
Low-carbon homes
• Generate power with fuel cell and solar panels
• Store power in battery
• Buy power when needed; sell when extra
• Record data on environment and energy usage
Goals
• Minimize energy cost
• Use EV battery for additional storage
![Page 52: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/52.jpg)
52
Optimizing home energy management system
Denso
HomeHome Energy Controller
Battery
command
Generated and consumed power
Stored energy
![Page 53: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/53.jpg)
53
Optimizing home energy management system
Denso
HomeHome Energy Controller
Battery
command
Generated and consumed power
Stored energy
Electricity prices
Predicted
vehicle use
¥
Simscape Power SystemsModel predictive control
Mixed integer linear programming
![Page 54: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/54.jpg)
54
Optimizing home energy management system
Denso
Develop
Data
Parallel
computing
1000 CSV Files
Access Data Deploy
PreprocessingClassification
Learner
Analyze Data
![Page 55: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/55.jpg)
55
Optimizing home energy management system
Denso
Develop
Data
Simulink
Control
algorithms
Deploy
Optimization
Embedded
devices
Classification
Learner
Simscape Power
Systems
Parallel
computing
1000 CSV Files
Access Data
Preprocessing
Analyze Data
![Page 56: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/56.jpg)
56
Optimizing home energy management system
Denso
Develop
Data
Simulink
Control
algorithms
Parallel
computing
1000 CSV Files
Access Data Deploy
Optimization
Preprocessing Embedded
devices
Classification
Learner
Analyze Data
Simscape Power
Systems
“The effort would have taken significantly longer if we had
used disparate tools.
[MATLAB] enabled our team of domain experts, who
lacked formal training in data science, machine learning,
and parallel computing, to incorporate all these areas in
our design process.”
Akira Ito and Ryu Matsumoto
![Page 57: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/57.jpg)
57
Autonomous
Primary
![Page 58: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/58.jpg)
58
![Page 59: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/59.jpg)
59
Autonomous
Primary
![Page 60: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/60.jpg)
60
++
Host computer ProsthesisProcessing laptop
EMG
Drummer
Music
Exceeding human capabilities with a robotic drumming prosthesis
Georgia Tech Center for Music Technology
PID controller
AI algorithms
![Page 61: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/61.jpg)
61
++
Host computer ProsthesisProcessing laptop
Microphone
EMG
Drummer
Music
Exceeding human capabilities with a robotic drumming prosthesis
Georgia Tech Center for Music Technology
PID controller
AI algorithms
![Page 62: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/62.jpg)
62
![Page 63: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/63.jpg)
63
Are you ready for AI if …
You’ve never used machine learning? Easy programming
Apps
Domain expertise to prepare data
![Page 64: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/64.jpg)
64
Are you ready for AI if …
You’ve never used machine learning?
You can’t identify features in your data?
Easy programming
Apps
Domain expertise to prepare data
Deep learning identifies features for you
Transfer learning works with less data
Use AI to label data
![Page 65: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/65.jpg)
65
Are you ready for AI if …
You’ve never used machine learning?
You can’t identify features in your data?
You don’t have the right data?
Easy programming
Apps
Domain expertise to prepare data
Deep learning identifies features for you
Transfer learning works with less data
Use AI to label data
Generate failure data with simulations
Simulate environment for reinforcement learning
![Page 66: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/66.jpg)
66
With MATLAB and Simulink, you ARE ready for AI!
![Page 67: Technical Computing Camp 2018](https://reader031.vdocument.in/reader031/viewer/2022012420/61748338eb3b2551fa40f71e/html5/thumbnails/67.jpg)
67