andrew ng, chief scientist at baidu
TRANSCRIPT
![Page 1: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/1.jpg)
Andrew Ng
What data scientists should know about deep learning
![Page 2: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/2.jpg)
Andrew NgAndrew Ng
Images Speech Behavior
Applications of Deep Learning
![Page 3: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/3.jpg)
Andrew NgAndrew Ng
Computer vision: Find coffee mug
![Page 4: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/4.jpg)
Andrew NgAndrew Ng
Computer vision: Find coffee mug
Early, poor computer vision results.
![Page 5: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/5.jpg)
Andrew NgAndrew Ng
Neurons in the brain
Output
Deep Learning: Neural network
![Page 6: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/6.jpg)
Andrew NgAndrew Ng
Computer vision
![Page 7: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/7.jpg)
Andrew NgAndrew Ng
Yes/No(Mug or not?)
What is a neural network?
Data (image)
x1 x2 x3
x4
x5
W4W3W2W1
![Page 8: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/8.jpg)
Andrew NgAndrew Ng
Supervised learning (learning from labeled data)
Yes
No
YXImage Yes/No
(Is it a coffee mug?)
Data:
![Page 9: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/9.jpg)
Andrew NgAndrew Ng
Engine
Fuel
Large neural networks
Labeled data (x,y pairs)
Why is Deep Learning taking off?
![Page 10: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/10.jpg)
Andrew NgAndrew Ng
It’s all about scale.almost
![Page 11: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/11.jpg)
Andrew NgAndrew Ng
Rocket engines: Deep Learning driven by scale
1 million connections
(2007)
CPU
10 million connections
(2008)
GPU
1 billionconnections
(2011)
Cloud(many CPUs)
100 billionconnections
(2015)
HPC(many GPUs)
![Page 12: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/12.jpg)
Andrew NgAndrew Ng
A yellow bus driving down a road with green trees and green grass in the background.
Living room with white couch and blue carpeting. The room in the apartment gets some afternoon sun.
Can a computer understand these pictures?
![Page 13: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/13.jpg)
Andrew NgAndrew Ng
Supervised learning (learning from labeled data)
YXImage Caption
A yellow bus driving down a road with green trees and green grass in the background.
![Page 14: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/14.jpg)
Andrew NgAndrew Ng
CaptionData (image)
A yellow bus driving down….
Learning to Caption
![Page 15: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/15.jpg)
Andrew NgAndrew Ng
( , )
Learning to answer questions
YX(Image,Question) Answer
The bus is red.(公共汽车是红色的 )
What is the color of the bus?(公共汽车是设么颜色的? )
![Page 16: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/16.jpg)
Andrew NgAndrew Ng
What is the color of the
bus?
Data (image, question)
The bus is red ....
Learning to Answer Questions
![Page 17: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/17.jpg)
Andrew Ng
![Page 18: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/18.jpg)
Andrew Ng
![Page 19: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/19.jpg)
Andrew NgAndrew Ng
Images Speech Behavior
Applications of Deep Learning
![Page 20: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/20.jpg)
Andrew NgAndrew Ng
TranscriptAudioFeatures
Data (audio)
Phonemes Language model
Speech recognition
![Page 21: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/21.jpg)
Andrew NgAndrew Ng
Transcript
Data (audio)
Baidu Deep Speech: The rocket engine
![Page 22: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/22.jpg)
Andrew NgAndrew Ng
WSJ Switchboard Fisher Deep Speech0
20000
40000
60000
80000
100000
120000
80 300 2000
>100,000
Synthesizeddata
Hours of data
Dataset
Baidu Deep Speech: The rocket fuel (data)
![Page 23: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/23.jpg)
Andrew NgAndrew Ng
Speech recognition performance
Error
![Page 24: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/24.jpg)
Andrew NgAndrew Ng
With 99% accuracy, we could redesign your cellphone using a
speech interface.
Most people don’t understand the difference between 95% accuracy and 99% accuracy.
99% is game changing.
![Page 25: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/25.jpg)
Andrew NgAndrew Ng
Home appliances
(e.g., TV, microwave, music player, ….)
Car interfaces Wearables
Speech will transform the Internet of Things
![Page 26: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/26.jpg)
Andrew NgAndrew Ng
Images Speech Behavior
Applications of Deep Learning
![Page 27: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/27.jpg)
Andrew Ng27
Andrew Ng
Web search/Advertising Datacenter management Computer security
Deep Learning and big data
![Page 28: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/28.jpg)
Andrew NgAndrew Ng
Applications of Deep Learning
Images Speech Behavior
![Page 29: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/29.jpg)
Andrew NgAndrew Ng
It’s all about scale.almost
![Page 30: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/30.jpg)
Andrew NgAndrew Ng
Why deep learning
Amount of data
Per
form
ance
Older learningalgorithms
Deep learning
How do data science techniques scale with amount of data?
![Page 31: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/31.jpg)
Andrew NgAndrew Ng
The problem of scale: Mobile devices
Image 72 keypoints Face segmentation
Binary size Speed
Desktop model 153MB 1.25 fps
Mobile model 800 KB (190x reduction)
25 fps (20x speedup)
![Page 32: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/32.jpg)
Andrew NgAndrew Ng
Faceyou (available on Apple app store)
![Page 33: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/33.jpg)
Andrew NgAndrew Ng
The future of Deep Learning
The AI rocket Images Speech Behavior
![Page 34: Andrew Ng, Chief Scientist at Baidu](https://reader034.vdocument.in/reader034/viewer/2022052606/587147fd1a28ab55588b5d3d/html5/thumbnails/34.jpg)
Andrew Ng34
Andrew Ng
We have superpowers
AI Data
Science
AI Data Science