ai advancement with deep learning and its application in ......ai advancement with deep learning and...
TRANSCRIPT
![Page 1: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/1.jpg)
AI Advancement with Deep Learning and Its Application in Autonomous
Shen Shengmei, Jane
Panasonic R&D Center Singapore (PRDCSG)
Oct 24, 2017
Email: [email protected]: +65 6550-5466; Mobile: +65 9173-8276Webpage: www.prdcsg.panasonic.com.sg
![Page 2: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/2.jpg)
Introduction of PanasonicIntroduction of Panasonic
100th years Anniversary
In 2018
100th years Anniversary
In 2018
Admiring him not only for he is a funder, innovator, but also a distinguished entrepreneur, philosopher and an opinion leader. He wrote many books
![Page 3: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/3.jpg)
Panasonic, Global Operation Panasonic, Global Operation
PRDCSGPanasonic R&D Center Singapore
27 Years History in Singapore Leading Advanced Technology Development especially in MPEG, 3D, AI
![Page 4: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/4.jpg)
PRDCSG: AI Contribution in Various BusinessPRDCSG: AI Contribution in Various Business
![Page 5: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/5.jpg)
World-Top Competitions with Machine LearningWe won world-wide competitions from 2010-2013:
• PASCAL VOC in 2010, 2011, and 2012 in object classification,
detection and segmentation
• 2013 VOT Visual Object Tracking 2013 VOT Tracking
Championship
Panasonic R&D Center
Singapore
Source: VOT Test Video
Source: PASCAL VOC
![Page 6: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/6.jpg)
Typical Development Process in Machine LearningTypical Development Process in Machine Learning
Typical Development Process Flow in Machine Learning(Supervised)
LBP: Local Binary Pattern ; HOG: Histograms of Oriented Gradients; SIFT: Scale-invariant feature transform
Hand-crafted Features: LBP, HOG, SIFT…
Hand-crafted Feature has the limitation, cannot represent the
variety contained in the data
![Page 7: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/7.jpg)
Traditional Machine LearningTraditional Machine Learning
Traditional Machine Learning is not good enough!
![Page 8: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/8.jpg)
Move Machine Learning Closer to Human Brain’s AIMove Machine Learning Closer to Human Brain’s AI
Andrew Ng
![Page 9: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/9.jpg)
Move Machine Learning Closer to Human Brain’s AI Move Machine Learning Closer to Human Brain’s AI
Since 2012 we have moved to Deep Learning for Higher Accuracy
Better RobustnessBeyond Human Intelligence
![Page 10: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/10.jpg)
World-Top Performance with Deep LearningWorld-Top Performance with Deep Learning
Deep learning framework:
Deep Features + Boosting Trees
input image detections
window
best
worst
PSL(JUN) 13.6%PSL(JUL) 11.6%
NUS(JUL) 9.8%
YAHOO(JUL) 11.8%
mis
s r
ate
false positive rate per image
Comparison to other companies
11.8% YahooPSL+NUS 11.6%
9.8% NUS
BaiduToyota 17.1%
14.1%
Top 5 results
2015
2014
Test on Caltech dataset
In 2015, Top result on Pedestrian Detection
![Page 11: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/11.jpg)
World-Top Performance with Deep LearningWorld-Top Performance with Deep LearningIn 2015, Top result on Pedestrian Detection
Comparison to other companies
11.8% YahooPSL+NUS 11.6%
9.8% NUS
BaiduToyota 17.1%
14.1%
Top 5 results
2015
2014
Test on Caltech dataset
Video Demo
![Page 12: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/12.jpg)
World-Top Competition with Deep LearningWorld-Top Competition with Deep Learning
“Panasonic Singapore Lab & NUS”
Panasonic R&D Center Singapore & NUS joint collaboration
In 2017.3, No. 1 on NIST Face Recognition IJB-A Challenge
N*(M40x4)+ M*(TitanXx4) used for training to win the competition
Very difficult test dataset with a lot of non-frontal faces but a good reflection of real situation
![Page 13: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/13.jpg)
World-Top Performance with Deep LearningWorld-Top Performance with Deep LearningIn 2017.7, No. 1 on MS Cele-1M Face Challenge
Face Source: MS Cele 1M
DGX-1 GPU machine used in the Training, winning the competition
1M face identities with 100 images for each identity(average) � huge data
![Page 14: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/14.jpg)
World-Top Performance with Deep LearningWorld-Top Performance with Deep LearningDeep Learning vs. Traditional Machine Learning
Video Demo
Deep Learning provides much robustness performance than Traditional machine learning
![Page 15: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/15.jpg)
World-Top Performance with Deep LearningWorld-Top Performance with Deep Learning
We achieved top results for different datasets• VIPeR : very small and challenging
• CUHK-SYSU : Biggest dataset for person re-id• PPReID : Partial person re-id dataset
Benchmark Results on Popular Datasets in 2016:
In 2016 Person Re-Identification for different datasets
Re-identify a person across multiple cameras
![Page 16: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/16.jpg)
AI for Autonomous & Automotive ApplicationsAI for Autonomous & Automotive Applications
AI for Autonomous
![Page 17: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/17.jpg)
AI for Autonomous & Automotive ApplicationsAI for Autonomous & Automotive ApplicationsPRDCSG’s autonomous car prototype
(for AGV: Automated Guided Vehicle)
Visual Self-Localization
Freespace and Obstacle detection
Demo Video
• Driver Control Modelling, Deep Reinforcement Learning • Multi objects detection and classification using DL• Multi objects tracking using DL• Driver sensing for safety & comfortable driving
Driver sensing
Actuator
Autonomous car
![Page 18: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/18.jpg)
AI for Autonomous & Automotive ApplicationsAI for Autonomous & Automotive ApplicationsDriver Control Modelling, Deep RL, IntentionNet
![Page 19: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/19.jpg)
AI for Autonomous & Automotive ApplicationsAI for Autonomous & Automotive ApplicationsMulti objects detection, DL implemented in PX2Traffic Scene Segmentation, DL implemented in PX2
NVIDIA DRIVE PX2
Video Demo
![Page 20: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/20.jpg)
AI for Autonomous & Automotive ApplicationsAI for Autonomous & Automotive ApplicationsDriver Sensing for safe and comfortable driving
http://news.panasonic.com/global/stories/2017/49621.html
https://www.engadget.com/2017/08/01/panasonic-drowsy-driver-ai-infrared/
http://news.panasonic.com/global/press/data/2017/07/en170727-3/en170727-3.html
“Drowsiness Detection”
![Page 21: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/21.jpg)
AI for Autonomous & Automotive ApplicationsAI for Autonomous & Automotive ApplicationsDriver Sensing: Driver Behavior Recognition
Participate in Kaggle Competition
![Page 22: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/22.jpg)
3 Key Factors & Strategy for AI Development3 Key Factors & Strategy for AI Development
AI Expert with Domain Knowledge:• Deep Learning Architecture
• Engineering Skills
• GPU Cluster for Training• Deployment GPU platform• Optimization for
deployment in Embedded H/W, PX2
1
2
3
3 Key Factors to work on Deep Learning:
1) People & Domain Knowledge2) Big Data
3) GPU resource Platform
DeepL_DataHub• Resource & Knowhow: Data collection & annotation• Various Assisting Tools
• Semi-auto labeling
PRDCSG: GPU Cluster:DGX1, 8xGPU-P-10040xP-TitanX, 8xM40, ….
![Page 23: AI Advancement with Deep Learning and Its Application in ......AI Advancement with Deep Learning and Its Application in Autonomous Shen Shengmei, Jane Panasonic R&D Center Singapore](https://reader036.vdocument.in/reader036/viewer/2022062606/5fe91f968334aa3d57578301/html5/thumbnails/23.jpg)
AI Advancement and Its ApplicationsAI Advancement and Its Applications
Thank You for your Attention!
Email: [email protected]: +65 6550-5466; Mobile: +65 9173-8276Webpage: www.prdcsg.panasonic.com.sg