developer.download.nvidia.com · abc abc abc abc abc defect types: s1 s2 s3 s4 s5 15 classes laptop...
TRANSCRIPT
![Page 1: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/1.jpg)
Trista Chen, Chief Scientist of Machine Learning of InventecWei-Chao Chen, Co-founder of Skywatch & Head of Inventec AI Center
{chen.trista, chen.wei-chao} @ inventec.com
S9617
![Page 2: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/2.jpg)
Speaker BioTrista Chen
- Chief Scientist in Machine Learning, Inventec Inc.- Serial Entrepreneur at the Bay Area- Staff Research Scientist, Intel Corp.- Video Architect, NVIDIA Corp.
- Ph.D., CMU ECE
Wei-Chao Chen
- Head of AI Center & Chief AI Advisor, Inventec Inc.- Co-Founder & CEO, Skywatch Inc.- Senior Research Scientist, Nokia Palo Alto- Graphics Architect, NVIDIA Corp.
- Ph.D., UNC Chapel-Hill CS
![Page 3: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/3.jpg)
Smart Manufacturinghttps://medium.com/@kenmacken/who-turned-off-all-the-lights-470dc797fd0f
![Page 4: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/4.jpg)
Lights-Out Factoryhttps://medium.com/@kenmacken/who-turned-off-all-the-lights-470dc797fd0f
![Page 5: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/5.jpg)
GTC 2019 Source: IoT Analytics – November 2018
![Page 6: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/6.jpg)
GTC 2019
Manufacturing stores more data than any other sector – an estimated two exabytes (2 " 10%& bytes) in 2010.
Source: McKinsey & Company, "Is manufacturing 'cool' again?” 2013
![Page 7: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/7.jpg)
About Inventec
• Public company (Since 1975; Taipei, Taiwan)• Tier 1 electronics manufacturer• Annual revenue USD $16B+ (2018) • Factories in Taiwan, Shanghai and Chongqing
GTC 2019
Personal ComputersLaptops
Enterprise ComputersServers
Solar Energy Smart DevicesMedical Devices
![Page 8: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/8.jpg)
AI for Smart Manufacturing
• Process Automation– Automatic optical inspection– Production scheduling– Automatic testing
• Predictive Analysis– Order forecast– Production / yield prediction– Predictive maintenance
GTC 2019
![Page 9: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/9.jpg)
Smart Manufacturing
Automatic optical inspectionOrder forecastProduction schedulingTest automation…
Future Product
AIOT / Smart City applicationsMedical devicesRoboticsComputation Platform….
Inventec AI Center
![Page 10: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/10.jpg)
Why Edge AI?
• Privacy
• Reliability
• Network Efficiency
GTC 2019
JETSON TX2 MODULE•NVIDIA Pascal™ Architecture GPU•2 Denver 64-bit CPUs + Quad-Core A57 Complex•8GB L128 bit DDR4 Memory•32GB eMMC 5.1 Flash Storage
•Connectivity to 802.11ac Wi-Fi and Bluetooth-Enabled Devices•10/100/1000BASE-T Ethernet
![Page 11: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/11.jpg)
GTC 2019
Laptop Testing Robot
A0I Re-inspection
Laptop Surface AOI
Re-inspectionAOI for SMT lines and PCBs
![Page 12: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/12.jpg)
GTC 2019
Laptop Testing Robot
A0I Re-inspection
Laptop Surface AOI
Re-inspectionAOI for SMT lines and PCBs
![Page 13: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/13.jpg)
1. Laptop Testing Robot
Background• Millions of laptops manufactured every month– Similar basic design, many different configurations– Production tests are mostly automatic
GTC 2019
![Page 14: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/14.jpg)
1. Laptop Testing Robot
Background• Product approval is labor intensive– Takes weeks to certify for mass production– ~1M test assets– Hundreds of people running the tests
GTC 2019
![Page 15: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/15.jpg)
1. Laptop Testing Robot
Motivation (least -> most important)
• Labor cost and management• Time-to-market– Regression tests take weeks / months to complete
• Increase confidence– The management confidence level about manual testing is only
around 70%.
GTC 2019
![Page 16: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/16.jpg)
0. 3
3
0 0 . / 0
0
0
0 3
GTC 2019
By: Jimmy Ou, Wei-Chao Chen, et al. of SkywatchCollaboration with Joseph Shi, Jack Hung & Inventec QA Engineers
1. Laptop Testing Robot
![Page 17: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/17.jpg)
GTC 2019
1. Laptop Testing Robot
Pneumatic actuators
Mechanical / electrical keyboard and mouse
![Page 18: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/18.jpg)
GTC 2019
1. Laptop Testing Robot
Camera with computer vision capability
A side of laptop
Industrial Camera
![Page 19: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/19.jpg)
1. Laptop Testing Robot
• Computer Vision (OpenCV)– Perspective correction– Edge detection & denoising– Template matching
• Tesseract OCR– LSTM-based NN OCR engine
GTC 2019
![Page 20: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/20.jpg)
GTC 2019
Test subject Controller
![Page 21: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/21.jpg)
1. Laptop Testing Robot
Future Opportunities
• Automatic testing script generation – from human-readable to machine-readable test cases– Close-loop verification is hard
• Scheduling optimization– Reshuffle test levels and orders to speed up process
• Monkey testing?
GTC 2019
![Page 22: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/22.jpg)
GTC 2019
Laptop Testing Robot
A0I Re-inspection
Laptop Surface AOI
Re-inspectionAOI for SMT lines and PCBs
![Page 23: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/23.jpg)
2: AOI Re-inspection
GTC 2019
Common SMT defects
![Page 24: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/24.jpg)
2: AOI Re-inspection
AOI Machine
Fail
Pass
GTC 2019
High false positiveLow first-pass yield
Re-inspection by human
![Page 25: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/25.jpg)
2: AOI Re-inspection
AOI Machine
Pass
Fail AOIRe-inspection
Pass
Fail
GTC 2019
By: ��, ���,��� of NTU & advised by Wei-Chao Chen of Skywatch & NTU & Trista Chen of InventecData & domain knowledge provided by Jessie Huang, Peter Chu @ TAO, among others
High false positiveLow first-pass yield
![Page 26: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/26.jpg)
2: AOI Re-inspection
GTC 2019
Traditional Computer Vision
defects w/ well-defined rules
Deep Learningdefects w/ intuitive descriptions
![Page 27: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/27.jpg)
2: AOI Re-inspection
GTC 2019
0. Excess Solder (true)
1. Excess Solder (false positive à pass )
2. Insuff. Solder (true)
2. Insuff. Solder (false positiveàpass)
![Page 28: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/28.jpg)
GTC 2019
Laptop Testing Robot
A0I Re-inspection
Laptop Surface AOI
Re-inspectionAOI for SMT lines and PCBs
![Page 29: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/29.jpg)
3. Laptop Surface AOI
GTC 2019
BrandLogo
CustomerInfo
![Page 30: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/30.jpg)
BrandLogo
GTC 2019
CustomerInfo
![Page 31: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/31.jpg)
BrandLogo
GTC 2019
CustomerInfo
Type #2Dot
Type #1Scratch
Type #3:Area
Type #4:Abrasion
Type #5:Don’t care
![Page 32: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/32.jpg)
3. Laptop Surface AOI
GTC 2019
Defect type Class A spec Class B specScratch Length: 12mm
Acceptable: 2 linesLength: 20mm, Acceptable: 2 lines
Dent 0.5 mm2 < size < 0.7mm2Acceptable: 2 points
0.5 mm2 < size < 1mm2Acceptable: 3 points
…
Fail
Pass
Human readable rules
Labor intensive
![Page 33: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/33.jpg)
3. Laptop Surface AOI
GTC 2019
Defect type Class A spec Class B specScratch Length: 12mm
Acceptable: 2 linesLength: 20mm, Acceptable: 2 lines
Dent 0.5 mm2 < size < 0.7mm2Acceptable: 2 points
0.5 mm2 < size < 1mm2Acceptable: 3 points
…
Fail
Pass
Labor intensive
Human readable rules
AI
![Page 34: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/34.jpg)
3. Laptop Surface AOI
GTC 2019
Fail
Pass
AI
Training data
![Page 35: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/35.jpg)
3. Laptop Surface AOI
Pass
Fail
AIMobile M1 (Nvidia TX2)
GTC 2019
By: Benson Lin of Skywatch, Trista Chen and Irene Chen of Inventec, Wei-Chao Chen of Skywatch & InventecIn collaboration with Steven Wang, Sing-Wang Chen, Alfa Shih & Tim Zhang et al @ ICCMachine manufactured by Jerry Tseng @ Leh-Yeh; Edge machine provided by Mark Lu @ AIMobile
Surface defect classification
![Page 36: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/36.jpg)
3. Laptop Surface AOI
Pass/Fail ClassificationDL
detection
Pass
Fail
AIMobile M1 (Nvidia TX2)
GTC 2019
![Page 37: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/37.jpg)
3. Laptop Surface AOI
Pass/Fail ClassificationDL
detection Pass
Fail
GTC 2019
Stage 1:
Explainable
Stage 2:
Adjustable
![Page 38: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/38.jpg)
3. Laptop Surface AOI
Pass/Fail ClassificationDL
detection Pass
Fail
GTC 2019
Stage 1:
Explainable
Stage 2:
Adjustable
![Page 39: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/39.jpg)
3. Laptop Surface AOI – Explainable
GTC 2019
Why did it pass/fail?
• Defect type• Defect count• Defect size
Defect type Class A spec Class B specScratch Length: 12mm
Acceptable: 2 linesLength: 20mm, Acceptable: 2 lines
Dent 0.5 mm2 < size < 0.7mm2Acceptable: 2 points
0.5 mm2 < size < 1mm2Acceptable: 3 points
…
![Page 40: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/40.jpg)
Defect class cluster analysis
Defect types: s1 s2 s3 s4 s5
5 classes
a b ca b c
a b ca b c
a b c
15 classes
GTC 2019
Stage-1 multi-class detector
5 classes?
?
![Page 41: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/41.jpg)
GTC 2019
a b ca b c
a b ca b c
a b c
Defect types: s1 s2 s3 s4 s5
15 classes
Laptop categories:
a, b, cDefect types: s1 s2 s3 s4 s5
Output
Inpu
t
s5 s4 s1 s3 s2
5 classes
Defect class cluster analysis
![Page 42: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/42.jpg)
3. Laptop Surface AOI
Pass/Fail ClassificationDL
detection Pass
Fail
GTC 2019
Stage 1:
Explainable
Stage 2:
Adjustable
![Page 43: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/43.jpg)
3. Laptop Surface AOI – Adjustable
GTC 2019
Class A2 lines 2 dots
![Page 44: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/44.jpg)
3. Laptop Surface AOI – Adjustable
GTC 2019
Class B
![Page 45: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/45.jpg)
3. Laptop Surface AOI – Adjustable
GTC 2019
Class C
![Page 46: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/46.jpg)
3. Laptop Surface AOI – Adjustable
GTC 2019
Class A
![Page 47: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/47.jpg)
3. Laptop Surface AOI – Adjustable
GTC 2019
Class A+
![Page 48: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/48.jpg)
3. Laptop Surface AOI – Adjustable
GTC 2019
Class A++
![Page 49: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/49.jpg)
3. Laptop Surface AOI
Pass/Fail ClassificationDL
detection Pass
Fail
GTC 2019
Stage 1:
Explainable
Stage 2:
Adjustable
![Page 50: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/50.jpg)
3. Laptop Surface AOI – Factory Prototype
GTC 2019
��CCD
����
NB
��
��
��
��
��
![Page 51: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/51.jpg)
Benefits of AI for Manufacturing
GTC 2019
• The Big Scope– Consistency – Trustable digital
record – Industry 4.0
�-,K
OEE�- 01A
Y5�11A
������� ������
� ����������
,K���6G1ASECS
MES
SECS
�:�1. 2�O7Y52. ?[S#"=3. �(/V<L4. 2�DA;$
0*&
MES��
2��4
��/Z./ C/�1/…
2�DU;$
���/��� ��� ���/��� &���2�O7�1Y5
Y5�
�W�
��?S#"=
�(/V<L
Idle P�%Q
�- 01. ,K��E�2. 9@MI3�3. BH 0F84. Y51��>
M+)�1. 2�,K'X2. MES/��JT3. �-�X)84. !R/�-�N
Repair
Source: Taiwan’s Institute for Information Industry (III) 2017
• The Obvious– Accuracy– Labor Saving ROI
![Page 52: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/52.jpg)
Benefits of AI for Manufacturing – I4.0
GTC 2019
95.00
96.00
97.00
98.00
99.00
100.00
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
Production Efficiency
Peak Productivity Identified Problem
Image source: Hitachi “Factories of the Future”, NEXT 2019
time
Process chain
![Page 53: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/53.jpg)
������������������ ����������������������
Unexpected Bonus: to do well while building your AI engine
We’re on a mission to connect 60,000 residential disabled in Taiwan to join AI work by providing high-quality data fuels to your AI engines.
![Page 54: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/54.jpg)
GTC 2019
Laptop Testing Robot
A0I Re-inspection
Laptop Surface AOI
Re-inspectionAOI for SMT lines and PCBs
![Page 55: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/55.jpg)
GTC 2019
Smart Manufacturing
![Page 56: developer.download.nvidia.com · abc abc abc abc abc Defect types: s1 s2 s3 s4 s5 15 classes Laptop categories: a, b, c Defect types: s1 s2 s3 s4 s5 Output nput s5 s4 s1 s3 s2 5 classes](https://reader030.vdocument.in/reader030/viewer/2022040807/5e49493fa274d14be21fb7e0/html5/thumbnails/56.jpg)
Trista Chen, Chief Scientist of Machine Learning of InventecWei-Chao Chen, Co-founder of Skywatch & Head of Inventec AI Center
{chen.trista, chen.wei-chao} @ inventec.com
S9617