presentation title (on one or two lines)cn.21ic.com/ebook_download/microsite/20160519.pdf ·...
Post on 06-Jun-2020
17 Views
Preview:
TRANSCRIPT
© 2016 Toshiba Corporation 東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
基于图像识别的ADAS解决方案
China Automotive Marketing Dept.Tan HongMay.19th 2016
© 2016 Toshiba Corporation 2東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
未来驾驶的方向
2020 20252015
无人驾驶
ADAS
被动安全
© 2016 Toshiba Corporation 3東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
车道偏离预警系统 LDW
疲劳驾驶检测系统 FDD
限速标志识别系统 SLSR
交通标志识别系统 TSRS
夜视辅助系统 Night Vision
What’s ADAS 高级驾驶辅助系统
前车避撞预警系统 FCW
行人检测报警系统 PDW
全景鸟瞰泊车辅助系统 EPA
前车启步提醒 Stop-Go
自动车灯检测系统 Auto Light
© 2016 Toshiba Corporation 4東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
ADAS市场发展
• 2019 中国市场 ADAS 装机超过25M 台, 80%以上
• 随着ADAS市场参与者增加,方案成本的下降,装机量会明显放大
© 2016 Toshiba Corporation 5
Non NDA
ViscontiTM Family Road Map
2003 --- 2011 2012 2013 2014 2015 2016 2017 2018
Visconti-
Trio
MPE x3
Video In x3
Next
Next
High Range
Mid Range
High
Mid Range
Low
Under planning
Under planning
2004~
Visconti4-Quartetto
MP: 2017/E
ENCAP 2018
Small
PKG(11mm□)Visconti2-Duetto
Visconti2-Quartetto
From 2013
From 2013
ENCAP 2016
Visconti2
-Solo
Now
2014 US KT Law
720p1080p
VGA720p
1080p
xxxCamera resolution
Visconti4-Solo
ENCAP 2018
720p1080p
Under development
© 2016 Toshiba Corporation 6東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
ADAS NCAP
Europe
USA
2013 Safety Regulation – for new heavy duty vehicleAdvanced Emergency Brake (AEB), Lane Departure Warning (LDW)
2014 Euro NCAPAutonomous Emergency Braking (AEB) – City, AEB – InterurbanLane Departure Warning (LDW) / Lane Keep Assist (LKA)
2016 Euro NCAP AEB – Pedestrian (Forward Pedestrian Detection)Speed Assist System (SAS) 100% (Traffic Sign Recognition)
2018 Euro NCAP AEB – Pedestrian: Night and low light condition AEB – Cyclists
2013 Regulation -- The Cameron Gulbransen, Kids and Cars Safety ActRear Visibility of Vehicles
(Originally it required a back-over detection standard that will alert drivers to the presence of a child behind the vehicle)
Visconti2 target
Visconti2 target
Visconti4 target
© 2016 Toshiba Corporation 7東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
Visconti 芯片的特点
• 多核并发架构
– 并行处理,实时响应
– 低功耗,高效能
• 独有的图像加速+算法加速 =》减轻软件开发负担
– 图形处理加速
– 算法优化加速
• 产品成熟,已量产投放全球市场
– 业界大厂Denso(电装)已选用,并大量投产
– 后续产品,不断升级
© 2016 Toshiba Corporation 8東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
Visconti2系统方框图
扬声器I2S
RGB888 / 565
LED(7-seg)8
DDR2DRAM
NORFlash
DDR2-533SDRAM
16-bit x 2
NORFlash
CAN
UART / SPI / I2C
前端相机
后端相机
左侧相机
右侧相机
视频输入I/F
视频输出I/F
媒体处理引擎 (MPE)
#1 #2 #3 #4
加速器
仿射变换 过滤器 1 直方图
32位RISC CPU主存储器控制器 片上2MB RAMWVGALCD 板
外围设备
CAN
GPIO
Serial I/F
定时器
PCM I/F
MCU I/F CAN MCU
MediaLB/MOST
CAN
GPIO
输入捕捉/输出比较/PWM
Visconti2
RGB888 / 666 / 565YCbCr422BT.656Y8 – Y128-12位 Bayer
其它ECU
PCI Express插槽
16-bit2CS
匹配过滤器 2 HOG
多内核结构实现了多个应用(最多4个)的轻松实施
行人 车道 &车辆 交通标志
加速器有助于实现非常高性能的图像处理,比如行人检测等
4相机检测车辆周围的障碍物
RGB888 / 565
© 2016 Toshiba Corporation 9東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
并行处理,实时响应
Visconti2实现了多种基于视觉的ADAS(高级驾驶辅助系统),比如LDW(车道偏离报警),FCW(前方碰撞报警), PD(行人检测)和使用TSR(交通标志识别)的超速报警以辅助驾驶。
结合4MPE(媒体处理引擎)& 硬件加速器可实现多个应用的同时进行。
车道检测(白线检测)- LDW
车辆检测 - VD
交通标志识别 - TSR
行人检测 - PD
MPE0
MPE1
MPE2
MPE3
100ms
HW加速器1
HW加速器2
HW加速器3
HW加速器4
HW加速器5
HW加速器6
© 2016 Toshiba Corporation 10東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
Visconti 芯片的特点
• 多核并发架构
– 并行处理,实时响应
– 低功耗,高效能
• 独有的图像加速+算法加速 =》减轻软件开发负担
– 图形处理加速
– 算法优化加速
• 产品成熟,已量产投放全球市场
– 业界大厂Denso(电装)已选用,并大量投产
– 后续产品,不断升级
© 2016 Toshiba Corporation 11東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
Image Recognition Technology History
Voice synthesis・recognition
Processor
Cell BroadbandEngine
SpursEngine
Visconti
System
1967 20012005
2008 2009
青字は世界No.1技術
Algorithm& Libraly
Audio/Video codec
Hand gesture
Pedestrian detection
Face recognition
Hand writing
recognition
Histgram, …
Rotetion, expanse・shrink …
Matching, …
Optical flow, ...
Filter
(Median, Sobel, Gaussian...)Feature amount
(CoHOG,TFD,…)
Vision Chip
2001 2003 20072005
System knowhow
SIMD、VILW、MeP、Multi core technology
ViscontiFamily
Heterogeneous multi core architecture
TOSHIBA has developed various image recognition applications last half-
century
Image recognitiontechnology
Only Toshiba has both original algorithm(CoHOG) and image recognition
hardware(Visconti) for high accuracy recognition.
© 2016 Toshiba Corporation 12東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
Hot Chips 24 (2012/8/27-)
Recognition process time comparison (1frame)
10fps = 100 msec/frame
Visconti2 MPE
@ 266MHz
Embedded CPU
@1GHz
3983 msec
Make gradient images
Affine
Conversion
Filter
HOG
79.3 msec
Matching
Track & MergeMake scaled images
MPE
Recognize using CoHOG
10x70x63x5x
50times faster
Breakdown
Real time operation
Just 1.2W(typ.) for Pedestrian
detection within 100ms
© 2016 Toshiba Corporation 13
Visconti 芯片的特点
• 多核并发架构
– 并行处理,实时响应
– 低功耗,高效能
• 独有的图像加速+算法加速 =》减轻软件开发负担
– 图形处理加速
– 算法优化加速
• 产品成熟,已量产投放全球市场
– 业界大厂Denso(电装)已选用,并大量投产
– 后续产品,不断升级
© 2016 Toshiba Corporation 14東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
Toshiba’s Image Recognition Processor Powers
DENSO’s Automotive Front-Camera-Based Active
Safety System6 Oct, 2015
TOKYO – Toshiba Corporation (TOKYO: 6502) today announced that DENSO Corporation (DENSO) is
deploying Toshiba’s TMPV7506XBG image recognition processor in its latest front-camera-based active
safety system. Vehicles equipped with DENSO’s camera system will reach the market in fall of 2015.
The TMPV7506XBG image recognition processor IC supports multiple camera-based Advanced Driver
Assistance Systems (ADAS) functions, including lane detection, vehicle detection, pedestrian detection
and traffic sign recognition. It concurrently executes multiple applications with low power consumption.
Toshiba is developing a family of automotive image recognition processor solutions. Products include
TMPV7528XBG, which adds an ARM® Cortex®-A9 MPCore, and the TMPV7608XBG, which offers
Toshiba’s original color-based pattern recognition technology, ideal for pedestrian recognition at night.
Toshiba is committed to innovations in safety and technology in automotive semiconductor solutions that
meet the requirements of European New Car Assessment Programme (NCAP) and other automotive
safety requirements.
电装采用Visconti2用于世界一流车厂前装车型
Visconti2 ADAS
Visconti2-Quartettoinside
© 2016 Toshiba Corporation 15東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
FUJI XEROX MFP –Visconti2
Human movement
detection Face recognition
Two cameras have been
installed in the multifunction
device for Smart WelcomEyes
Advance Technology. We
replaced the reflection sensor,
which was previously used to
detect human movement, with
a human detection camera,
making it possible to detect
users within a wider area. We
also installed a face
recognition camera that can
identify users for easy
authentication.
http://www.fujixerox.com/eng/company/technology/production/digital/smart_welcomeyes_advance.html
© 2016 Toshiba Corporation 16東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
Downsize image recognition camera module
Visconti2-solo + 1.3M CMOS image sensor inside
24x24x35mm
Feasibility
Study
© 2016 Toshiba Corporation 17
推动中国市场ADAS的普及
• 多核并发架构
– 并行处理,实时响应
– 低功耗,高效能
• 独有的图像加速+算法加速 =》减轻软件开发负担
– 图形处理加速
– 算法优化加速
• 产品成熟,已量产投放全球市场
– 业界大厂Denso(电装)已选用,并大量投产
– 后续产品,不断升级
成熟,开发便利,成本适中…
迅速提升ADAS的装车量
提高整车主动安全水平
© 2016 Toshiba Corporation 19東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
• 品质保证 AEC-Q101 / TS16949
• 温度 175 度 (一般为150度)
– 雪崩测试 (175度)
• 超低噪声
车载专用MOSFET
上面図
Unit: mm
下面図
20© 2015, Toshiba Corporation.
2015年7月 Rev1.0
MOSFET 产品线 175℃保証 アバランシェ保証 AEC-Q101 (650V系を除く)
*計画は予告なしに変更となる可能性があります。
1Q=1月~3月,2Q=4月~6月,3Q=7月~9月,4Q=10月~12月
~13A 13B 14A 14B 15A 15B 16A 16B 17A 17B
Nch40V
Nch60V
Nch100V
Nch650V
Pch40V
次世代
P6
UMOSⅧRon・A=10mΩ・mm2
Crss/Ciss≒0.05
UMOSⅣRon・A=
13.5mΩ・mm2
UMOSⅨRon・A=(6) mΩ・mm2先頭ES=OK、CS=‘15/8
Next
UMOSⅨRon・A=(20)mΩ・mm2先頭ES=‘16/1Q、CS=’16/3Q
UMOSⅥRon・A=25mΩ・mm2
次世代
UMOSⅧRon・A=18mΩ・mm2
Crss/Ciss≒0.05
UMOSⅣRon・A=30mΩ・mm2
UMOSⅨRon・A=(12) mΩ・mm2先頭ES=‘15/4Q、CS=‘16/2Q
UMOSⅥRon・A=93mΩ・mm2
UMOSⅧRon・A=37mΩ・mm2
UMOSⅧ+Logic Level DriveRon・A=37mΩ・mm2
Next
DTMOSⅣRon・A=17mΩ・cm2
先頭品開発中先頭開発中ラインアップ展開中旧タイプ 構想段階
Fin.
Fin.
Fin.
Fin.
Fin.
Fin.
Fin.
Fin.
Fin. :プロセス開発完
Fin.
Next(Soft recovery diodes)
© 2016 Toshiba Corporation 21東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
车用光耦(EV/HEV)
2010 – 2013 连续4年全球光耦市场占有率第一by Gartnar
w/w No.1
© 2016 Toshiba Corporation 22
Line-up Reference
TLP9104TLP9104A
TLP9118
TLP9148J
TLP9121A
MP from 2010 MP from 2014 (High efficiency product line)
Topr=125℃
10M Logic
Topr=125℃
1M Logic
Topr=125℃
Tr coupler
1M LogicIRMO LED
Photorelay
Topr=105℃
TLP9114B
1M Analog
VOFF=600V
MP
MP
MP
MP
TLP9121
Tr coupler
TLX9378
TLX9309
TLX9304
TLX9175J
TLX9300
TLX9000
Tj=125℃
Tj=125℃
New Tr chipwith RBE
TLX9185A
10M Logic
1M LogicHigh CMR
TLX9291A
Improve ESD of detector in
TLP9148J
Topr=125℃
TLX9376
20M LogicTotem-pole output
SO6 package
SO4 package
5M LogicTotem-pole output
Photovoltaic coupler Topr=125℃TLX9905w/o discharge circuitTLX9906w/ discharge circuit
ES:OK
ES:OK
New Tr chipwith RBE
Under development
TLX9310
Extremely low power consumption
Under development
SO6 package
SO4 package
Under development
Under development
Under development
AEC-Q100compliant
(plan)
Under development
Under development
Under development
Under development
Under development
CS:OK
CS:OK
ES:OK
CS:OK
CS:OK
MP
CS:OK
ES:Dec.2015
Topr=125℃
ES:OK
Tj=125℃
Tj=125℃
Topr=105℃
Topr=125℃
Topr=125℃
Topr=105℃
© 2016 Toshiba Corporation 23東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
Capricorn 虚拟仪表芯片
累计销售量超过1000万片!
Capricorn
© 2016 Toshiba Corporation 24東芝電子(中国)有限公司 TOSHIBA ELECTRONICS (CHINA) CO., LTD.
微信号:
Toshiba_Semicon
top related