visible light cmos image sensors - slac national … · visible light cmos image sensors dr. eric...
TRANSCRIPT
![Page 1: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/1.jpg)
1
Visible LightCMOS Image Sensors
Dr. Eric R. FossumSenior Fellow, Micron Imaging
Micron Technology, Inc.
![Page 2: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/2.jpg)
September 03 2
Outline
4 Introduction to CMOS image sensor pixels4 Examples of sensors4 Customer trends4 CMOS image sensor technology trend4 Thoughts on next 5 years
![Page 3: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/3.jpg)
September 03 3
3Transistor (3T) CMOS APS
M2SF
M1RST
M3RS
Vpd
Vout
ColBus
Vpix
IL
CpdIpd
Vss
M2SF
M1RST
M3RS
Vpd
Vout
ColBus
Vpix
IL
CpdIpd
Vss
4 Use source-follower“amplifier” to drivecolumn bus
![Page 4: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/4.jpg)
September 03 4
Voltage on 3T Pixel vs. Time
Pixel sampled twice to remove variations in threshold voltageof pixel source-follower and reset level
integration starts
signal sampled
pixel reset level sampled
PhotodiodeVoltage
0V
1V
2V
3V
33 ms 66 ms
Netsignal
![Page 5: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/5.jpg)
September 03 5
Simplified Signal Chain
SHS
SHR
SIG
RST
COL BUS
RS
RST
VDD
CS
HOR BUS
VLN
VLP
VLP
PIXEL
PER COLUMN
GLOBAL
integration starts
signal sampled
pixel reset level sampled
Photodiode Voltage
0V
1V
2V
3V
33 ms 66 ms
Netsignal
integration starts
signal sampled
pixel reset level sampled
Photodiode Voltage
0V
1V
2V
3V
33 ms 66 ms
Netsignal
![Page 6: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/6.jpg)
September 03 6
Imaging System on a ChipCMOS Active Pixel Color Imaging ArrayDigital Logic for
• User Interface• Sensor Setup• Timing Generator• Digital Signal Processing
–Color Processing–White Balance–Image Enhancement
• Data Output Formatting
Analog Signal Processing• Data Sampling• Noise Reduction• Gain Analog-To-Digital Conversion
![Page 7: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/7.jpg)
September 03 7
00.10.20.30.40.50.60.70.80.9
1
400 500 600 700 800 900 1000 1100Wavelength (nm)
Rela
tive
resp
onse
Human Eye
Silicon
NIR
Spectral Response of Eye and Silicon
UV
![Page 8: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/8.jpg)
September 03 8
Fill Factor4 A pixel is divided into a sensing portion and a readout
portion4 Fill factor is the ratio of sensing area to total area and
is typically about 20-30%
Total pixel areaSensitive area
![Page 9: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/9.jpg)
September 03 9
Color Filter Arrays and Microlenses
Microlens layer
Color filter layerMetal opaque layerPhotodiodeSilicon substrate
![Page 10: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/10.jpg)
September 03 10
Scene Image
Resolution and Sensitivity
Photons/pixel
Pixel pitch
4 More pixels = high resolution4 Smaller pixels = less sensitivity
![Page 11: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/11.jpg)
September 03 11
1
10
1/7 1/6 1/5 1/4 1/3 1/2 2/3
Lens Format
Pix
el S
ize
(um
) CIF
VGA
1.3M
2.1M
3.3M
4.1M
Optical Formats7.8 mm5.6 mm3.6 mm
2.8 mm
“1/4 in”
![Page 12: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/12.jpg)
September 03 12
Pictures from PC Camera Sensors
CIF Resolution(352 x 288)
VGA Resolution(640 x 480)
![Page 13: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/13.jpg)
September 03 13
1.3Mpixel High Speed Sensor
1/33,000 sec = 30 usecFreeze frame shutter
41280 ADCs per chip45T pixel4500 pictures per
second at fullresolution
4Shutter from 1/30th secto 1/100,000th sec
4Shutter efficiency >99.99%
4Rotating fan image ‡
![Page 14: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/14.jpg)
September 03 14
Pill Camera
4 Pixel Format: 256 X 2564 Pixel Size: 10 µm X 10 µm4 Frame Rate: 2 fps4 ADC: On-Chip, 8 bits4 Power Supply: 2.8 V4 Power: 3 mW
Sensor and US$0.10 Pill Camera and US$0.25 View inside smallintestine
Krymski 1998
![Page 15: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/15.jpg)
September 03 15
4 Mpixel sensor 240fps ERS
4 2352 x 17284 7 mm x 7 mm pixel pitch4 16x10b digital output4 240 fps ERS4 960 Mbytes/sec at 66 MHz4 4000 bits/lx-sec4 3.3 volt operation
Krymski 2001
![Page 16: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/16.jpg)
September 03 16
Customer Drivers4 Incredibly fast price point erosion (2Mpixel CCD
now sells for $8 in Japan)4 Voltage scaling required to be compatible with
companion chips (3.3V -> 2.8V ->…1.8V)4 Power dissipation <200 mW/megapixel for
portable apps4 CCD performance sets benchmark for DSC
applications (SNR, dark current, etc.)4 CMOS performance fine for PC and wireless
applications
![Page 17: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/17.jpg)
17
A Very Small Digital Camera in 1995
4 2nd generation APScamera
4 JPL 256x256 element APS4 On-chip timing/control4 On-chip FPN suppression4 Separate 10-bit ADC4 Separate FPGA4 Serial digital camera I/O
![Page 18: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/18.jpg)
September 03 18
Cell Phone Cameras Are Small
![Page 19: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/19.jpg)
September 03 19
Technology Challenges
4 Smaller pixels4 Maintain or improve SNR with smaller pixel4 Maintain or increase dynamic range with lower
operating voltages4 Reduce dark current4 Reduce number of defective pixels4 Reduce power dissipation in analog and digital circuits
while increasing functionality
![Page 20: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/20.jpg)
September 03 20
Diffraction Limit
0
2
4
6
8
10
12
14
16
18
20
400 500 600 700 800 900 1000 1100
Wavelength (nm)
Size
(micr
ons)
Airy Disk DiameterD = 2.44 F#
Cheap Lens Resolution(30 lp/mm)
High Performance Lens Resolution(120 lp/mm)
B G R
F/2.8
F/11
B G R
LENS
![Page 21: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/21.jpg)
September 03 21
Alignment to Mainstream Technology
4 CMOS APS starts diverging from mainstream CMOS toimprove pixel performance
1970 1980 1990 2000
CCDs
CMOS APS
Mainstream CMOS Technology
Window ofOpportunity
Syst
em M
inia
turiz
atio
n Co
st
![Page 22: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/22.jpg)
September 03 22
Buried Photodiodes
N P NP P
ConventionalPhotodiode
BuriedPhotodiode
![Page 23: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/23.jpg)
September 03 23
4T Buried Photodiode
BPD FD BPD FD
BPD FD
TG TG
TG
BPD FD
TG
DVfd
4Reset Pixel4Integrate4Readout4 Reset FD4 Read FD4 Transfer Q4 Read FD
![Page 24: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/24.jpg)
September 03 24
Comparison of Pixels
RST
SELCOLBUS
Photodiode
“Amp” RST
SELCOLBUS
TG
BuriedPhotodiode
“Amp”
Three-transistor (3T) photodiode-type pixel
Four-transistor (4T) pinned-photodiode-type pixel
+ fewer transistors+ easier to implement+ better under good light- poorer under low light
- more transistors- challenge to implement- poorer under good light+ better under low light
![Page 25: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/25.jpg)
September 03 25
$1,379$1,645
$2,468
$3,477
$4,335
$0.00
$500.00
$1,000.00
$1,500.00
$2,000.00
$2,500.00
$3,000.00
$3,500.00
$4,000.00
$4,500.00
2000 2001 2002 2003 2004
Image Sensor Revenue Projections
Sources: CD analysis based on OEM and industry research reports
![Page 26: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/26.jpg)
September 03 26
$0
$500
$1,000
$1,500
2001 2002 2003 2004
ToysMachine VisionSecurity/BiometricsOptical MiceVideo CamerasOtherPC CamerasMobile PhonesDigital Still Cameras
CMOS Image Sensor Market Growth
Sources: CD analysis based on OEM and industry research reports
$ in
Mill
ions
$1,443
![Page 27: Visible Light CMOS Image Sensors - SLAC National … · Visible Light CMOS Image Sensors Dr. Eric R. Fossum Senior Fellow, Micron Imaging Micron Technology, Inc. September 03 2 Outline](https://reader030.vdocument.in/reader030/viewer/2022020414/5bb9840909d3f2da618bfadb/html5/thumbnails/27.jpg)
September 03 27
CMOS Vs. CCD Market Growth
0
10
20
30
40
50
60
70
2002 2003 2004 2005 2006 2007 2008
CMOS CCD
Perc
enta
ge