digital image fundamentals selim aksoy department of computer engineering bilkent university...
TRANSCRIPT
![Page 2: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/2.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 2
Imaging process
Light reaches surfaces in 3D.
Surfaces reflect. Sensor element
receives light energy.
Intensity is important.
Angles are important.
Material is important. Adapted from Rick Szeliski
![Page 3: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/3.jpg)
Physical parameters Geometric
Type of projection Camera pose
Optical Sensor’s lens type Focal length, field of view, aperture
Photometric Type, direction, intensity of light reaching sensor Surfaces’ reflectance properties
Sensor Sampling, etc.
CS 484, Spring 2015 ©2015, Selim Aksoy 3
Adapted from Trevor Darrell, UC Berkeley
![Page 4: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/4.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 4
Image acquisition
Adapted from Rick Szeliski
![Page 5: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/5.jpg)
Camera calibration
Camera’s extrinsic and intrinsic parameters are needed to calibrate the geometry.
Extrinsic: camera frame world frame Intrinsic: image coordinates relative to camera
pixel coordinatesCS 484, Spring 2015 ©2015, Selim Aksoy 5
Camera frame
World frame
Adapted from Trevor Darrell, UC Berkeley
![Page 6: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/6.jpg)
Perspective effects
CS 484, Spring 2015 ©2015, Selim Aksoy 6
Adapted from Trevor Darrell, UC Berkeley
![Page 7: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/7.jpg)
Aperture
Aperture size affects the image we would get.
CS 484, Spring 2015 ©2015, Selim Aksoy 7
Larger
Smaller
Adapted from Trevor Darrell, UC Berkeley
![Page 8: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/8.jpg)
Focal length Field of view depends
on focal length. As f gets smaller,
image becomes more wide angle
more world points project onto the finite image plane
As f gets larger, image becomes more telescopic
smaller part of the world projects onto the finite image plane
CS 484, Spring 2015 ©2015, Selim Aksoy 8
Adapted from Trevor Darrell, UC Berkeley
![Page 9: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/9.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 9
Sampling and quantization
![Page 10: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/10.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 10
Sampling and quantization
![Page 11: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/11.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 11
Problems with arrays
Blooming: difficult to insulate adjacent sensing elements.
Charge often leaks from hot cells to neighbors, making bright regions larger.
Adapted from Shapiro and Stockman
![Page 12: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/12.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 12
Problems with arrays
Clipping: dark grid intersections at left were actually brightest of scene.
In A/D conversion the bright values were clipped to lower values.
Adapted from Shapiro and Stockman
![Page 13: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/13.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 13
Problems with lenses
Adapted from Rick Szeliski
![Page 14: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/14.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 14
Image representation
Images can be represented by 2D functions of the form f(x,y).
The physical meaning of the value of f at spatial coordinates (x,y) is determined by the source of the image.
Adapted from Shapiro and Stockman
![Page 15: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/15.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 15
Image representation
In a digital image, both the coordinates and the image value become discrete quantities.
Images can now be represented as 2D arrays (matrices) of integer values: I[i,j] (or I[r,c]).
The term gray level is used to describe monochromatic intensity.
![Page 16: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/16.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 16
Spatial resolution Spatial resolution is the smallest discernible
detail in an image. Sampling is the principal factor determining
spatial resolution.
![Page 17: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/17.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 17
Spatial resolution
![Page 18: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/18.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 18
Spatial resolution
![Page 19: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/19.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 19
Gray level resolution Gray level resolution refers to the smallest
discernible change in gray level (often power of 2).
![Page 20: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/20.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 20
Bit planes
![Page 21: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/21.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 21
Electromagnetic (EM) spectrum
![Page 22: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/22.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 22
Electromagnetic (EM) spectrum The wavelength of an EM wave required to
“see” an object must be of the same size as or smaller than the object.
![Page 23: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/23.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 23
Other types of sensors
![Page 24: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/24.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 24
Other types of sensors
![Page 25: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/25.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 25
Other types of sensors blue green red
near ir middle ir thermal ir middle ir
![Page 26: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/26.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 26
Other types of sensors
![Page 27: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/27.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 27
Other types of sensors
![Page 28: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/28.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 28
Other types of sensors
![Page 29: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/29.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 29
Other types of sensors
![Page 30: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/30.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 30
Other types of sensors
![Page 31: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/31.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 31
Other types of sensors
![Page 32: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/32.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 32
Other types of sensors
©IEEE
![Page 33: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/33.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 33
Image enhancement
The principal objective of enhancement is to process an image so that the result is more suitable than the original for a specific application.
Enhancement can be done in Spatial domain, Frequency domain.
Common reasons for enhancement include Improving visual quality, Improving machine recognition accuracy.
![Page 34: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/34.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 34
Image enhancement
First, we will consider point processing where enhancement at any point depends only on the image value at that point.
For gray level images, we will use a transformation function of the form
s = T(r)where “r” is the original pixel value and “s” is the new value after enhancement.
![Page 35: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/35.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 35
Image enhancement
![Page 36: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/36.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 36
Image enhancement
![Page 37: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/37.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 37
Image enhancement
![Page 38: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/38.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 38
Image enhancement
![Page 39: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/39.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 39
Image enhancement
Contrast stretching:
![Page 40: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/40.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 40
Histogram processing
![Page 41: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/41.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 41
Histogram processing
Intuitively, we expect that an image whose pixels tend to occupy the entire range of possible gray
levels, tend to be distributed uniformly
will have a high contrast and show a great deal of gray level detail.
It is possible to develop a transformation function that can achieve this effect using histograms.
![Page 42: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/42.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 42
Histogram equalization
http://fourier.eng.hmc.edu/e161/lectures/contrast_transform/node3.html
![Page 43: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/43.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 43
Histogram equalization
![Page 44: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/44.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 44
Histogram equalization
Adapted from Wikipedia
![Page 45: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/45.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 45
Histogram equalization
Original RGB image
Histogram equalization of each individual
band/channel
Histogram stretching by removing 2%
percentile from each individual
band/channel
![Page 46: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/46.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 46
Enhancement using arithmetic operations
![Page 47: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/47.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 47
Image formats
Popular formats: BMP Microsoft Windows bitmap image EPS Adobe Encapsulated PostScript GIF CompuServe graphics interchange format JPEG Joint Photographic Experts Group PBM Portable bitmap format (black and white) PGM Portable graymap format (gray scale) PPM Portable pixmap format (color) PNG Portable Network Graphics PS Adobe PostScript TIFF Tagged Image File Format
![Page 48: Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr](https://reader035.vdocument.in/reader035/viewer/2022062421/56649c725503460f94923114/html5/thumbnails/48.jpg)
CS 484, Spring 2015 ©2015, Selim Aksoy 48
Image formats
ASCII or binary Number of bits per pixel (color depth) Number of bands Support for compression (lossless, lossy) Support for metadata Support for transparency Format conversion …
http://en.wikipedia.org/wiki/Comparison_of_graphics_file_formats