integral university ec-024 digital image processing
TRANSCRIPT
![Page 1: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/1.jpg)
Integral University
EC-024 Digital Image Processing
Piyush Charan
Assistant Professor
Department of Electronics and Communication Engineering
![Page 2: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/2.jpg)
2
Three Dimensional
Image Processing
Unit 5
![Page 3: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/3.jpg)
Three-Dimensional Image Processing
¨ Spatially Three-Dimensional Images¨ CAT (Computerized Axial Tomotography¨ Stereometry¨ Stereoscopic Display¨ Shaded Surface Display
3
![Page 4: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/4.jpg)
Basic Concept behind 3D imaging¨ If we can somehow get the sliced
images of an object and then try to reconstruct the image , then it may eventually be possible to reconstruct an object’s image in 3D.
4
![Page 5: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/5.jpg)
Optical sectioning
◦ Problem with conventional optical microscope: only structure near the focus plane is visible
◦ Serial sectioning (slicing the specimen into a series of thin sections and acquiring the image of each section) can be used to solve the problem but it has 2 major disadvantages: loss of registration when sections become separated geometric distortions
◦ Optical sectioning is achieved by digitizing the specimen with the focal plane situated at various levels along the optical axis
5
![Page 6: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/6.jpg)
Definition of Registration
¨ Image Registration is a process of overlaying two or more digital images of the same scene taken at different times or at the same time by different image sensors.
¨ The final information(3D image) is obtained by combining various data (2D images).
6
![Page 7: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/7.jpg)
Thick specimen imaging
7
![Page 8: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/8.jpg)
Thick specimen imaging (cont’d)
– The focal length of the objective lens determines the distance df to the focal plane from the lens equation:
1/di +1/df = 1/f
and the magnification of the objective is
M = di / df
8
![Page 9: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/9.jpg)
Thick specimen imaging (cont’d)
We can place the focal plane at any desired level z’. The focal plane of the objective is related to the other microscope parameters by
f = di/(M+1) = (df .M)/(M+1) = (didf)/(di+df)
and the distance from the center of the lens to the focal plane is
df = di/M = (M+1)f /M = fdi /(di-f)
9
![Page 10: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/10.jpg)
Computerized Axial Tomography (CAT)¨ Conventional radiography
– Using X-rays– Some structures in human body absorb X rays
more heavily than other structures– No lenses are used– Projection (2 dimensional) of the object is
recorded– Multiple views are frequently used to resolve
ambiguities
10
![Page 11: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/11.jpg)
Conventional radiography
11
![Page 12: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/12.jpg)
Images obtained by Conventional Radiography
12
![Page 13: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/13.jpg)
Tomography
¨ Tomography– Useful where image detail is required in deeply
imbedded structures such as those of the middle ear
– One disadvantage: high dosage of X-ray
13
![Page 14: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/14.jpg)
CAT Scan Animation
14
![Page 15: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/15.jpg)
Tomography
15
![Page 16: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/16.jpg)
CAT
¨ Computerized axial tomography (CAT)– CAT is a technique that incorporates digital
image processing to obtain 3-D images– The CAT scanner rotates about the object to
acquire a series of exposures– The resulting set of 1-D intensity functions is
used to compute a 2-D cross-sectional image of the object at the level of the beam
– The beam is moved down the object in small steps producing a 3-D image
16
![Page 17: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/17.jpg)
CAT
17
![Page 18: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/18.jpg)
Stereometry¨ Stereometry is a technique by which one can deduce the
3-D shape of an object from a stereoscopic image pair
¨ Image of the object can be recorded by measuring the
brightness of each pixel on the image plane
¨ The distance from the center of the lens to the point p
defines the range of this pixel
¨ A range image can be generated by assigning each pixel
a gray level proportional, not to its brightness, but to the
length of its pixel cone
18
![Page 19: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/19.jpg)
Stereometry
19
![Page 20: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/20.jpg)
Stereoscopic Imaging
20
![Page 21: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/21.jpg)
Range equations
¨ Range equations– Suppose that the point P, with coordinates (X0,
Y0, Z0) is located in front of the cameras
– We can show that a line from P through the center of the left camera will intersect the Z = -f plane at
21
00
00
Z
fYY
Z
fXX ll
![Page 22: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/22.jpg)
Range equations
– Similarly for the right camera
– We now setup a 2-D coordinate system in each image plane with a 180o rotation, thus
22
00
00 )(
Z
fYY-d
Z
fdXX rr
rrrr
llll
Yy-dXx
YyXx
![Page 23: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/23.jpg)
Range equations
– Now the coordinate of the point images are
and
Rearranging both equations
23
00
00
Z
fYY
Z
fXX ll
00
00 )(
Z
fYY
Z
fdXX rr
df
Zx
f
ZxX rl 00
0
![Page 24: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/24.jpg)
Range equations
Solving for Z0, gives
the normal-range equation.– We can also write
24
lr xx
fdZ
0
f
yxf
Z
R ll222
0
![Page 25: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/25.jpg)
Range equations
Substitute Z0 gives the true-range equation:
25
lr
ll
xx
yxfdR
222
![Page 26: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/26.jpg)
Range calculations¨ For each pixel in the left image, determine what pixel
position in the right image corresponds to the same point on the object. This can be accomplished on a line-by-line basis.
¨ Calculate the difference xr- xl to produce a displacement image, in which gray level represents pixel shift.
¨ Using the displacement image, calculate Zo at each pixel to produce a normal range image.
26
![Page 27: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/27.jpg)
Range calculations¨ Calculate the X and Y coordinates of each point by:
¨ Now we can calculate the X,Y,Z-coordinates of every point on the object that maps to a pixel in the camera.
¨ Finally, compute R as a function of X and Y to produce a true-range image.
27
f
ZYY
f
ZXX ll
00
00
![Page 28: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/28.jpg)
Range calculations
¨ Notes (for boresighted cameras):– If Z0 >> d , the cameras must be converged to ensure that their
fields of view overlap to include the objects in the near field. The
range equations are slightly more complex.
– If the cameras are not in the sample plane, the equations are even
more complex.
– Cameras geometry can be computed from a pair of stereo images.
28
![Page 29: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/29.jpg)
Stereo Matching
¨ The following figure illustrates a technique that locates the right image pixel position that corresponds to a particular left image pixel.
29
![Page 30: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/30.jpg)
Stereo Matching
– Suppose the given pixel in the left image has coordinates xl, yl
– Fit the imaginary windows around that pixel and the pixel having the same coordinates in the right image
– Compute a measure of agreement (using cross-correlation-- a sum of squared differences)
– Move the window in the right image to the right to find maximum agreement, thus xr-xl can be found
30
![Page 31: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/31.jpg)
Stereo Matching
Notes:• Noise tends to corrupt the image agreement measure• Increase window size to ignore noise but this
reduces the resolution of the resulting range image• It is difficult to determine the range of a smooth
surface. Projection of random texture onto such surface can be helpful
31
![Page 32: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/32.jpg)
Stereometry with Wide-Angle Cameras
¨ Used in Viking Mars Lander spacecraft¨ Two digitizing cameras (angle scanning
cameras) are spaced 1 meter apart¨ The coordinates of a pixel are given by the
azimuth and elevation angles of the centerline of its pixel cone
¨ The azimuth is the angle between the yz-plane
¨ The elevation angle is the angle between the xz-plane
¨ Normal-range equation components in terms of the two camera azimuth coordinates and are written as follow:
– is the elevation coordinate and is the same for both cameras
32
![Page 33: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/33.jpg)
Stereometry with Wide-Angle Cameras
33
![Page 34: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/34.jpg)
Stereometry with Wide-Angle Cameras
¨ The azimuth is the angle between the yz-plane
¨ The elevation angle is the angle between the xz-plane
34
![Page 35: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/35.jpg)
Stereometry with Wide-Angle Cameras
¨ Normal-range equation components in terms of the two camera azimuth coordinates and are written as follow:
¨ - is the elevation coordinate and is the same for both cameras
35
llrl
zyzxd
z
tan tan tantan
l r
l
![Page 36: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/36.jpg)
Stereometry with Wide-Angle Camera (Cont’d)
36
![Page 37: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/37.jpg)
Stereoscopic Image Display
¨ Range relation
37
z
DSxx
xx
DSz lr
rl
![Page 38: Integral University EC-024 Digital Image Processing](https://reader035.vdocument.in/reader035/viewer/2022081519/56649ea05503460f94ba3e3d/html5/thumbnails/38.jpg)
Stereoscopic Image Display
¨ If the relationship DS = fd is satisfied, the scene will appear as if
the observer had viewed it firsthand
¨ Two conditions must be met to obtain accurate reproduction of a
3-D scene:
– There should be converging lenses in front of each of the
viewer’s eyes so that the viewer can focus his/her eyes at
infinity and still see the two transparency in focus. Positive
lenses of focal equal to D are commonly used
– The viewing geometry is exact only when the viewer’s line
of sight falls along the z-axis.
38