digital image processing - columbia universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf ·...
TRANSCRIPT
![Page 1: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/1.jpg)
1/29/2008 1
Digital Image ProcessingELEN E4830
Professors:Shahram EbadollahiLexing Xie
![Page 2: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/2.jpg)
1/29/2008 2
General Information
Spring 2008Mondays 4:10~6:40pmLocation: Eng. Mudd 1127Credits: 3.0Offered on CVN
4:10~5:20 part 1
5:20~5:30 break
5:30~6:40 part 2
Target audience:First year Graduate and Senior level students
Course Webpage http://www.ee.columbia.edu/~xlx/ee4830/
![Page 3: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/3.jpg)
1/29/2008 3
Staff
� Lecturers/Staff:� Shahram Ebadollahi
Research Staff Member, IBM T.J. Watson ResearchPhD from Columbia U. EE dept.
� Lexing XieResearch Staff Member, IBM T.J. Watson ResearchPhD from Columbia U. EE dept.
� TA: Wei Liu
![Page 4: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/4.jpg)
1/29/2008 4
How to reach us?
� Shahram Ebadollahi� E-mail: [email protected]� Office hours: Mondays 3:00~4:00pm� Office: 1312 Mudd
� Lexing Xie� E-mail: [email protected]� Office hours: Mondays 3:00~4:00pm� Office: 1312 Mudd
� Wei Liu� E-mail: [email protected]� Office hours:TBD� Office: 711 CEPSR� Mailbox:TBD
Please contact the lecturer of the week
for problems/question related to each
lecture!
![Page 5: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/5.jpg)
1/29/2008 5
Our research
� Shahram Ebadollahi� Image/Video content understanding� Medical imaging informatics
� Lexing Xie� multimedia content analysis, data mining� statistical learning and signal processing in multimedia
![Page 6: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/6.jpg)
1/29/2008 6
Pre-requisites
� Signals & Systems� Linear Algebra� Probability
� If you haven’t taken these courses please see us after the class TODAY!
![Page 7: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/7.jpg)
1/29/2008 7
Outline
� Part I [Shahram Ebadollahi]
� Course protocol, policy, and all that� Introduction to DIP and examples of applications� Course outline� Brief review of signals and systems
� Break
� Part II [Lexing Xie]
� Introduction to MATLAB for Image Processing� Brief review of linear algebra and probability
![Page 8: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/8.jpg)
1/29/2008 8
Course Protocols & Policies
![Page 9: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/9.jpg)
1/29/2008 9
Course textbook
� Digital Image Processing, 3rd Editionby Gonzalez and Woods, Prentice Hall 2008 (ISBN 9780131687288)
� Very well written book� Broad coverage of the subject� Accessible by wide audience
� Other references: see course web-page!
![Page 10: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/10.jpg)
1/29/2008 10
Assignments
� 6 assignments
� Due at: END OF DAY OF CLASS IN TA’s MAILBOX OR EMAIL INBOX! (NO EXCEPTIONS)� Solutions and graded homeworks will be handed out the week after you hand in your
assignments.
� Types of questions in the assignment:
� Analytical
� ExperimentalA problem which require some programming and experimentation. e.g.
1) change parameters of an image processing algorithm, observe the effect, comment on your findings
2) how do you think this image could be enhanced? Show it! Why this approach?
![Page 11: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/11.jpg)
1/29/2008 11
2 Exams
� Midterm (03/10/2008)� 150 minutes� Open book
� Final� 3 hours� Open book
![Page 12: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/12.jpg)
1/29/2008 12
Grading Policy
� Homeworks: 30%
� Midterm: 30%
� Final: 40%� All material will be covered in the final exam
![Page 13: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/13.jpg)
1/29/2008 13
DIP Introduction
![Page 14: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/14.jpg)
1/29/2008 14
Eye Physiology
![Page 15: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/15.jpg)
1/29/2008 15
Eye Physiology & Visual Perception
Rods & Cones Distribution in Retina
•6~7 Million
•Highly sensitive to color
•Concentrated in Fovea
•Photopic (day light) vision
•75~150 Million
•Sensitive to low illumination
•Distributed over Retina
• Scotopic (dim light) vision
Photoreceptor Cells
![Page 16: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/16.jpg)
1/29/2008 16
Electromagnetic Spectrum & more
Gamma X-ray Optical Infrared Radio
Cra
b P
ulsa
r
![Page 17: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/17.jpg)
1/29/2008 17
Image
� Image = 2d function
Ryxf ∈),( Ryx ∈,
),().,(),( yxryxiyxf =
Illumination reflectance
Fyxf ≤≤ ),(0
![Page 18: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/18.jpg)
1/29/2008 18
Image
� Image = 2d function
Ryxf ∈),( Ryx ∈,
x
y
),().,(),( yxryxiyxf =
Illumination reflectance
Fyxf ≤≤ ),(0
Yy
Xx
≤≤≤≤
0
0
![Page 19: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/19.jpg)
1/29/2008 19
Digital Image
x
y� Discretization
� Spatial sampling� Quantization
Znmf ∈),( Znm ∈,
)0,0(
)1,1( −− NM
m
n
10
10
−≤≤−≤≤
Nn
Mm1),(0 −≤≤ Lnmf
0
L-1
Picture Element
(Pixel, Pel)
![Page 20: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/20.jpg)
1/29/2008 20
Digital Image
x
y
−−−−
−−
=
)1,1()1,1()0,1(
)1,1()1,1()0,1(
)1,0()1,0()0,0(
NMfMfMf
Nfff
Nfff
f
�
����
�
�
![Page 21: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/21.jpg)
1/29/2008 21
Color Image
R
G
B
0
255
0
255
0
255
Rα
Gα
Bα
![Page 22: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/22.jpg)
1/29/2008 22
Digital Image Processing
Low level
Mid level
=
Px
x
x
x�
2
1
High level
![Page 23: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/23.jpg)
1/29/2008 23
![Page 24: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/24.jpg)
1/29/2008 24
Digital Image Processing
Low level
Mid level
=
Px
x
x
x�
2
1
High level
Communication & Storage
![Page 25: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/25.jpg)
1/29/2008 25
What are we going to study?
Applications: medical, cbir, ...SE5.513
Image Compression (ch8)LX4.2812
Object Recognition (ch12)LX4.2111
Image Description (ch11)SE4.1410
Image Segmentation (ch10)SE4.79
Morphological Image Processing (ch9)SE3.318
Image Restoration (ch5)LX3.247
3.10Mid-term
More Image Transform, Wavelets (ch7)LX3.36
Image Enhancement in Frequency Domain (ch4)LX2.255
Image Enhancement in Spatial Domain (ch3& 6)LX2.184
Gray-level, Color and Multi-band Images (ch3 & 6), Video
SE2.113
Digital Image Fundamentals (ch2): Sensing, Sampling, and Quantization
SE2.42
Course Mechanics, Introduction to Image Processing, Introduction to MATLAB
SE/LX1.281
SubjectLecturerDateLecture No.
![Page 26: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/26.jpg)
1/29/2008 26
Why study DIP?
� Image & video is a major communication media� “An image is worth 1000 words!”
� In all application domains, image and video is becoming indispensable
� WWW, faster computation, more storage, proliferation of image capture and consumption devices � Need for more, better, faster, and more intelligent image and video analysis
� It’s fun!
![Page 27: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/27.jpg)
1/29/2008 27
Application Domains� Consumer domain
� Storage, tagging, searching,…� Remote sensing
� Agriculture, Urban growth monitoring, …
� Medical� CAD, quantification, organization,
assisted surgery, …
� Space explorations � Image mosaic, image matching,
…� Art
� Working methods of painters, material used, …
� Security� Military� … and many more!
![Page 28: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/28.jpg)
1/29/2008 28
Application Domains
� Consumer domain� Storage, tagging,
searching,…
mountain, snow, buildings, sky
![Page 29: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/29.jpg)
1/29/2008 29
Application Domains
� Remote sensing� Agriculture, Urban growth
monitoring, …
Urban growth in Washington D.C. between 1973 and 1985
[Image courtesy of NASA/LANDSAT]Multi-spectral imaging
![Page 30: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/30.jpg)
1/29/2008 30
Application Domains
� Medical� CAD, quantification,
organization, assisted surgery, …
Color doppler Echocardiogram Brain MRI Cardiac CT
Tissue Microscopy Spine X-rayBrain PET (Alzheimers)
![Page 31: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/31.jpg)
1/29/2008 31
Application Domains
� Space explorations � Image mosaic, image
matching, …
Panoramic image built from images taken from mars rover Spirit
[image courtesy of NASA/JPL/Cornell]
![Page 32: Digital Image Processing - Columbia Universityxlx/courses/ee4830-sp08/notes/lect1-parta.pdf · Introduction to DIP and examples of applications ... Digital Image Processing, ... Spatial](https://reader033.vdocument.in/reader033/viewer/2022051205/5abb75917f8b9a297f8ce6b2/html5/thumbnails/32.jpg)
1/29/2008 32
Review of Signals & Systems