image enhancement - southeast universitycse.seu.edu.cn/personalpage/bao.list/enhancement.pdf ·...

54
Image Enhancement

Upload: hahuong

Post on 07-Aug-2018

218 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Image Enhancement

Page 2: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Image Qualities

• Gray distribution

– Gray level mapping

• Noise level

– Image smoothing

• Contour sharpness

– Image sharpening

2011-fall LIST 2

Page 3: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Gray Histogram

2011-fall LIST 3

Histogram h(rk) = nk rk=[0, L-1]

kyx

k ryxfcountn ),(),(

nnrhk

k

k

k )(

normalized histogram :

n

n

n

rhrp kkk

)()(

1)(0 krp

1)( k

krpprobability density

Page 4: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Gray Histogram

2011-fall LIST 4

0

200

400

600

800

1000

0 50 100 150 200 250

Page 5: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Gray Histogram

2011-fall LIST 5

0

1000

2000

3000

4000

5000

6000

0 50 100 150 200 250

Page 6: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Gray Histogram

2011-fall LIST 6

0

0.5

1

1.5

2

2.5

x 104

0 50 100 150 200 250

Page 7: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Gray Histogram

2011-fall LIST 7

0

500

1000

1500

2000

2500

3000

3500

4000

4500

5000

0 50 100 150 200 250

Page 8: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Gray Histogram

2011-fall LIST 8

0

1000

2000

3000

4000

5000

6000

0 50 100 150 200 250

Page 9: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Gamma Correction

2011-fall LIST 9

inout II

Page 10: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Gamma Correction

2011-fall LIST 10

Page 11: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Gray Mapping

2011-fall LIST 11

Page 12: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 12

Page 13: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 13

Page 14: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Histogram Equalization

2011-fall LIST 14

PDF:

Page 15: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Histogram Equalization

2011-fall LIST 15

0

500

1000

1500

2000

2500

3000

3500

4000

4500

5000

0 50 100 150 200 250

0

500

1000

1500

2000

2500

3000

3500

4000

4500

5000

0 50 100 150 200 250

Page 16: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 16

R

B

G (0,0,0)

(1,0,0)

(0,1,0)

(0,0,1)

Red

Blue

Green

Yello

Black

White

Cyan

Magenta

红 黄

绿

品红

RGB

Page 17: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 17

Additive System Subtractive System

Page 18: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 18

HSI

Page 19: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Color Image Histogram Equalization

2011-fall LIST 19

Page 20: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 20

1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping (GLG) : an automatic method for optimized image contrast enhancement – part I : the basic method', IEEE Trans Image Proc, 15(8), 2006 : 2290-2302

2. N Bassiou, C Kotropoulos, ‘Color image histogram equalization by absolute discounting back-off’, Computer Vision and Image Understanding, Vol 107, 2006: 108-122

Assignment

Page 21: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Image Smoothing

Page 22: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Spectrum Properties

2011-fall LIST 22

0 50 100 150 200 250 30050

100

150

200

250

300

gray levels on line 256

0 50 100 150 200 250 3000

500

1000

1500

2000

2500

3000

spectrum on line 256

Page 23: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Spectrum Properties

2011-fall LIST 23

0 50 100 150 200 250 30050

100

150

200

250

300

0 50 100 150 200 250 3000

500

1000

1500

2000

2500

3000

Gaussian noise

μ = 0 σ=0.01

Page 24: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 24

0 50 100 150 200 250 30050

100

150

200

250

300

0 50 100 150 200 250 30050

100

150

200

250

300

0 50 100 150 200 250 3000

500

1000

1500

2000

2500

3000

gray levels spectrum

original signal

with noise

0 50 100 150 200 250 3000

500

1000

1500

2000

2500

3000

Page 25: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Image Averaging

2011-fall LIST 25

tt

tnN

ItIN

I )(1

)(1

Original Image without noise: I

Samples of original image with noise : I(t), (t=0,1,...,N-1)

)()( tnItI n(t) → Gaussian distribution

Page 26: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

sample 8 frames averaging 16 frames averaging

64frames averaging 128frames averaging

2011-fall 26 LIST

Page 27: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall 27 LIST

Page 28: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Lowpass Filter

2011-fall LIST 28

G(u,v) = H(u,v) F(u,v)

H(u,v) : filter transfer function

F(u,v) : image in frequency domain

G(u,v) : output in frequency domain

g(x,y) = h(x,y) f(x,y)

h(x,y) : point spread function

Linear Filter H(·)

F(u,v) G(u,v)

u

|F(u)|

u0 0

0

1)u(H

(|u|≤u0)

otherwise

Understanding of Lowpass Filter H(u)

Noise ↔ Edge

Page 29: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Lowpass Filter

2011-fall LIST 29

Ideal lowpass filter

point spread function

0 20 40 60 80 100 120 140-0.04

-0.02

0

0.02

0.04

0.06

0.08

0.1

Page 30: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Lowpass Filter

2011-fall LIST 30

Gaussian filter

22 2/)( uAeuH 22222)( xAexh

0 20 40 60 80 100 120 1400

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0 20 40 60 80 100 120 1400.2

0.25

0.3

0.35

0.4

0.45

0.5

0.55

Page 31: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Lowpass filter

2011-fall LIST 31

Average filter

0 20 40 60 80 100 120 140-0.04

-0.02

0

0.02

0.04

0.06

0.08

0.1

transfer function

0 20 40 60 80 100 120 1400

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

point spread function

otherwise

axaxh

0

)2/2/(1)(

2/

2/

2)(a

a

uxj dxeuH

uj

ee aujauj

2

u

au

)sin(

Page 32: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 32

0 50 100 150 200 250 3000

50

100

150

200

250

300

0 50 100 150 200 250 30020

40

60

80

100

120

140

160

0 50 100 150 200 250 30040

60

80

100

120

140

160

180

average filter

original image 3x3 5x5

Page 33: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 33

0 50 100 150 200 250 3000

50

100

150

200

250

300

Gaussian filter

original image σ=0.5

0 50 100 150 200 250 30040

60

80

100

120

140

160

180

200

220

240

0 50 100 150 200 250 30020

40

60

80

100

120

140

160

180

σ=1.0

Page 34: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Median Filter

2011-fall LIST 34

nonlinear filter

median value

Page 35: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 35

0 50 100 150 200 250 3000

50

100

150

200

250

300

0 50 100 150 200 250 3000

50

100

150

200

250

3x3 median filter original image

0 50 100 150 200 250 3000

50

100

150

200

250

5x5 median filter

Page 36: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Image Sharpening

Page 37: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Edges

2011-fall LIST 37

x

G(x)

x

G(x)

x

G(x)

Ideal Edge

Sharp Edge

Blurred Edge

Edge ↔ Noise

Page 38: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 38

Page 39: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 39

Page 40: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 40

Median Filter Gaussian Filter Average Filter

Page 41: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 41

Median Filter Gaussian Filter

Average Filter

Page 42: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 42

Gaussian Filter

Page 43: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 43

Page 44: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 44

Page 45: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Unsharp Masking

2011-fall LIST 45

Low Pass

High Pass

+

×

Input f(x,y) Output g(x,y)

α

Page 46: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 46

Page 47: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 47

Page 48: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 48

Page 49: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 49

Page 50: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

Contrast Enhancement

2011-fall LIST 50

Page 51: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 51

Page 52: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 52

Page 53: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 53

Page 54: Image Enhancement - Southeast Universitycse.seu.edu.cn/PersonalPage/bao.list/Enhancement.pdf · 2011-fall LIST 20 1. Z Chen, R R Abidi, D L Page, and M A Abidi, 'Gray-level grouping

2011-fall LIST 54