analysis of texture and oriented patterns in biomedical images › ~ranga › enel697 ›...

61
Rangaraj M. Rangayyan Professor Emeritus of Electrical and Computer Engineering University of Calgary, Alberta, Canada Contains material from R.M. Rangayyan, Biomedical Image Analysis,”© CRC Press, 2005 Analysis of Texture and Oriented Patterns in Biomedical Images

Upload: others

Post on 07-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Rangaraj M. RangayyanProfessor Emeritus of Electrical and Computer Engineering

University of Calgary, Alberta, Canada

Contains material from R.M. Rangayyan, “Biomedical Image Analysis,” © CRC Press, 2005

Analysis of Texture and Oriented Patterns in Biomedical Images

Page 2: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Detection and Analysis of Regions in Images

After regions of interest (ROIs) have been detected and extracted from a given image, they may be analyzed for

representation or characterization description feature extraction pattern classification and image understanding

2

Page 3: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Description of Regions

External characteristics: boundary or contour morphology (shape) boundary roughness and sharpness boundary complexity

Internal characteristics: gray level color statistics of pixel population texture

3

Page 4: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

4

Examples of Texture

Page 5: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

5

Examples of Texture

Page 6: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

6

Examples of Texture

Page 7: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

7

Models for the Synthesis of Texture

Page 8: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Synthesis of Random Texture: Spot Noise

8

Page 9: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

9

Synthesis of Random Texture: Spot Noise

Page 10: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

10

Fractals

Self Similarity:repetition at multiple scales

Page 11: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

11

Fractional Brownian Motion and 1/f Models of Fractals

Page 12: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

12

Analysis of Texture

Page 13: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

13

Analysis of Texture

Page 14: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

14

Derivation of the Gray-level Cooccurrence Matrix

Page 15: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

15

The Gray-level Cooccurrence Matrix

Page 16: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

16

Analysis of Texture using the GCM

Page 17: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

17

Analysis of Texture using the GCM

Page 18: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

18

Analysis of Texture using the GCM

Page 19: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

19

Analysis of Texture using the GCM

Page 20: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

20

Analysis of Texture using the GCM

Page 21: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

21

Analysis of Texture using the GCM

Page 22: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

22

Analysis of Texture using the GCM

Page 23: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

23

Extraction of regions of interest or selected pixels for the computation of texture and gradient measures

Page 24: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

24

Page 25: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

25

Fourier Spectral Analysis of Texture

Page 26: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

26

Synthesis of

Periodic Texture

Page 27: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

27

Fourier Spectrum in Polar Coordinates

Page 28: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

28

Page 29: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

29

Page 30: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

30

Page 31: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Laws’ Convolution Operators

A method for classifying each pixel in an image based upon measures of local “texture energy”

The texture energy features represent the amounts of gray-level variation within a sliding window

The basic Laws’ operators are: L3 = [ 1 2 1] (center-weighted averaging) E3 = [ -1 0 1] (edge detection) S3 = [ -1 2 -1] (spot detection)

Nine 3×3 masks can be generated by multiplying the transposes of the operators: L3TE3 = a Sobel mask.

31

Page 32: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Laws’ Convolution Operators

Operators of length five pixels may be generated by convolving L3, E3, and S3 in various combinations:L5 = L3 * L3 = [ 1 4 6 4 1 ] (local average)E5 = L3 * E3 = [ -1 -2 0 2 1 ] (edges)S5 = -E3 * E3 = [ -1 0 2 0 -1 ] (spots) R5 = -S3 * S3 = [ 1 -4 6 -4 1 ] (ripples)W5 = -E3 * S3 = [ -1 2 0 -2 1 ] (waves)

Some 5×5 convolution operators: L5L5 = L5TL5 W5W5 = W5TW5 R5R5 = R5TR5

32

Page 33: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Results of Laws’ Operators

L5L5 E5E5

S5S5 W5W5 R5R5 33

Page 34: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Laws’ Texture Energy MeasuresSum of the absolute values in a 15×15 window

L5L5 E5E5

S5S5 W5W5 R5R5 34

Page 35: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Fractal Analysis of Grayscale Images: Blanket Method

35

Page 36: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Fractal Analysis of Grayscale Images: Blanket Method

36

Page 37: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Fractal Analysis of Grayscale Images: Spectral Method

1. Compute the 2D Fourier transform of the image2. Compute the 2D power spectral density (PSD)3. Transform the 2D PSD into a 1D PSD by radial averaging4. Fit a straight line to a selected range of frequencies of the

1D PSD on a log−log scale5. Determine the slope β of the best-fitting straight line

37

Page 38: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Fractal Analysis of Grayscale Images: Example

38

Page 39: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

39

A TP ROI, s(x, y) Fourier power spectrum, S(u, v)

Power spectrum inpolar coords, S(f, θ)

θ

f

Angular spread of power, S(θ)

Radial frequencyspectrum, S(f)

Fractal and Spectral Analysis of Mammograms

Page 40: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

40

θ

A FP ROI, s(x, y) Power spectrum inpolar coords, S(f, θ)

f

Angular spread of power, S(θ)

Radial frequencyspectrum, S(f)

Fourier power spectrum, S(u, v)

Fractal and Spectral Analysis of Mammograms

Page 41: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

41

Analysis of Oriented Texture:Sector or Fan Filtering

Page 42: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

42

Page 43: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

43

Page 44: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

44

Gabor Filters

Page 45: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

45

Gabor Filter: Impulse Response

Page 46: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

46

Gabor Filter: Impulse Response

Page 47: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

47

Gabor Filter: Frequency Response

Page 48: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

48

Page 49: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

49

Multiscale Analysis with Gabor Filters

Page 50: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

50

Gabor Filter: Design Parameters

( ) ( )xfyxyxyxyx

πσσσπσ

2cos21exp

21,g 2

2

2

2

+−=

Design parameters

′′

−=

=

==

yx

yx

l

f

xy

x

θcosθsinθsinθcos

;

2ln22;1

σσ

τστ

Gabor parameters

• line thickness τ• elongation l• orientation θ

Page 51: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

51

Gabor Filters: Impulse and Frequency Responses

Page 52: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

52

Multiscale Analysis with Gabor Filters: Frequency Response

Page 53: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

53

Gabor Filtering of a Mammogram

Page 54: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Analysis of bilateral asymmetry

The directional distribution of fibroglandular tissue differs between the left and right breasts

54

Page 55: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

55

Directional analysis of collagen fibers in ligaments using sector or fan filters

Page 56: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

56

Page 57: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

57

Page 58: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

58

Page 59: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

59

Page 60: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Conclusion

Texture and fractal analysis of biomedical images can provide useful features for computer-aided diagnosis

60

Page 61: Analysis of Texture and Oriented Patterns in Biomedical Images › ~ranga › enel697 › TextureAnalysis.pdf · texture 3. 4 Examples of Texture. 5 Examples of Texture. 6 Examples

Thank you! Natural Sciences and

Engineering Research Council of Canada

My collaborators and students

http://people.ucalgary.ca/~ranga/enel697/

61