efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · gamma...
TRANSCRIPT
![Page 1: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/1.jpg)
IEEE Transaction on Image Processing
vol. PP, No. 99, 2012
Shi-Chia Huang, Fan-Chieh Cheng, and Yi-Sheng Chiu
Presented by Shu Ran
School of Electrical Engineering and Computer Science
Kyungpook National Univ.
Efficient contrast enhancement using
adaptive gamma correction with
weighting distribution
![Page 2: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/2.jpg)
Abstract
Proposed method
– Automatic modifying histogram and enhancing contrast
– Improving brightness of dimmed images
• Gamma correction
• Probability distribution of luminance pixels
– Enhancing video
• Using temporal information
− Regarding differences between each frame
» Reducing computational complexity
2/29
![Page 3: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/3.jpg)
Introduction
Concept of contrast enhancement
– Improving visual quality
• Computer vision and pattern recognition and image processing
– Circumstance resulting poor contrast
• Lack of operator expertise
• Inadequacy of image capture device
• Environmental conditions in captured scene
− Obscuring details of image or video feature
– Two categories of contrast enhancement
• Direct enhancement
− Directly defining contrast by specific contrast term
» Cannot simultaneously gauging contrast of simple and complex
patterns
3/29
![Page 4: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/4.jpg)
• Indirect enhancement
− Redistributing probability density
» Histogram modifications techniques
Gamma correction techniques
– Using varying adaptive parameter
• Simple form of transform-based gamma correction
− Different images exhibiting same changes in intensity
» Using probability density function
max max/T l l l l
(1)
maxlwhere is the maximum intensity of the input
/lpdf l n MN (2)
where is the number of pixels that have intensity ,
and is the total number of pixels in the image ln l
MN
4/29
![Page 5: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/5.jpg)
» Cumulative distribution function
• Traditional histogram equalization
− Using cdf as transformation curve
• Transformation curves
0
l
k
cdf l pdf k
(3)
maxT l cdf l l (4)
Fig. 1. Transformation curves illustrated by (a) gamma
correction and (b) THE methods, with their corresponding
intensity level modifications shown in (c) and (d). 5/29
![Page 6: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/6.jpg)
Previous works
Approaches of THE and TGC methods
– Earlier works in sub-histograms as 1D histogram
• BBHE calculating mean intensity as threshold value
• DSIHE using median intensity
− RSIHE using multi-equalizations reducing artifacts
− RSWHE using weighting function to smooth sub-histogram
» Losing some statistical information
• BPHEME maximizing entropy of enhanced image via histogram
speciation
– 2D histogram for generating contextual and variational information
• Gaussian mixture model
− Compensating for gray-level distribution of image
• Contextual and variational contrast
− Constructing priori probability
6/29
![Page 7: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/7.jpg)
Proposed method
Proposing hybrid HM method
– Compensating limitations of previous methods
– Creating balance
• Between high levels of visual quality and low computational costs
− Utilizing efficiently combining TGC and THE methods
– Proposing cdf and applied normalized gamma function
• Modifying transformation curve
− Without losing available histogram of statistics
• Proposed adaptive gamma correction
− Increasing low intensity
− Avoiding significant decrement of high intensity
1
max max max max/ /cdf l
T l l l l l l l
(5)
7/29
![Page 8: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/8.jpg)
• Applying weighting distribution function
− Slightly modifying statistical histogram
− Lessen generation of adverse effects
− Modified cdf function
− Sum of
min
max
max min
w
pdf l pdfpdf l pdf
pdf pdf
(6)
where is the adjusted parameter,
is the maximum pdf of statistical histogram,
and is minimum pdf
maxpdf
minpdf
max
0
/l
w w w
k
cdf l pdf l pdf
(7)
wpdf
max
0
l
w w
l
pdf pdf l
(8)
8/29
![Page 9: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/9.jpg)
− Gamma parameter based on cdf
– Using HSV color model for enhancing only luminance intensity
• By proposed AGC and WD method
• Flow chart of AGCWD method
(9) 1w
cdf l
Fig. 2. The flowchart of the AGCWD method.
9/29
![Page 10: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/10.jpg)
– Proposing temporal-based technique
• Reducing computational complexity for video sequence
Fig. 3. The flowchart of the TB method applied to a video sequence.
10/29
![Page 11: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/11.jpg)
• Approximating information content of each frame
max
0
logl
l
H pdf l pdf l
(10)
11/29
![Page 12: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/12.jpg)
Experimental results
Summarizing experimental results
– Image-contrast enhancement
• Enhancing various grayscale and color images
− Following same decomposition of histogram used by previous
– Considering illumination conditions
• Indoor and outdoor scenes
12/29
![Page 13: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/13.jpg)
Visual assessment
– Performance of each method
• Measured by four grayscale images
Fig. 4. The “blackboard” image: (a) is the original image with its
corresponding statistical histogram; the remaining nine images are
the enhancement results with modified histograms generated by the
(b) THE, (c) BBHE, (d) DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC,
(h) AWMHE, (i) CVC, and (j) AGCWD methods. 13/29
![Page 14: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/14.jpg)
• Grayscale image of truck
Fig. 5. (a) is the original image with its corresponding statistical
histogram; the remaining nine images are the enhancement results
with modified histograms generated by the (b) THE, (c) BBHE, (d)
DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,
and (j) AGCWD methods. 14/29
![Page 15: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/15.jpg)
– Grayscale image of viaduct
Fig. 6. (a) is the original image with its corresponding statistical
histogram; the remaining nine images are the enhancement results
with modified histograms generated by the (b) THE, (c) BBHE, (d)
DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,
and (j) AGCWD methods. 15/29
![Page 16: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/16.jpg)
– Grayscale image of warplane
Fig. 7. (a) is the original image with its corresponding statistical
histogram; the remaining nine images are the enhancement results
with modified histograms generated by the (b) THE, (c) BBHE, (d)
DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,
and (j) AGCWD methods. 16/29
![Page 17: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/17.jpg)
– Visual assessment for color image
• Color image of man
Fig. 8. (a) is the original image with its corresponding statistical
histogram; the remaining nine images are the enhancement results
with modified histograms generated by the (b) THE, (c) BBHE, (d)
DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,
and (j) AGCWD methods.
17/29
![Page 18: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/18.jpg)
• Color image of square
Fig. 9. (a) is the original image with its corresponding statistical
histogram; the remaining nine images are the enhancement results
with modified histograms generated by the (b) THE, (c) BBHE, (d)
DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,
and (j) AGCWD methods.
18/29
![Page 19: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/19.jpg)
• Color image of sky
Fig. 10. (a) is the original image with its corresponding statistical
histogram; the remaining nine images are the enhancement results
with modified histograms generated by the (b) THE, (c) BBHE, (d)
DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,
and (j) AGCWD methods.
19/29
![Page 20: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/20.jpg)
• Color image of road
Fig. 11. (a) is the original image with its corresponding statistical
histogram; the remaining nine images are the enhancement results
with modified histograms generated by the (b) THE, (c) BBHE, (d)
DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,
and (j) AGCWD methods.
20/29
![Page 21: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/21.jpg)
Quantitative evaluation
– Classifying objective metrics
• Full-reference and no-reference and reduced-reference
– Focusing on FR method
• Highlighting use of distortion-free image
− As reference image for assessment
– Snapshots of environment and devices
• Consumer camera and ColorChecker
• Illumination meter to perform quantitative evaluation
− In specific dark room
Fig. 12. Snapshots of environments and devices.
21/29
![Page 22: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/22.jpg)
• Color information of blocks in ColorChecker
Table 1. The standard RGB(sRGB) values of ColorChecker
22/29
![Page 23: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/23.jpg)
• Capturing images of ColorChecker in low-light condition
Fig. 13. The ColorChecker image: (a) is the original set of images;
the remaining nine sets of images are the enhancement results with
modified histograms generated by the (b) THE, (c) BBHE, (d) DSIHE,
(e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC, and (j)
AGCWD methods 23/29
![Page 24: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/24.jpg)
• Quantitative evaluations assessed via AMBE and △E94
Table 2. AMBE assessment of contrast enhancement methods
Table 3. △E94 assessment of contrast enhancement methods
24/29
![Page 25: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/25.jpg)
Enhancement of video sequence
– Provided for comparison
Fig. 14. Seven sampled frames of the “campus” sequence and the
enhancement results generated by each method. 25/29
![Page 26: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/26.jpg)
– Home color video and enhancement results
Fig. 15. Seven sampled frames of the “home” sequence and the
enhancement results generated by each method.
26/29
![Page 27: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/27.jpg)
– Using feature similarity index
• For measuring difference between TB and proposed method
Fig. 16. The FSIM of each frame generated by the TB method for
the (a) “campus” and (b) “home” sequences.
27/29
![Page 28: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/28.jpg)
– Improved rate of frames per second
• By TB method
Table 4. Performance evaluation for the proposed TB method
28/29
![Page 29: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based](https://reader034.vdocument.in/reader034/viewer/2022051815/603f5bdb226b3c151859b95d/html5/thumbnails/29.jpg)
Conclusion
Proposed method
– Novel enhancement method for images and video sequence
– Three major steps
• Histogram analysis providing spatial information of single image
− Based on probability and statistical inference
• Using weighting distribution to smooth fluctuant
− Avoiding generation of unfavorable artifacts
• Automatically gamma correction
− Using smooth curve
– Reducing computational time
29/29