region-level motion-based background modeling and subtraction using mrfs
DESCRIPTION
Region-Level Motion-Based Background Modeling and Subtraction Using MRFs. Shih-Shinh Huang Li-Chen Fu Pei-Yung Hsiao 2007 IEEE. Abstract. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/1.jpg)
Region-Level Motion-Based Region-Level Motion-Based BackgroundBackground
Modeling and Subtraction Modeling and Subtraction Using MRFsUsing MRFsShih-Shinh HuangShih-Shinh Huang
Li-Chen FuLi-Chen FuPei-Yung HsiaoPei-Yung Hsiao
2007 IEEE2007 IEEE
![Page 2: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/2.jpg)
AbstractAbstract
This paper presents a new approach to aThis paper presents a new approach to automatic segmentation of foreground outomatic segmentation of foreground objects from an image sequence by integrbjects from an image sequence by integrating techniques of background subtracating techniques of background subtraction and motion-based foreground segmtion and motion-based foreground segmentation.entation.
![Page 3: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/3.jpg)
OutlineOutline
INTRODUCTIONINTRODUCTION REGION-BASED MOTION REGION-BASED MOTION
SEGMENTATIONSEGMENTATION BACKGROUND MODELINGBACKGROUND MODELING MRFS-BASED CLASSIFICATIONMRFS-BASED CLASSIFICATION RESULTSRESULTS CONCLUSIONCONCLUSION
![Page 4: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/4.jpg)
INTRODUCTIONINTRODUCTION
In many applications, success of detecting foreground regions from a static background scene is an important step before high-level processing.
In real-world situations, there exist several kinds of environment variations that will make the foreground detection more difficult.
![Page 5: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/5.jpg)
Several kinds of environment variations
Illumination VariationGradual illumination variationSudden illumination variationShadow
Motion VariationGlobal motionLocal motion
![Page 6: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/6.jpg)
System Overview
![Page 7: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/7.jpg)
REGION-BASED MOTION REGION-BASED MOTION SEGMENTATIONSEGMENTATION
motion vector
![Page 8: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/8.jpg)
Region Projection
Projecting regions in the previous frame to the current one, is to facilitate the segmentation.
![Page 9: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/9.jpg)
Motion Marker Extraction
The output of this step is a set of motion-coherent regions, all pixels within a region comply with a motion model.
![Page 10: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/10.jpg)
![Page 11: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/11.jpg)
Boundary Determination
Merge uncertain pixels to one of the markers.
![Page 12: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/12.jpg)
![Page 13: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/13.jpg)
BACKGROUND MODELINGBACKGROUND MODELING
A brief description of Stauffer and Grimson’s work is first given and then we introduce the Bhattacharyya distance as the difference measure between the region from the region-based motion segmentation and the one represented by the background model.
![Page 14: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/14.jpg)
Adaptive Gaussian Mixture Models
![Page 15: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/15.jpg)
Bhattacharyya Distance
![Page 16: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/16.jpg)
Shadow effectShadow effect
However, the region similarity defined in this way will lead to misclassification of the background region where direct light is blocked by the foreground object.
![Page 17: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/17.jpg)
An example of shadow An example of shadow effecteffect
![Page 18: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/18.jpg)
MRFS-BASED MRFS-BASED CLASSIFICATIONCLASSIFICATION
Incorporate the background model to classify every region in the segmentation map SM into either a foreground object or a background one by MRFs.
![Page 19: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/19.jpg)
MRFs Framework
![Page 20: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/20.jpg)
Region Classification
![Page 21: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/21.jpg)
![Page 22: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/22.jpg)
RESULTSRESULTS
![Page 23: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/23.jpg)
![Page 24: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/24.jpg)
![Page 25: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/25.jpg)
![Page 26: Region-Level Motion-Based Background Modeling and Subtraction Using MRFs](https://reader035.vdocument.in/reader035/viewer/2022062804/568149d5550346895db6fd4d/html5/thumbnails/26.jpg)
CONCLUSIONCONCLUSION
Experimental results demonstrate that our proposed method can successfully extract the foreground objects even under situations with illumination variation, shadow, and local motion.
Our on-going research is to develop a tracking algorithm which can be used track the detected object.