correcting projector distortions on planar screens via homography
DESCRIPTION
Correcting Projector Distortions on Planar Screens via Homography. Daniel Hirt. Projector Devices Today. More affordable Smaller Some are even low-cost and compact. A Common Setup of a Projector Device. Mounted on ceiling. Another Common Setup. Placed on table. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/1.jpg)
Correcting Projector Distortions on Planar Screens via Homography
Daniel Hirt
![Page 2: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/2.jpg)
Projector Devices Today
• More affordable• Smaller• Some are even low-cost and compact
![Page 3: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/3.jpg)
A Common Setup of a Projector Device
Mounted on ceiling
![Page 4: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/4.jpg)
Another Common Setup
Placed on table
![Page 5: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/5.jpg)
• Cause distortions• Mild deviations may cause mild distortions,
oftenly referred to as “keystone effect”
Deviations from Recommeded Setup
![Page 6: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/6.jpg)
Basic Distortion Correction
• Most projectors offer a limited range of methods to correct a distorted image.
• Usually only “keystone correction” is available, and require manual operation.
![Page 7: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/7.jpg)
Problem Solved?
• “Keystone Correction” features in projectors does not overcome all distortions.
• Some distortions might be caused by extreme conditions of projector placement.
![Page 8: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/8.jpg)
Projection Correction On Planar Screens
• Recall the perspective projection formula, give a 3D point (x,y,z).
• We can use this to correct our image, but...• We do not have any 3D information
![Page 9: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/9.jpg)
Approaches to Get 3D Information
• Rectified Calibrated Stereo (two cameras)• Determine calibration values for:– Projector– Camera
• Each of the above can give enough information for us to correct the distorted image
![Page 10: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/10.jpg)
However, We Need to Also Know
• Intrinsic Parameters– Focal length– Principal point– Lens distortion
• Extrinsic Parameters– Translation– Rotation
Note: not all are actually required to be able to get a correction, but we need to have most for each of the participants (camera, projector)
![Page 11: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/11.jpg)
Chosen Approach - Homography
• Popular in image and video analysis• Offers a simpler approach for planar-to-planar
projection problems
![Page 12: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/12.jpg)
Using Homography
• A point (x1,y1) is projected from one plane to another point (x2,y2)
x1,y1
x2,y2
• We represent these points in homogenous coordinates
![Page 13: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/13.jpg)
Using Homography
• In homogenous coordinates we get the following pinhole model
![Page 14: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/14.jpg)
Using Homography
• Applying properties of homogenous representation where z=0 in points on planars, we get:
1
Solving an 8-DOF system
![Page 15: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/15.jpg)
Method and Setup
![Page 16: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/16.jpg)
Steps
• Get at least 4 correspondence points (usually the four corners) to solve 8-DOF system.
• Solve the homography matrix from corresponding points in captured projected image (webcam) to reference straight image.
• Apply persepective warp: H*(reference image)– “pre-warping”
• Re-project the pre-warped image
![Page 17: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/17.jpg)
Raised Issues
The model is a good approximation• Some factors are added but are not
considered in the model:– Projector and webcam’s native distortions
• In practice, we need to improve the process, for more flexibility.
![Page 18: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/18.jpg)
Improvement
• Project a chessboard pattern: 6x8 squares (5x7 inner corners)
• Detects 35 corresponding points• Scale-down the reference image to
approximate to the size of the captured image (factor of resize: diagonals on inner corners)
• Solves the Homography using RANSAC with the 35 sample points
![Page 19: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/19.jpg)
Setup and Results
-Laptop Computer-Webcam-Pico Projector-Program using OpenCV 2.4.3 library (Linux OS)
![Page 20: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/20.jpg)
Results
![Page 21: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/21.jpg)
![Page 22: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/22.jpg)
![Page 23: Correcting Projector Distortions on Planar Screens via Homography](https://reader035.vdocument.in/reader035/viewer/2022062305/56815ed4550346895dcd6941/html5/thumbnails/23.jpg)