cis581-02-2017-projectioncis581/lectures/fall...olpj lpj)rfdo ohqjwk lq phwhu 3urmhfwlrq sodqh lpj...

46
Creating Video and Images Stretching the sense of reality

Upload: others

Post on 20-Nov-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Creating Video and Images

S t r e t c h i n g t h e s e n s e o f r e a l i t y

Page 2: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG
Page 3: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Computational Photography

Page 4: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG
Page 5: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG
Page 6: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Field of View (Zoom)

Page 7: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG
Page 8: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Large Focal Length compresses depth

© 1995-2005 Michael Reichmann

400 mm 200 mm 100 mm 50 mm 28 mm 17 mm

Page 9: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

f

FOV depends of Focal Length

Smaller FOV = larger Focal Length

f

Page 10: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Field of View (Zoom)

Page 11: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Field of View (Zoom)

Page 12: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

http://2blowup.com/fotografia-para-egobloggers-ii/

Page 13: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG
Page 14: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Fisheye lens distortion

Page 15: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG
Page 16: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG
Page 17: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D object

Lens

CCD sensor

Pixel

Page 18: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Metric Space)

3D point

2D projection onto CCD plane

: Focal length in meter

Page 19: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Metric Space)

3D point

2D projection onto CCD plane

Focal length in meter

Projection plane

Page 20: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Metric Space)

3D point

2D projection onto CCD plane

Focal length in meter

Projection plane

Page 21: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Pixel Space)

CCD sensor (mm) Image (pixel)

: Image principal point

Page 22: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Pixel Space)

Projection plane

Focal length in pixel

Focal length in pixelCCD sensor (mm) Image (pixel)

Page 23: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Pixel Space)

Projection plane

Focal length in pixel

Focal length in pixelCCD sensor (mm) Image (pixel)

Page 24: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Pixel Space)

3D point

img img

Focal length in meter

Projection plane

img img

Page 25: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Homogeneous Coordinate

λ2D point =: 3D ray

: A point in Euclidean space ( ) can be represented by a homogeneous representation in Projective space ( ) (3 numbers).

22

Projection plane

Page 26: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Homogeneous Coordinate

λ

λ

2D point =: 3D ray

: 3D point lies in the 3D ray passing 2D image point.Homogeneous coordinate

Projection plane

Page 27: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Metric Space)

λ

2D point =: 3D ray

Projection plane

Page 28: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Pixel Space)

Projection plane

CCD sensor (mm) Image (pixel)

Homogeneous representation

Page 29: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Camera Intrinsic Parameter

Projection plane

+

Camera intrinsic parameter: metric space to pixel space

Metric spacePixel space

Page 30: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

2D Inverse Projection

Projection plane

Metric spacePixel space

Note: arrow direction

2D point == 3D ray

3D ray

The 3D point must lie in the 3D ray passing through the origin and 2D image point.

Page 31: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

3D Point Projection (Pixel Space)

3D point

img img

Focal length in meter

Projection plane

img img

Page 32: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Exercise

324 m

1280 pix

960 pix

fm ?

What f to make the height of Eifel tower appear 960 pixel distance?

21.8 mm

ccd size

m 1500 m

Page 33: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Exercise

324 m

Z ?

1280 pix

960 pix

What f to make the height of Eifel tower appear 960 pixel distance?

21.8 mm

ccd size

fm = 50 mm

Page 34: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Exercise

324 m

1500

What Zp to make the height of Eifel tower appear twice of the person?

fm = 50 mm

Z p

h e

h p

1.7 m s.t.

Page 35: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Where Was I?

Circa 1984

324 m

fm = 50 mm

Z 1

0.9 m

Z 2

250 pix

670 pix

Page 36: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Where Was I?

Circa 1984

250 pix

670 pix

200m

400m

600m

800m

1000m

Page 37: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

800 m

Where Was I?

Page 38: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Focal Length

Page 39: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Focal Length

Page 40: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Focal Length

Page 41: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Focal Length

Page 42: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

(Jaws 1975)

Dolly Zoom (Vertigo Effect)

Page 43: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Dolly ZoomGiven focal length (fm=100mm),what Z100 to make the height of the person remain the same as fm=50mm?

f100 = 100 mm

Z 100

h p H p

?

Z 50 =157.41m

Page 44: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Dolly ZoomGiven focal length (fm=100mm),what Z100 to make the height of the person remain the same as fm=50mm?

f100 = 100 mm

Z 100

h p

s.t.

H p

?

Z 50 =157.41m

Page 45: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Dolly ZoomGiven focal length (fm=100mm),what Z100 to make the height of the person remain the same as fm=50mm?

f100 = 100 mm

Z 100

h p

s.t.

H p

?

Z 50 =157.41m

Page 46: cis581-02-2017-projectioncis581/Lectures/Fall...oLPJ LPJ)RFDO OHQJWK LQ PHWHU 3URMHFWLRQ SODQH LPJ LPJ +RPRJHQHRXV &RRUGLQDWH λ ' SRLQW ' UD\ o $ SRLQW LQ (XFOLGHDQ VSDFH FDQ EH UHSUHVHQWHG

Dolly Zoom (Jaws 1975)Dolly Zoom (Vertigo Effect)