video for virtual reality - christian richardt · 2017-08-13 · • virtual reality...
TRANSCRIPT
![Page 1: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/1.jpg)
COURSES
http://richardt.name/pub/Video4VR/
James Tompkin
Introduction by
![Page 2: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/2.jpg)
COURSES
http://richardt.name/pub/Video4VR/
James Tompkin
Introduction by
![Page 3: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/3.jpg)
COURSES
http://richardt.name/pub/Video4VR/
James Tompkin
Introduction by
![Page 4: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/4.jpg)
WHO ARE WE?
Christian
Richardt
Oliver
Wang
Jon
Starck
Aaron
Hertzmann
Jordan
Halsey
James
Tompkin
![Page 5: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/5.jpg)
Suppose we want to look at real-world
objects on a display as if we were
looking at them in real life.
What would we need to capture?
![Page 6: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/6.jpg)
PERCEPTUAL NEEDS
A head
Rotation
![Page 7: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/7.jpg)
THE COURSE
• Introduction 09:00
• Technical Foundations
2. 360° video 09:15
![Page 8: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/8.jpg)
2. 360° VIDEO (09:15)
• 360° projections
• 360° cameras
– Stitching
– Processing
– Analysis
• Limitations & challenges of format
Oliver Wang
![Page 9: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/9.jpg)
PERCEPTUAL NEEDS
An eye
Monocular
A head
Rotation
![Page 10: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/10.jpg)
PERCEPTUAL NEEDS
A head
Rotation
Binocular stereo
‘3D’ (Not really 3D!)
Two eyes
![Page 11: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/11.jpg)
THE COURSE
• Introduction 09:00
• Technical Foundations
2. 360° video 09:15
3. Stereo 3D videos and panoramas 09:35
![Page 12: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/12.jpg)
3. STEREO 3D VIDEOS & PANOS (09:35)
• Capturing and displaying stereo 3D videos
• Viewing comfort considerations
• Editing stereo 3D videos
• Creating stereo 3D panoramas
Christian
Richardt
![Page 13: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/13.jpg)
THE COURSE
• Introduction 09:00
• Technical Foundations
2. 360° video 09:15
3. Stereo 3D videos and panoramas 09:35
Q & A + break (15 minutes) 09:55
![Page 14: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/14.jpg)
THE COURSE
• Introduction 09:00
• Technical Foundations
2. 360° video 09:15
3. Stereo 3D videos and panoramas 09:35
• Current Practice
4. Art, storytelling, and tools 10:10
5. State-of-the-art cameras 10:30
6. Industry post-production pipelines 10:50
![Page 15: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/15.jpg)
4. ART, STORYTELLING, & TOOLS (10:10)
• History of visual storytelling media.
• VR video as an art form:
– Special issues, needs, and artistic considerations.
• Editing VR footage paper highlight:
– VRemiere: In-headset Virtual Reality Video Editing
– CollaVR: Collaborative Review for VR Video
Aaron
Hertzmann
![Page 16: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/16.jpg)
5. CURRENT CAMERAS (10:30)
• Camera rigs for stereo 360 video capture.
• Stereoscopic 360 video stitching and video formats
in production.
• The practical impact on stitching in post.
• Limitations of existing camera rigs. Jon Starck
![Page 17: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/17.jpg)
6. POST PRODUCTION (10:50)
• Introduction to live-action VR production.
• Overview of different camera systems in production.
• Post-production tools: node-based compositing.
• 360 stitching pipelines: setting up rigs and stitching.
• Challenges in post: clean up and CG integration. Jon Starck
![Page 18: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/18.jpg)
THE COURSE
• Introduction 09:00
• Technical Foundations
2. 360° video 09:15
3. Stereo 3D videos and panoramas 09:35
• Current Practice
4. Art, storytelling, and tools 10:10
5. State-of-the-art cameras 10:30
6. Industry post-production pipelines 10:50
Q & A + break (15 minutes) 11:10
![Page 19: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/19.jpg)
PERCEPTUAL NEEDS
A head
Rotation
Binocular stereo
‘3D’ (Not really 3D!)
Two eyes
![Page 20: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/20.jpg)
PERCEPTUAL NEEDS
Binocular stereo
‘3D’ (Not really 3D!)
Two eyesA body
Motion parallax
‘6DoF’
![Page 21: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/21.jpg)
THE COURSE
• Introduction 09:00
• Technical Foundations
2. 360° video background 09:15
3. Stereo 3D videos and panoramas 09:35
• Current Practice
4. Art, storytelling, and tools 10:15
5. State-of-the-art cameras 10:35
6. Industry post-production pipelines 10:55
• Cutting edge 6DoF Systems
7. Light fields basics 11:25
8. Light field production and post-production 11:45
![Page 22: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/22.jpg)
7. LIGHT FIELD BASICS (11:25)
• What, why, and how?
• Capturing light fields:
– State-of-the-art cameras and future potential.
• Processing light fields:
– Filtering, editing, challenges ahead.James
Tompkin
![Page 23: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/23.jpg)
8. LIGHT FIELD VIDEO PRODUCTION (11:45)
• Developing immersive experiences using
light field camera arrays.
• Connecting Google JUMP to post-production
workflows.
• Real-time experiences using volumetric
live-action elements.
Jordan
Halsey
![Page 24: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/24.jpg)
THE COURSE
• Introduction 09:00
• Technical Foundations 09:15
• Current Practice 10:10
• Future 6DoF Systems 11:25
• Summary and outlook 12:05
– How far do we have to go?
– Q & A
– Lunch (not on us)
![Page 25: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/25.jpg)
A FEW NOTES
• A new course - feedback welcome!
• Broad audience:
– visual computing researchers
– video producers
– enthusiastic video users
• Knowledge requirement: Intermediate.
• Not enough time to talk about all the great work across research, industry, tools, and production.
![Page 26: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/26.jpg)
WHAT ARE WE NOT COVERING?
• No audio (even though it is critical)
• No haptics / proprioception
• No gustation (taste)
• No olfaction - no smell-o-vision
• Just the visual sense – the Latin video
– Plenty of exciting things here
![Page 27: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/27.jpg)
UP CLOSE AND PERSONAL
• But how?
![Page 28: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/28.jpg)
VR + VIDEO @
![Page 29: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/29.jpg)
David Laidlaw
VR &
Scientific
Visualization
YURT:
Yurt
Ultimate
Reality
Theatre
Not VR Glamping.
![Page 30: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/30.jpg)
![Page 31: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/31.jpg)
ADAM BLUMENTHAL
• Virtual Reality Artist-in-Residence
@ Brown’s Granoff Center for the Arts
• Recreating 1772 ‘Gaspee Affair’.
– Rhode Islanders attacked
tax enforcing HMS Gaspee.
![Page 32: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/32.jpg)
Harper & Brothers - Harper's New Monthly Magazine
No. 399, August, 1883.
Rhode Islanders grounded,
boarded, and torched the ship...
…including one John Brown,
after who the university is named.
![Page 33: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/33.jpg)
ADAM BLUMENTHAL
• Virtual Reality Artist-in-Residence
@ Brown’s Granoff Center for the Arts
• Recreating 1772 ‘Gaspee Affair’.
– Rhode Islanders burned
tax enforcing HMS Gaspee.
• 14 students in
VR production course.
![Page 34: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/34.jpg)
[Adam Blumenthal]
![Page 35: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/35.jpg)
[Adam Blumenthal]
![Page 36: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/36.jpg)
[Adam Blumenthal]
![Page 37: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/37.jpg)
Ivy Film Festival
@ Brown
Screened
Across the Linede la Peña, Lichtenstein, Fitzsimmons
http://www.acrossthelinevr.com/
![Page 38: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/38.jpg)
Ivy Film Festival
@ Brown
Screened
Across the Linede la Peña, Lichtenstein, Fitzsimmons
http://www.acrossthelinevr.com/
![Page 39: Video for Virtual Reality - Christian Richardt · 2017-08-13 · • Virtual Reality Artist-in-Residence @ Brown’s Granoff Center for the Arts • Recreating 1772 ‘Gaspee Affair’](https://reader033.vdocument.in/reader033/viewer/2022050409/5f860652fb133b2386033842/html5/thumbnails/39.jpg)
Welcome!
Now over to Oliver…
Oliver Wang
360° Video