vr / ar fundamentals - amazon s3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · vr / ar...
TRANSCRIPT
![Page 1: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/1.jpg)
VR / AR Fundamentals
Michael Naimark Visiting Associate Arts Professor
Interactive Media Arts NYU Shanghai
INTM-SHU 280C - 1 Topics in New Media & Entertainment Fall 2017
a practical guide to the big ideas
![Page 2: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/2.jpg)
VR / AR Fundamentals
1. (Funny Question) 2. What are VR / AR fundamentals? 3. Who am I? 4. Who are you? 5. Class structure 6. Assignments & grading 7. Being “positively critical”
Week 1: Introduction
![Page 3: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/3.jpg)
VR / AR Fundamentals
1. (Funny Question) 2. What are VR / AR fundamentals? 3. Who am I? 4. Who are you? 5. Class structure 6. Assignments & grading 7. Being “positively critical”
Week 1: Introduction
![Page 4: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/4.jpg)
1. (Funny Question)
![Page 5: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/5.jpg)
How do you know I’m not a movie?
![Page 6: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/6.jpg)
Mixing Board Analogy
![Page 7: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/7.jpg)
Artifacts
![Page 8: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/8.jpg)
David Hockney, installation from De Young Museum, San Francisco, 2014
![Page 9: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/9.jpg)
Michael Naimark, “Displacements”, Art Center College of Design, Pasadena, 2005
![Page 10: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/10.jpg)
VR / AR Fundamentals
1. (Funny Question) 2. What are VR / AR fundamentals? 3. Who am I? 4. Who are you? 5. Class structure 6. Assignments & grading 7. Being “positively critical”
Week 1: Introduction
![Page 11: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/11.jpg)
2. What are VR / AR fundamentals?
Begin with our sensors (our “inputs”)
• sight & sound • touch • smell & taste • (mind)
![Page 12: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/12.jpg)
2. What are VR / AR fundamentals?
Begin with our sensors (our “inputs”)
• sight & sound • touch • smell & taste • (mind)
And our effectors (our “outputs”)
• fingers & hands • head position & gaze • feet & body • voice • (mind?)
![Page 13: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/13.jpg)
2. What are VR / AR fundamentals?
What does it take to “fool” our sensors and effectors into believing a representation is real?
![Page 14: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/14.jpg)
2. What are VR / AR fundamentals?
What does it take to “fool” our sensors and effectors into believing a representation is real?
Start here . . .
![Page 15: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/15.jpg)
1 - Resolution and FidelityJiayi Wang
![Page 16: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/16.jpg)
2 - Spatiality and ImmersionJiayi Wang
![Page 17: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/17.jpg)
2 - Spatiality and ImmersionJiayi Wang
![Page 18: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/18.jpg)
2 - Spatiality and ImmersionJiayi Wang
![Page 19: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/19.jpg)
3 - Other Senses (Haptic, Smell, Taste, Mind)
Jiayi Wang
![Page 20: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/20.jpg)
4 - Input and InteractivityJiayi Wang
![Page 21: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/21.jpg)
5 - Social and LivenessJiayi Wang
![Page 22: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/22.jpg)
2. What are VR / AR fundamentals?
Different communities and applications have different priorities for these fundamentals
• Cinema or Games (“Hollywood or Silicon Valley”)
• VR or AR
• Home or Location-based or Outdoors
• Immersive or “Casual”
• Cheap or Expensive
![Page 23: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/23.jpg)
VR / AR Fundamentals
1. (Funny Question) 2. What are VR / AR fundamentals? 3. Who am I? 4. Who are you? 5. Class structure 6. Assignments & grading 7. Being “positively critical”
Week 1: Introduction
![Page 24: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/24.jpg)
3. Who am I?
“Michael Naimark” is easy to find online so let’s look at stuff.
![Page 25: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/25.jpg)
\
MIT / SF Museum of Modern Art “Displacements” 1980 / 1984
![Page 26: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/26.jpg)
“Displacements” (1980 / 1984 / 2005), CAVS MIT / SFMOMA / Art Center College of Design, Pasadena
\
Art Center College of Design Pasadena “Displacements” 2005
![Page 27: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/27.jpg)
Claire Denamur Toben Seymour (dir)
“Prince Charmant” 2009
![Page 28: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/28.jpg)
![Page 29: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/29.jpg)
![Page 30: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/30.jpg)
![Page 31: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/31.jpg)
Architecture Machine Group MIT “Aspen Moviemap” 1978-80
![Page 32: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/32.jpg)
![Page 33: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/33.jpg)
Exploratorium “Golden Gate Flyover” 1987
![Page 34: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/34.jpg)
![Page 35: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/35.jpg)
![Page 36: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/36.jpg)
ZKM | Centre for Arts and Media “Karlsruhe Moviemap” 1991
![Page 37: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/37.jpg)
ZKM | Centre for Arts and Media “Karlsruhe Moviemap 2009” 2009
![Page 38: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/38.jpg)
![Page 39: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/39.jpg)
Banff Centre for the Arts Interval Research Corporation
“See Banff” kineotscope
1993-94
![Page 40: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/40.jpg)
Banff Centre for the Arts Interval Research Corporation
“See Banff” kineotscope 1993-94
![Page 41: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/41.jpg)
w/ H Baker, J Woodfill, P Debevec, L Villareal Interval Research Corporation
“Dimensionalization Studies”
1994
![Page 42: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/42.jpg)
![Page 43: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/43.jpg)
![Page 44: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/44.jpg)
![Page 45: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/45.jpg)
![Page 46: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/46.jpg)
“Be Now Here,” Michael Naimark, Interval Research and UNESCO, 1995 3D panning motion picture and rotating floor
![Page 47: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/47.jpg)
“Be Now Here Triptych”, Michael Naimark, USC, 2008 3D, motion, sound, but same footage spatially offset
3 screens over 180 degrees
![Page 48: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/48.jpg)
USC Cinema
“Be Now Here Triptych” 2008
![Page 49: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/49.jpg)
USC Cinema
“Be Now Here Triptych” 2008
![Page 50: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/50.jpg)
![Page 52: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/52.jpg)
The Setup
![Page 53: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/53.jpg)
September 2015 “Big Chairs” Park, Google
![Page 54: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/54.jpg)
Jump VR camera Area taped off with 12 “hour” radials in concentric rings
![Page 55: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/55.jpg)
Our intention was to explore how people are represented in VR.
![Page 56: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/56.jpg)
Teaching this class
and (my current projects):
1) Community-based Interactive Hyper-Images
2) VR Virtual Travel “Super StreetView”
3) First-Person VR via a Wearable VR Camera
and maybe reformatting (older work):
“See Banff” and “Be Now Here” for projection VR
3. Who am I?
![Page 57: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/57.jpg)
![Page 58: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/58.jpg)
VR / AR Fundamentals
1. (Funny Question) 2. What are VR / AR fundamentals? 3. Who am I? 4. Who are you? 5. Class structure 6. Assignments & grading 7. Being “positively critical”
Week 1: Introduction
![Page 59: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/59.jpg)
4. Who are you?
Please say a bit about yourself and why you are interested in VR and AR!
![Page 60: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/60.jpg)
![Page 61: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/61.jpg)
VR / AR Fundamentals
1. (Funny Question) 2. What are VR / AR fundamentals? 3. Who am I? 4. Who are you? 5. Class structure 6. Assignments & grading 7. Being “positively critical”
Week 1: Introduction
![Page 62: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/62.jpg)
5. Class Structure
This is a new and experimental class
The first half semester will be learning the basics and seeing what’s out there
The second half semester will be producing short, entertaining, “studies” relevant to VR / AR today
![Page 63: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/63.jpg)
Week 1 - Introduction to VR and AR
Week 2 - FUNDAMENTALS 1: Audiovisual Resolution and Fidelity Fooling a single static eye and single static ear experiencing a framed representation.
Week 3 - FUNDAMENTALS 2: Audiovisual Spatiality and Immersion Fooling two static eyes and ears, then two moving eyes and ears, then removing the frame.
Week 4 - FUNDAMENTALS 3: Other Senses (Haptic, Smell, Taste, Mind) Fooling the other senses.
Week 5 - FUNDAMENTALS 4: Input and Interactivity Using our effectors as inputs and how they shape interactive experiences.
Week 6 - FUNDAMENTALS 5: Social and Liveness Being immersed with other people and live events.
Week 7 - Current Dilemmas This is a lead-in, “pre-production,” to the second half-semester.
First half semester5. Class Structure
![Page 64: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/64.jpg)
First half semester5. Class Structure
The weekly routine will be:
Mondays: Michael’s “fundamentals” presentations (with lots of time for Q & A)
Wednesdays: Students assignments presentations (and posts on IMA Documentation blog)
Mondays and Wednesdays: VR / AR “News of the Week”
![Page 65: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/65.jpg)
Second half semester5. Class Structure
The weekly routine will be conceiving, producing, and documenting short “studies.”
Like the Google Cinematography Studies, they’ll typically be under one minute each.
We should be able to make at least one per week.
We will work as a team.
The goal is to make them public.
![Page 67: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/67.jpg)
Our intention was to explore how people are represented in VR.
![Page 68: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/68.jpg)
The 360 degree “equirectangular” format turns the radial lines into parallel lines. Here’s the active left eye view from a stereo pair.
(Yep, that’s a full 360 degree view of the last slide!)
![Page 69: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/69.jpg)
(1) Close-Up Artifacts
![Page 70: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/70.jpg)
284 x 320
1.0 meters
Todd Zach
Todd Zach
Todd Zach
960 x 320
960 x 320
960 x 320
284 x 320 284 x 320
284 x 320
284 x 320
284 x 320
284 x 320
0.5 meter
1.0 meter
2.0 meters
![Page 71: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/71.jpg)
(2) Recognizability
![Page 72: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/72.jpg)
Zach
1396 x 465413 x 465
Walking backwards from the 1 meter “close up” ring to the 5 meter outer ring and beyond to 10 meters.
Not much recognizability beyond the 5 meter outer ring. (Remember, there is no natural zooming in VR.)
[audio]
![Page 73: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/73.jpg)
(3) Camera Height / Eyeline
![Page 74: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/74.jpg)
mono view Romalyn1110 x 370
329 x 370 370 x 370
mono view Romalyn1110 x 370
329 x 370 370 x 370
Camera height 3 feet, below eyeline of subject
Camera height 5 feet, at eyeline of subject Viewer’s head is level
Viewer’s head tilts up
Privilege is equal
Privileges subject
![Page 75: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/75.jpg)
(4) First Person / Third Person Solo Lip Sync
![Page 76: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/76.jpg)
(hi my name is) mono view
1380 x 460 409 x 460
Romalyn
690 x 388
(my name is)
“Hi. My name is . . .” not looking into camera.
“Hi. My name is . . .” looking into camera.
[audio]
![Page 77: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/77.jpg)
(5) First Person / Third Person Two Shot Lip Sync
![Page 78: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/78.jpg)
(hi my name is) mono view
1380 x 460 409 x 460
Romalyn
690 x 388
(the question game)
Zach on left moves closer to Todd on right.
Both maintain eye contact.
[audio]
![Page 79: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/79.jpg)
1: Zach and Todd are directly opposite the camera.
2, 3, 4: Zach and Todd are offset from the camera.
1
2
3
4
![Page 80: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/80.jpg)
1
2
3
4
![Page 81: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/81.jpg)
(6) Hyper-real Compositing
![Page 82: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/82.jpg)
1816 x 908
(Ring around the Rosie silent palendrome) “Loop back and forth” in Keynote
“Credible” hyper-image composite. Everyone was shot separately. Soft looping for ambient movement.
![Page 83: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/83.jpg)
(Don’t Be Evil.) “Loop” in Keynote
“Incredible” hyper-image composite. [audio]
1816 x 908
![Page 84: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/84.jpg)
(Ring around the Rosie) Jim
Solos minus fall Chorus with fall
freeze (I’ll FTB in Keynote)
Everyone was mic’ed and shot separately. Various spatial audio mixes. [audio]
1816 x 908
![Page 85: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/85.jpg)
![Page 86: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/86.jpg)
VR / AR Fundamentals
1. (Funny Question) 2. What are VR / AR fundamentals? 3. Who am I? 4. Who are you? 5. Class structure 6. Assignments & grading 7. Being “positively critical”
Week 1: Introduction
![Page 87: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/87.jpg)
6. Assignments and Grading
Assignments will mainly be to find and present:
1) relevant VR / AR content for the week’s topic
2) relevant content from other media for this week’s topic
All assignments must be documented on the IMA Documentation blog http://ima.nyu.sh/documentation/
(I will help with pointers and suggestions!)
![Page 88: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/88.jpg)
6. Assignments and Grading
Grading Components
First Half-Semester Finding, presenting, documenting: 60% In-class critical discussion: 30% Readings and video assignments: 10%
Second Half-Semester Production team member: 60% In-class critical discussion: 30% Readings and video assignments: 10%
![Page 89: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/89.jpg)
![Page 90: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/90.jpg)
VR / AR Fundamentals
1. (Funny Question) 2. What are VR / AR fundamentals? 3. Who am I? 4. Who are you? 5. Class structure 6. Assignments & grading 7. Being “positively critical”
Week 1: Introduction
![Page 91: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/91.jpg)
“Throwing the Medicine Ball.”
7. Being “positively critical”
![Page 92: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/92.jpg)
![Page 93: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/93.jpg)
VR / AR Fundamentals
Read:
Concept and Syllabus on http://ima.nyu.sh/vr-ar-fundamentals/ (!!!) Brenda Laurel, “What Is Virtual Reality?” (2016) Alvin Wang Graylin, “16 Lessons for a VR-First Future From ‘Ready Player One’” (2017)
Post and Present:
Of the 16 Lessons, which one you MOST agree with and which one you LEAST agree with. The posts can be very short, like one or two sentences for each.
Week 1: Assignment for Wednesday
![Page 94: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/94.jpg)
![Page 95: VR / AR Fundamentals - Amazon S3s3-ap-southeast-1.amazonaws.com/ima-wp/wp-content/... · VR / AR Fundamentals Michael Naimark Visiting Associate Arts Professor ... “Displacements”](https://reader031.vdocument.in/reader031/viewer/2022011903/5f12bde37339fe1e3f34e9b4/html5/thumbnails/95.jpg)
VR / AR Fundamentals
Read:
Concept and Syllabus on http://ima.nyu.sh/vr-ar-fundamentals/ (!!!) Brenda Laurel, “What Is Virtual Reality?” (2016) Alvin Wang Graylin, “16 Lessons for a VR-First Future From ‘Ready Player One’” (2017)
Post and Present:
Of the 16 Lessons, which one you MOST agree with and which one you LEAST agree with. The posts can be very short, like one or two sentences for each.
Week 1: Assignment for Wednesday