amd augmented reality and virtual reality · 2019-10-11 · amd augmented reality and virtual...

17
AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek

Upload: others

Post on 21-Jun-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek

Page 2: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

2 | AMD VR STRATEGY |

Introducing

Page 3: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

3 | AMD VR STRATEGY |

The Progression of REAL-TIME Visual Experiences is Just Starting

Basic 2D

Rendering

Physically

Based

Rendering

Basic 3D

Rendering

Immersive

2D Displays

Shaders VR

Pursuit of

Presence

Page 4: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

4 | AMD VR STRATEGY |

Photorealism

in VR

Full Presence

The Next 30 Years will Progress on an Exponential Curve

Basic 2D

Rendering

Physically

Based

Rendering

Basic 3D

Rendering

Immersive

2D Displays

Shaders AR/VR

Level of

Presence

Page 5: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

5 | AMD VR STRATEGY |

A Few Interesting/Unique Hardware Advances Needed for VR

To achieve the vision

of full presence you

need:

Scalable CPUs,

GPUs

And

Accelerators

The following must improve, or users have a

terrible experience:

1. We need radical new levels of performance

2. Low latency drives new architectural features

3. Quality and consistency are not optional

4. New system-level challenges emerge

Page 6: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

6 | AMD VR STRATEGY |

Step up the

performance VR Challenge #1

A ton of

computation needs

to complete in very

short intervals of

time from motion

to photons

Page 7: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

7 | AMD VR STRATEGY |

35 years of Visual Computing Acceleration, Good, But Not VR Yet

Year: 2015

Transistor Count: >6B

Operations/Sec: >6T

Year: 1979

Transistor Count: 13K

Operations/Sec: 1M

Page 8: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

8 | AMD VR STRATEGY |

Where Performance Needs to be for Immersive VR

Pixels 8 Million

Polygons 4 Million

Rendering Time 10 milliseconds

Pixels 1Million

Polygons 4 Million

250 GFLOP CPU Rendering

Time 144 minutes

Million X speedup required from where we are today

100 Million X speedup in performance/Watt

Page 9: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

9 | AMD VR STRATEGY |

Ensure Very

Low Latency

Response

VR Challenge #2

The human eye

and brain does not

respond well unless

there is <10ms

movement to

photons

Page 10: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

10 | AMD VR STRATEGY |

“Time Warping” to align current available image to

current spatial location

10-15ms render, 8-12ms display

10ms = 100 frames/second today

Goal is 1ms = 1000 frames/second tomorrow

Latency Innovation

Reducing Latency from Movement to Photons is Critical

Page 11: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

11 | AMD VR STRATEGY |

Must have

High-Quality

Consistency

of Media

VR Challenge #3

Even with low

latency,

inconsistent/poor

quality destroys the

experience

Page 12: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

12 | AMD VR STRATEGY |

Content creation

Content creation is also a big challenge – designing convincing virtual worlds can be prohibitively expensive

We’re working with leading providers of graphics middleware to make this process more manageable

Reduce Blur – Shutter the Pixels

Audio/Video Needs to Sync Well

Fast Paths for Most Recent Data Latch

Depth of Focus can be Problematic

Priority Queues and Asynchronous Operation Needed

Image Quality

DIRECT-TO-DISPLAY

Monitor

2D

Operating System

VR Application

GPU

Data and Image Quality Cannot be Compromised

Page 13: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

13 | AMD VR STRATEGY |

The System

Architecture

Needs to

Evolve

VR Challenge #4

Heat, bandwidth,

error rates, faster

interfaces, form

factors, and more

must be addressed

Page 14: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

14 | AMD VR STRATEGY |

System Advances Display Thermals, Power, and Heat are a Problem

Wireless has to Improve in Bandwidth and Power

New GPU Parallel Processing and Scaling is Coming

Compression needs to improve beyond H.265

Form Factors Need to be Reduced

New System Advances are Needed to Improve the Experience

Page 15: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

15 | AMD VR STRATEGY |

Yet, the market for VR to drive GPU sales already exists… VR still hasn’t reached the quality of the first iPod yet...

Oculus CV1, HTC Vive, and Sony Morpheus are ‘VR v1.0’

The ecosystem is assembling itself at an exponential pace

THE START OF THE

ROAD…

Page 16: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

16 | AMD VR STRATEGY |

Fully connected at low latency, for all senses…

THE END OF THE

ROAD

Fully immersive virtual and augmented reality

Holographic displays, bio interfaces, and the “Holodeck”

Timeline: 30 years – circa 2045…

Page 17: AMD Augmented Reality and Virtual Reality · 2019-10-11 · AMD Augmented Reality and Virtual Reality Handling Some Unique Problems in Hardware Keith Witek . 2 ... 8-12ms display

17 | AMD VR STRATEGY |

THANK YOU

LiquidVR 1.0 Alpha SDK available now