environmental audio and processing for vrtwvideo01.ubm-us.net/o1/vault/gdc2015/... · environmental...
TRANSCRIPT
Environmental Audio and Processing for VR Nicholas Ward-Foxton
Senior Audio Programmer, Sony Computer
Entertainment
Sound Localisation
d1
d2
Interaural Time Delay
Sound Localization – ILD Interaural Level Difference
Sound Localization – Pinna Pinnae Filtering
Combines to form HRTF x(t)
hL(t)
hR(t)
XR(t) XL(t)
Head Related Transfer Function
Cone of Confusion Cone of Confusion
Head tracking = WIN! Head Tracking
Localization – Going Further
Indirect Audio
The Initial Time Delay Gap Time
Lou
dn
ess
So what have we built?
● Obstruction system
● Dynamic reverberation system
Obstruction Model
● Ray-casts form cone
● Results are integrated
● LPF before HRTF system
● Transmission values are used
Video
Reverb System
Dynamic Reverb – First Reflections
● Ray-casting
● Image source method (6)
● Absorption
● Variable delay line taking into account
source distance
● Also HRTF processed
● Parametrically driven
● Renders to quad output
● Can use portals
Dynamic Reverb – Tail
Reverb Send Curve
Send Curve
Video
Sound Localization - Falloff Direct Sound Falloff
Proximity Proximity
Mic Input
Video
Multi Channel Ambience
Object Based Mixing – DSP?! Mixing
Diegetic and Non Diegetic Audio
Voice Over
Music
Music
Summary
● HRTF + Morpheus audio system
● Obstruction + Occlusion System
● Mic Input
● Other VR audio Tips
● Audio for VR is exciting
Questions? [email protected]