hearing in numbers: virtual sound as next nature
TRANSCRIPT
![Page 1: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/1.jpg)
1
Balance Unbalance 2015
Water, Climate & Place [Reimagining Environments]
![Page 2: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/2.jpg)
2
Hearing in Numbers Virtual Sound as Next Nature
Phylis Johnson, PhDSouthern Illinois University, Carbondale, IL USA
Jay Jay Jegathesan, PhD CandidateUniversity of Western Australia, Australia, Perth
![Page 3: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/3.jpg)
3
Sonification: Art & Science
Barass & Vickers (2011) point toward an open-ended process that includes perceptual & ethnographical data, and perhaps speculative theatrical representation of ecological sound and abstract data, and most relevant to virtual world designs those that incorporate first person avatar immersion as exhibited in computer games and platforms.
![Page 4: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/4.jpg)
4
Figure 2. The architecture of our real-time interactive system follows the sensing/processing/response paradigm. (LeGroux et al. 2007)
![Page 5: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/5.jpg)
5
Figure 9. This diagram shows the different type ofdata we are dealing with during the sonification process. (LeGroux et al. 2007)
![Page 6: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/6.jpg)
6
The Virtual Theater
Cinema of the FutureMorton Heilig, 1955
![Page 7: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/7.jpg)
7
![Page 8: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/8.jpg)
8
![Page 9: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/9.jpg)
9
![Page 10: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/10.jpg)
10
Sound Design in Second Life
![Page 11: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/11.jpg)
11
Prim – Unit of Measurement
![Page 12: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/12.jpg)
12
Scripting the Prim
![Page 13: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/13.jpg)
13
Welcome to Virlantis
![Page 14: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/14.jpg)
14
Virlantis
![Page 15: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/15.jpg)
15
Virlantis
![Page 16: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/16.jpg)
16
Perceptual Placement
![Page 17: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/17.jpg)
17
![Page 18: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/18.jpg)
18
![Page 19: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/19.jpg)
19
Positioning Sound
![Page 20: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/20.jpg)
20
![Page 21: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/21.jpg)
21
![Page 22: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/22.jpg)
22
![Page 23: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/23.jpg)
23
VIRTUAL WORLD SOUND DESIGNSound Prim Measurement
Sound Time Ambient LoopObject Unit
![Page 24: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/24.jpg)
24
![Page 25: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/25.jpg)
25
Koert van Mensvoort
![Page 26: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/26.jpg)
26
![Page 27: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/27.jpg)
27
![Page 28: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/28.jpg)
28
Shopping for Virtual Sound
Acoustic Alchemy in Second life
![Page 29: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/29.jpg)
29
![Page 30: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/30.jpg)
30
Sound Objects
![Page 31: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/31.jpg)
31
![Page 32: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/32.jpg)
32
SL Sound Barriers
10 second limitations per clip
Every avatar hears sound differently
Client Settings – System & Client
ISP performanceLagLimited Playback options
![Page 33: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/33.jpg)
33
Break Sound Barriers
Hear sounds all aroundNo Time Limit on clipsRandomize volume - 11 PresetsPlayback flexibility (day, night options)
3D placement flexibility -variable borders without subdividing land into parcels (N, S, E, W, up, down)
![Page 34: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/34.jpg)
34
![Page 35: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/35.jpg)
35
![Page 36: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/36.jpg)
36
![Page 37: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/37.jpg)
37
![Page 38: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/38.jpg)
38
Virtu
al Soun
d Archi
ve
![Page 39: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/39.jpg)
39
Sonic Continuum (Toward Invisibility)
World Virtual Reality POV Avatar Human Placement Data Perceptual Locative Studio Field Purpose Archive Action Source Non-Present Present Dimensional Linear Layered Emotive Non-Referential Referential Memory Fragmented Immersive Medium Headphone Ear Sound Paths Waves Nature Visible Invisible
![Page 40: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/40.jpg)
40
![Page 41: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/41.jpg)
41
Schaeffer to Schafer
![Page 42: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/42.jpg)
42
Reich, Cage, & Cardiff
![Page 43: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/43.jpg)
43
The Cage Museum
![Page 44: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/44.jpg)
44
Imaginary Soundscape
![Page 45: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/45.jpg)
45
Sonic Luggage
![Page 46: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/46.jpg)
46
Across Time & Soundscapes
![Page 47: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/47.jpg)
47
![Page 48: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/48.jpg)
48
The Art of Noise
![Page 49: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/49.jpg)
49
Sonic Role Play
Why should we care?How will it help, hinder?Revisit, Reimagine, and
Speculate on What’s Next for Sound?
![Page 50: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/50.jpg)
50
Virtual Reality
Other Virtual Worlds and
Environments
Audio Avatars
![Page 51: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/51.jpg)
51
Virtual Dublin
![Page 52: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/52.jpg)
52
Discover Ireland
![Page 53: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/53.jpg)
53
John Cage
![Page 54: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/54.jpg)
54
Sources (cited in presentation)
Barrass, S., & Vickers, P. (2011). Sonification Design and Aesthetics. Sonification Handbook (pp. 145-171). Johnson, P. ( 2011), A Second Life for Sound: Crossing Sonic Paths in Virtual Worlds. Soundscape, 11 (1), 52-56. Kramer, G., Walker, B., Bonebright, T., Cook, P., Flowers, J. H., Miner, N. and John
Neuhoff, N. (1999). Sonification Report: Status of the Field and Research Agenda. Technical report, ICAD/NSF. McLuhan, M. (2005). Visual and Acoustic Space. In Christopher Cox & Daniel Warner (eds)., Audio Culture.
Readings in Modern Music, New York: Continuum, 67-72. Ong, W. J. (2012). Orality and Literacy: 30th Anniversary Edition. New York, NY: Routledge. Ribeiro, F., Florencio, D., Chou, P., and Zhang, Z. (2012). Auditory Augument Reality: Object Sonification for the
Visually Impaired. MMSP Proceedings: IEEE, September. Sample, Ian. (2015). 'Noise pollution makes us oblivious to nature.' The Guardian Weekly, February 27. Schafer, R. M (2004). The Music of the Environment. In Christopher Cox & Daniel Warner (eds.), Audio Culture.
Readings in Modern Music, New York: Continuum, 29-39 Schafer, R. Murray (1992). Music, Non-Music and the Soundscape. In John Paynter et al. (eds)., Companion to Contemporary
Musical Thought, London: Routledge, 34–45. The Interactive Sonification Workshop (ISON), 2013. van Mensvoort, Koert. (2012). Next Nature. Barcelona, Spain: Actar.
Additional references available upon request.
![Page 55: HEARING IN NUMBERS: VIRTUAL SOUND AS NEXT NATURE](https://reader038.vdocument.in/reader038/viewer/2022103019/55c80506bb61ebf76f8b45a7/html5/thumbnails/55.jpg)
55