![Page 1: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/1.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Sonic Browsing: An Auditory Tool For Multimedia Asset Management
Mikael Fernström & Eoin Brazil
Interaction Design Centre
University of Limerick, IRELAND
www.idc.ul.ie
![Page 2: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/2.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Outline
• Introduction, Multimedia Asset Management
• Applications
• Sonic Browser
• Study results
• Conclusion
![Page 3: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/3.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Introduction
• how sound can be used to assist users working
with complex data sets.
• Searching and Browsing datasets of everyday sounds
• Visual & Aural representation
• Direct Sonification
![Page 4: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/4.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Intro: Multimedia Asset Management
• Multimedia Designers
• Large sets of everyday sounds used as datasets
• Idea -> use “cocktail party effect” to exploit ability to switch between sounds in auditory scene
![Page 5: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/5.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Applications
• Applications
• Collection of everyday sounds, multimedia authoring
• Copyright Issues
• Use by Multimedia Designers
• ...
![Page 6: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/6.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Sonic Browser - Concepts
• Screenscape and Soundscape• Visual, star-field type display
– shape, colour, size, and location
• Audio, direct music representation– drivers that support multiple stream audio
• Tight Coupling– Objects under the Aura are high-lighted and
played simultaneously
![Page 7: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/7.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Sonic Browser - Visual
Visual Representation:
• Star-field representation of auditory objects
• Arbitrary mapping, controlled by the user– shape, colour, size, horizontal and vertical
location
• Tunes playing are high-lighted.
![Page 8: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/8.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Sonic Browser - Audio
Audio: Direct representation of tunes (exploting the cocktailparty effect)
• Sounds are panned out in a stereo field controlled by the visual location of the tunes nearest to the cursor.
• The volume of the tunes playing concurrently is proportional to the visual distance between the objects and the cursor
![Page 9: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/9.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Sonic Browser – Screenshot
![Page 10: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/10.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Sonic Browser – Usage
• Cursor on object - the object plays, max volume, centered.
• Click - show dialogue box with details of the properties of the objects
• Double-click - access the object, e.g. show the details in the database, edit, etc.
• Single-click & Drag – move the object in display
![Page 11: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/11.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Study - Overview
• Design of interface elements and components of an interface when working with sound resources
• Examined differences in– Microsoft Windows™ Explorer– Sonic Browser
![Page 12: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/12.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Windows Explorer – Screenshot
![Page 13: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/13.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 20018
Users and Data set
• Postgraduates in the CSIS at UL
• Two commerical datasets– first set contained 54 sounds, used for
familiarisation. – second set contained 244 sounds, used in the
test phase
![Page 14: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/14.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Tasks
• Familiarisation – practice tasks
• Testing– similar way with a different sound data set and
tasks
• Post testing debrief & questionnaire
![Page 15: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/15.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Overview of Sound Areas
• The various categories of sound are shown below
![Page 16: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/16.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Sound Datasets
• Everyday Sound
• Musical Sound
Area of Interest
Start of Song
![Page 17: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/17.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Study Findings
• Hierarchical Layout helped navigation
• Long file names for files versus using cryptic short file names were more useful
• Aura allowed panning across files quickly
• Windows Explorer only has the ability to play one sound at a time
• Categorization differs between users
![Page 18: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/18.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Conclusion
• Straight hierarchy view does improve performance but can lead to confusion
• Use long descriptive file names
• Categorization problems can be avoid by use of an aura
• Areas / Regions of interest may not always be at the start of a sound, use of Cue points
![Page 19: ICAD-01, Espoo, Finland, July 29 - August 1, 2001 Sonic Browsing: An Auditory Tool For Multimedia Asset Management Mikael Fernström & Eoin Brazil Interaction](https://reader036.vdocument.in/reader036/viewer/2022081811/56649e9e5503460f94ba08af/html5/thumbnails/19.jpg)
ICAD-01, Espoo, Finland, July 29 - August 1, 2001
Future Work & Reference
• Development of a zoom facility• Addition of display by category• Inclusion of “tagging” or “shading” for files
of interest • Use of cue points to play sound
areas/regions of interest• Use of three property sliders for filtering• Website: http://www.idc.ul.ie