research-article

Sound design: a procedural communication model for VE

Authors:

Diane GromalaAuthors Info & Claims

AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound

Pages 16 - 23

https://doi.org/10.1145/2371456.2371459

Published: 26 September 2012 Publication History

Abstract

In this paper, we address the issue of sound mapping in virtual environments (VEs). Currently, the use of sound in virtual environments is shifting towards adaptive or generative techniques in which sound no longer has a static quality but is dynamic via real-time controls that modify the tonal characteristics over time. We build upon the acoustic communication model posited by Barry Truax by examining two aspects: how sound mediates information and its importance to the listener through cognitive processing. Using this model and investigating the qualitative aspects of soundwalks, soundscape composition, and sound in virtual reality (VR), we present a hybrid model, which addresses the use of procedural sound design techniques to enhance the communicative and pragmatic role of sound in virtual environments. The end result produces a sonic environment that heightens the listeners' experience and cognitively engages them to sounds within a specific time and space.

References

[1]

Truax, B., 2000 2^nd Ed. Acoustic Communication. Westport, CT. Ablex Publishing.

[2]

Blesser, B. and Salter, L. 2007. Spaces speak, are you listening?. Cambridge, MA. MIT Press.

[3]

Schafer, R. M., 1978a. The Vancouver Soundscape. ARC Publications.

[4]

Smith, C., J. 1993. The Acoustic Experience of Place. The Tuning of the World Conference. Simon Fraser University.

[5]

Southworth, M. 1969. The Sonic Environment of Cities. Environment and Behaviour. 1:1, 49--70.

[6]

Grimshaw, M., Lindley, C. A., & Nacke, L. (2008). Sound and Immersion in the First-Person Shooter: Mixed Measurement of the Player's Sonic Experience. Audio Mostly Conference 2008, Piteå, Sweden.

[7]

Paine, F. (1985). Sound Mixing and Apocalypse Now: An Interview with Walter Murch. In Weis, E and Belton J. (Eds.), Film Sound: theory and practice (pp. 356--360). New York: Columbia University Press.

[8]

Schafer, R. M. 1977. The Soundscapes. Rochester, Vermont. Destiny Books.

[9]

Truax, B. 2012. From Soundscape Documentation to Soundscape Composition. Acoustics 2012. Nantes, France

[10]

Westerkamp, H., Soundwalking as Ecological Practice. Vancouver New Music. 2008. Reprinted from The West Meets the East in Acoustic Ecology. International Conference on Acoustic Ecology. 2006. Japan

[11]

Truax, B., 1996--2012. Soundscape Composition. http://www.sfu.ca/~truax/scomp.html. Accessed March 15th, 2012.

[12]

Truax, B., 2002. Genres and Techniques of Soundscape Composition as Developed at Simon Fraser University. Organised Sound. 7:1, 5--14.

Digital Library

[13]

Kubisch, C., 1970-2003. Works with Electromagnetic Induction. http://www.christinakubisch.de/english/klangundlicht_frs.htm. Accessed March 10th, 2012.

[14]

Schaub, M., 2005. The Walk Book: Janet Cardiff. Vienna & New York: Thyssen-Bornemisza Art Contemporary and the Public Art Fund.

[15]

Gagnon, M., 2007. Janet Cardiff. Senses & Society. 2:2, 259--264.

[16]

Nedelkopoulou, E., 2011. Walking Out on Our Bodies Participation as Ecstasis in Janet Cardiff's Walks. Performance Research: A Journal of the Performing Arts. 16:4, 117--123.

[17]

Begault, D., 2000. Sound for Virtual Reality and Multimedia. NASA Center for AeroSpace Information. Hanover, MD: NASA Center for AeroSpace Information.

[18]

Brandon, A. (2005). Audio for Games, Planning, Process and Production. Berkeley, CA: New riders.

Digital Library

[19]

Shilling, R., Shinn-Cunningham, B., 2000. Virtual Auditory Displays. Handbook of Virtual Environment Technology. Stanney, K., Lawrence Erlbaum, Associates, Inc., in press.

[20]

Slater, M., & Wilbur, S. 1995. Through the looking glass world of presence: A framework for immersive virtual environments. In: Slater, M., (ed.) Proceedings of FIVE'95 Framework for Immersive Virtual Environments. QMW University of London. MISSING PAGE #

[21]

Sheriden, T. B., 1996. Further Musings on the Pschophysics of Presence. Presence. 5:2, 241--246.

Digital Library

[22]

Augoyard, Jean-Francois., Torgue, Henry., 2005. Sonic Experience. Montreal. McGill-Queen's University Press.

[23]

Singer, M. J., & Witmer, B. G. 1999. On selecting the right yardstick. Presence 8:5. MIT Press.

Digital Library

[24]

Jerome CJ, Witmer B., 2002. Immersive tendency, feeling of presence, and simulator sickness: formulation of a causal model. Human Factors and Ergonomics Society Annual Meeting Proceedings: Virtual Environments, pp. 2197--2201.

[25]

Scheume MJ, Van der Straaten P., Krijin M et al. 2001. Research on presence in virtual reality: a survey. Cyberpsychological Behaviour; 4(2): 183--201.

[26]

Witmer, BJ., Singer, MJ., 1998. Measuring presence in virtual environments: a presence questionnaire. Presence; 7:3, 225--240.

Digital Library

[27]

Fencott, C. (1999). Presence and the content of virtual environments. Retrieved July 16, 2012, from http://web.onyxnet.co.uk/Fencott-onyxnet.co.uk/pres99/pres99.htm. Fernández-Vara, C., Zagal, J. P., & Mateas, M. (2005, June 16--20). Evolution of spatial configurations in videogames. Paper presented at Changing Views -- Worlds in Play, Toronto.

[28]

Grimshaw, M. (2008). The Acoustic Ecology of the First-Person Shooter: The Player, Sound and Immersion in the First-Person Shooter Computer Game. Saarbrücken: VDM Verlag.

Digital Library

[29]

Hendrix, C., Barfield, W., 1996. The sense of presence in auditory virtual environments. Presence. 5:3, 290--301.

Digital Library

[30]

Harrison, J., Wilson, S., 2010. Editorial. Organised Sound. 15:3, 183--184. Cambridge University Press.

Digital Library

[31]

Yost, W. A. 1994. Fundamentals of Hearing: An Introduction (3ed.). San Diego, CA: Academic Press.

[32]

Shinn-Cunningham, B. G. 2000a. Adapting to remapped auditory localization cues: A decision-theory model. Perception and Psychophysics. 62:1, 33--47.

[33]

Shinn-Cunningham, B. G. 2000b. Learning reverberation: Implications for spatial auditory displays. International Conference on Auditory Displays. Atlanta, GA.

[34]

Malham, D. G., 1998. Approaches to Spatialisation. Organised Sound; 3:2, 167--77. Cambridge University Press.

Digital Library

[35]

AudioGaming, 2012. http://www.audiogaming.net/audio-middleware. Accessed March 2th, 2012.

Cited By

Zhou SGromala DWang L(2023)Ethical Challenges of Virtual Reality Technology Interventions for the Vulnerabilities of Patients With Chronic Pain: Exploration of Technician ResponsibilityJournal of Medical Internet Research10.2196/4923725(e49237)Online publication date: 4-Dec-2023
https://doi.org/10.2196/49237
Triantafyllou DAntoniou ALepouras G(2016)Sound and kinesthesis in virtual environmentsProceedings of the 20th Pan-Hellenic Conference on Informatics10.1145/3003733.3003737(1-4)Online publication date: 10-Nov-2016
https://dl.acm.org/doi/10.1145/3003733.3003737
Yusoff NSalim S(2014)Social-based versus shared situation awareness-based approaches to the understanding of team cognitive research in HCI2014 3rd International Conference on User Science and Engineering (i-USEr)10.1109/IUSER.2014.7002717(281-286)Online publication date: Sep-2014
https://doi.org/10.1109/IUSER.2014.7002717
Show More Cited By

Index Terms

Sound design: a procedural communication model for VE

Recommendations

Soundscape, sonification, and sound activism

In this article, the author will argue that the act of listening through public soundwalks and other formal and informal exercises builds environmental and social awareness and promotes changes in social and cultural practices. By examining the act of ...
Noise-cancelling, steps and soundscapes: the effect of auditory stimulation on presence in virtual realities while walking
VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

This study investigates the influence of different auditory stimuli on perceived presence, the feeling of "being there", on a walk through a park-like virtual environment. A single-factorial design with five levels varying the surrounding sound ...
Dynamic enhancement of videogame soundscapes
AM '13: Proceedings of the 8th Audio Mostly Conference

A game soundscape often includes sounds that are triggered by the game logic according to the player's actions and to other real time occurrences. The dynamic nature of such triggering events leads to a composition that is not necessarily interesting, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AM '12: Proceedings of the 7th Audio Mostly Conference: A Conference on Interaction with Sound

September 2012

174 pages

ISBN:9781450315692

DOI:10.1145/2371456

Conference Chairs:
Andreas Floros
Ionian University, Greece
,
Andreas Mniestris
Ionian University, Greece
,
Program Chairs:
Iani Zannos
Ionian University, Greece
,
Theodoros Lotis
Ionian University, Greece

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 September 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AM '12

AM '12: A conference on interaction with sound

September 26 - 28, 2012

Corfu, Greece

Acceptance Rates

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
381
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou SGromala DWang L(2023)Ethical Challenges of Virtual Reality Technology Interventions for the Vulnerabilities of Patients With Chronic Pain: Exploration of Technician ResponsibilityJournal of Medical Internet Research10.2196/4923725(e49237)Online publication date: 4-Dec-2023
https://doi.org/10.2196/49237
Triantafyllou DAntoniou ALepouras G(2016)Sound and kinesthesis in virtual environmentsProceedings of the 20th Pan-Hellenic Conference on Informatics10.1145/3003733.3003737(1-4)Online publication date: 10-Nov-2016
https://dl.acm.org/doi/10.1145/3003733.3003737
Yusoff NSalim S(2014)Social-based versus shared situation awareness-based approaches to the understanding of team cognitive research in HCI2014 3rd International Conference on User Science and Engineering (i-USEr)10.1109/IUSER.2014.7002717(281-286)Online publication date: Sep-2014
https://doi.org/10.1109/IUSER.2014.7002717
Ramalho JChambel TChambel TBove VStrover SViana PThomas G(2013)Immersive 360° mobile video with an emotional perspectiveProceedings of the 2013 ACM international workshop on Immersive media experiences10.1145/2512142.2512144(35-40)Online publication date: 22-Oct-2013
https://dl.acm.org/doi/10.1145/2512142.2512144

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents