research-article

The Sound of the Smell of my Shoes

Authors:

Mads Walther-HansenAuthors Info & Claims

AM '15: Proceedings of the Audio Mostly 2015 on Interaction With Sound

Article No.: 18, Pages 1 - 8

https://doi.org/10.1145/2814895.2814900

Published: 07 October 2015 Publication History

Abstract

Given the sensory poverty of virtual environments, such as those found in computer games that rely, in the main, solely on audio-visual interfaces, how best do we attain the experience of presence in those environments when presence requires the construction of a coherent (in the sense of realism) place in which to be and in which to act? The paper explores this question through an investigation of the senses of hearing and smell and suggests the possibility of introducing the experience of odours into such environments through the use of sound.

References

[1]

Ara, K. et al. 2006. Foot odor due to microbial metabolism and its control. Canadian Journal of Microbiology 52(4), 357--364.

[2]

Başdoğan, Ç. and Loftin, R. B. 2009. Multimodal display systems: Haptic, olfactory, gustatory, and vestibular. In The PSI Handbook of Virtual Environments for Training and Education: VE Components and Training Technologies Vol. 2, Nicholson, D., Schmorrow, D. and Cohn, J. (eds.). Westport, CONN: Praeger Security International, 116--134.

[3]

Belkin, K., Martin, R., Kamp, S. E., and Gilbert, A. N. 1997. Auditory pitch as perceptual analogue to odor quality. American Psychological Society 8(4), 340--342.

[4]

Boevé, J. and Giot, R. 2014. Volatiles that sound bad: Sonification of defensive chemical signals from insects against insects. The 20th International Conference on Auditory Display, New York, June 22-25.

[5]

Bregman, A. S. 1990. Auditory Scene Analysis: The Perceptual Organization of Sound. Cambridge and Massachusetts: MIT Press.

[6]

Bronner, K., Frieler, K., Bruhn, H., Hirt, R., and Piper, D. 2012. What is the sound of citrus: Research on the correspondences between the perception of sound and flavour. In Proceedings of the ICMPC, 42--48.

[7]

Brown, E. and Cairns, P. 2004. A grounded investigation of game immersion. Paper presented at Human Factors in Computing Systems, Vienna, April 24-29.

Digital Library

[8]

Butera, M. 2011. Sound for thought: Listening as metabolism. SoundEffects 1(1).

[9]

Cacciari, C. 2008. Crossing the senses in metaphorical language. In The Cambridge Handbook of Metaphor and Thought, Gibbs, W. R. (ed.). Cambridge and New York: Cambridge University Press, 425--444.

[10]

Calkin, R. R. and Jellinek, J. S. 1994. Perfumery: Practice and Principles. Jon Wiley and Sons.

[11]

Calleja, G. 2014. Immersion in virtual worlds. In The Oxford Handbook of Virtuality, M. Grimshaw (ed.). New York: Oxford University Press, 222--236.

[12]

Castro, J. B. and Seeley, W. P. 2014. Olfaction, valuation and action: Reorienting perception. Frontiers in Psychology 5, 299.

[13]

Chalmers, A. G., Howard, D., and Moir, C. 2009. Real virtuality: A step change from virtual reality. In SCCG '09: Proceedings of the 25th Spring Conference on Computer Graphics, 9--16. New York: ACM Press.

Digital Library

[14]

Chalmers, A. 2014. Level of realism: Feel, smell, and taste in virtual environments. In The Oxford Handbook of Virtuality, M. Grimshaw (ed.). New York: Oxford University Press, 222--614.

[15]

Chion, M. 1994. Audio-vision: Sound on screen. C. Gorbman (trans.). New York: Columbia University Press.

[16]

Clarke, A. 1997. Being There: Putting Brain, Body, and World Together Again. New York: Oxford University Press.

Digital Library

[17]

Collins, K. 2008. Game Sound: An Introduction to the History, Theory, and Practice of Video Game Music and Sound Design. Cambridge, Massachusetts: MIT Press.

[18]

Collins, K. 2013. Playing with Sound. Cambridge, Massachusetts: MIT Press.

[19]

DiFranco, D. E., Beauregard, G. K., and Srinivasan, M. A. 1997. The effect of auditory cues on the haptic perception of stiffness in virtual environments. Proceedings of the ASME. Dynamic Systems and Control Division, DSC 61, 17--22.

[20]

Freud, S. 1962. Three Essays on the Theory of Sexuality, James Strachey (trans.). New York: Basic Books.

[21]

Glass, S. T., Lingg, E., and Heuberger. E. 2014. Do ambient urban odors evoke basic emotions? Frontiers in Psychology 5, 340.

[22]

Grimshaw, M. (ed.). 2011. Game Sound Technology and Player Interaction: Concepts and Developments. Hershey (PA): IGI.

[23]

Grimshaw, M. 2012. Sound and player immersion in digital games. In The Oxford Handbook of Sound Studies, T. Pinch and K. Bijsterveld (eds.). New York: Oxford University Press, 347--366.

[24]

Grimshaw, M. and Garner, T. 2014. Imagining sound. Proceedings of the 9th Audio Mostly Conference. New York: ACM Press.

Digital Library

[25]

Grimshaw, M. and Garner, T. 2015. Sonic Virtuality: Sound as Emergent Perception. New York: Oxford University Press.

[26]

Grimshaw, M., Lindley, C. A., and Nacke, L. 2008. Sound and immersion in the first-person shooter: Mixed measurement of the player's sonic experience. Paper presented at Audio Mostly 2008, Piteå, Sweden, October 22-23.

[27]

von Hornbostel, E. 1938. The unity of the senses. In A Source Book of Gestalt Psychology, Koffka, E. and Vinton, W. (trans.), Ellis. W. D. (ed.). New York: Harcourt-Brace, 210--216.

[28]

Howes, D. 2002. Nose-wise: Olfactory metaphors in mind. In Olfaction, Taste and Cognition, Rouby, C., Schaal, B., Gervais, R., and Holley, A. (eds.). Cambridge and New York: Cambridge University Press, 67--81.

[29]

Hudson, R. and Distel, H. 2002. The individuality of odor perception. In Olfaction, Taste and Cognition, Rouby, C., Schaal, B., Gervais, R., and Holley, A. (eds.). Cambridge and New York: Cambridge University Press, 408--420.

[30]

IJsselsteijn, W. A., Freeman, J., and De Ridder, H. 2001. Presence: Where are we? Cyberpsychology & Behavior 4(2), 179--182.

[31]

Jajeja, H. 2008. Scientific basis behind traditional practice of application of "shoe-smell" in controlling epileptic seizures in the eastern countries. Clinical Neurology and Neurosurgey 110, 535--538.

[32]

Jennett, C., Cox, A. L., Cairns, P., Dhopare, S., Epps, A., Tijs, T., and Walton, A. 2008. Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies 66, 641--661.

Digital Library

[33]

Johnson, M. 1987. The Body in the Mind: The Bodily Basis of Meaning, Imagination, and Reason. Chicago London: The University of Chicago Press.

[34]

Knöferle, K. and Spence, C. 2012. Crossmodal correspondences between sounds and tastes. Psychonomic Bulletin & Review. October 6.

[35]

Köster, E. P., Møller, P., and Mojet, J. 2014. A "misfit" theory of spontaneous conscious odor perception (MITSCOP): Reflections on the role and function of odor memory in everyday life. Frontiers in Psychology 5(64).

[36]

Lakoff, G. 1987. Women, Fire and Dangerous Things: What Categories Reveal about the Mind. Chicago and London: The University of Chicago Press.

[37]

Melzack, R. and Wall, P. D. 1996. The Challenge of Pain. London: Penguin Books.

[38]

Moore, A. 2013. The spectacular anus of Joseph Pujol: Recovering the Pétomane's unique historic context. French Cultural Studies 24(1), 27--43.

[39]

Piesse, G. 1857. The Art of Perfumery and Methods of Obtaining the Odors of Plants. Philadelphia: Lindsay and Blakiston.

[40]

Riddoch, M. 2012. On the non-cochlearity of the sounds themselves. Paper presented at The International Computer Music Conference. September 9-14.

[41]

Roberts, E. 2000. Pity the Damned. Queensland, Australia: Life Today.

[42]

Simner, J., Cuskley, C., and Kirby, S. 2010. What sound does that taste? Cross-modal mapping across gustation and audtion. Perception 39(4), 553--569.

[43]

Slater, M. 2003. A note on presence terminology. Presence Connect 3(3).

[44]

Smeller.net. 2015. Available at: http://smeller.net. {Accessed June 7, 2015}.

[45]

Toffolo, M. B. J., Smeets, M. A. M., and van den Hout, M. A. 2012. Proust revisited. Odours as triggers of aversive memories. Cognition and Emotion 26(1), 83--92.

[46]

Verhulst, N. O. et al. 2011. Composition of human skin microbiota affects attractiveness to malaria mosquitoes. PLoS One 6(12).

[47]

Wesson, D. W. and Wilson, D. A. 2010. Smelling sounds: Olfactory--auditory sensory convergence in the olfactory tubercle. The Journal of Neuroscience 30(8), 3013--3021.

[48]

Williams, J. M. 1976. Synaesthetic adjectives: A possible law of semantic change. Language 32(2), 461--478.

[49]

Zatorre, R. J. 2007. There's more to auditory cortex than meets the ear. Hearing Research 229, 24--30.

[50]

Zbikowski, L. M. 2002. Conceptualizing Music: Cognitive Structure, Theory, and Analysis. New York: Oxford University Press.

[51]

Zimmer, U., Koschutnig, K., Ebner, F., and Ischebeck, A. 2014. Successful contextual integration of loose mental associations as evidenced by emotional conflict-processing. PlosOne 9(3), e91470.

Cited By

Grimshaw-Aagaard MWalther-Hansen M(2024)Less-is-more: auditory strategies for reduced realityPersonal and Ubiquitous Computing10.1007/s00779-024-01808-628:5(713-725)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1007/s00779-024-01808-6
Walther-Hansen M(2020)Making Sense of Recordings10.1093/oso/9780197533901.001.0001Online publication date: 22-Oct-2020
https://doi.org/10.1093/oso/9780197533901.001.0001
Brianza GTajadura-Jiménez AMaggioni EPittera DBianchi-Berthouze NObrist M(2019)As Light as Your Scent: Effects of Smell and Sound on Body Image PerceptionHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29390-1_10(179-202)Online publication date: 23-Aug-2019
https://doi.org/10.1007/978-3-030-29390-1_10
Show More Cited By

Index Terms

The Sound of the Smell of my Shoes
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Auditory feedback

Recommendations

The Sound of the Smell (and taste) of my Shoes too: Mapping the Senses using Emotion as a Medium
AM '16: Proceedings of the Audio Mostly 2016

This work discusses basic human senses: sight; sound; touch; taste; and smell; and the way in which it may be possible to compensate for lack of one, or more, of these by explicitly representing stimuli using the remaining senses. There may be many ...
Low frequency eardrum directionality in the barn owl induced by sound transmission through the interaural canal

The middle ears of birds are typically connected by interaural cavities that form a cranial canal. Eardrums coupled in this manner may function as pressure difference receivers rather than pressure receivers. Hereby, the eardrum vibrations become ...
An investigation into the modelling of virtual objects with sound vibration properties

In order to increase the power of virtual environments, several different attempts have been made to incorporate sound interactivity in some form. For example, several implementations of virtual environments permit the playing of a previously recorded ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AM '15: Proceedings of the Audio Mostly 2015 on Interaction With Sound

October 2015

250 pages

ISBN:9781450338967

DOI:10.1145/2814895

Conference Chair:
George Kalliris
Aristotle University of Thessaloniki
,
Program Chair:
Charalampos Dimoulas
Aristotle University of Thessaloniki

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 October 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

AM '15

AM '15: Audio Mostly 2015

October 7 - 9, 2015

Thessaloniki, Greece

Acceptance Rates

Overall Acceptance Rate 177 of 275 submissions, 64%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
302
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)3

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Grimshaw-Aagaard MWalther-Hansen M(2024)Less-is-more: auditory strategies for reduced realityPersonal and Ubiquitous Computing10.1007/s00779-024-01808-628:5(713-725)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1007/s00779-024-01808-6
Walther-Hansen M(2020)Making Sense of Recordings10.1093/oso/9780197533901.001.0001Online publication date: 22-Oct-2020
https://doi.org/10.1093/oso/9780197533901.001.0001
Brianza GTajadura-Jiménez AMaggioni EPittera DBianchi-Berthouze NObrist M(2019)As Light as Your Scent: Effects of Smell and Sound on Body Image PerceptionHuman-Computer Interaction – INTERACT 201910.1007/978-3-030-29390-1_10(179-202)Online publication date: 23-Aug-2019
https://doi.org/10.1007/978-3-030-29390-1_10
Cunningham SWeinel JFagerlönn J(2016)The Sound of the Smell (and taste) of my Shoes tooProceedings of the Audio Mostly 201610.1145/2986416.2986456(28-33)Online publication date: 4-Oct-2016
https://dl.acm.org/doi/10.1145/2986416.2986456
Walther-Hansen MGrimshaw MFagerlönn J(2016)Being in a Virtual WorldProceedings of the Audio Mostly 201610.1145/2986416.2986425(77-84)Online publication date: 4-Oct-2016
https://dl.acm.org/doi/10.1145/2986416.2986425
Walther-Hansen M(2015)Balancing Audio: Towards a Cognitive Structure of Sound Interaction in Music ProductionMusic, Mind, and Embodiment10.1007/978-3-319-46282-0_14(228-242)Online publication date: 16-Jun-2015
https://dl.acm.org/doi/10.1007/978-3-319-46282-0_14

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents