skip to main content
10.1145/3173225.3173241acmconferencesArticle/Chapter ViewAbstractPublication PagesteiConference Proceedingsconference-collections
research-article

Sensory VR: Smelling, Touching, and Eating Virtual Reality

Published: 18 March 2018 Publication History

Abstract

We present two proof of concept sensory experiences designed for virtual reality (VR). Our experiences bring together smell, sound, taste, touch, and sight, focusing on low-cost, non-digital materials and on passive interactions. We also contribute a design rationale and a review of sensory interactions, particularly those designed for VR. We argue that current sensory experiences designed for VR often lack a broader consideration of the senses, especially in their neglect of the non-digital. We discuss some implications of non-digital design for sensory VR, suggesting that there may be opportunities to expand conceptions of what sensory design in VR can be.

Supplementary Material

suppl.mov (fp1076.mp4)
Supplemental video

References

[1]
Anvio VR. 2017. Retrieved from: https://en.anviovr.com/
[2]
Bruno de Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 218--226.
[3]
Peter Arnold. 2017. You Better Eat to Survive! Exploring Edible Interactions in a Virtual Reality Game. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 206--209.
[4]
AxonVR. 2017. Retrieved from: https://axonvr.com/
[5]
Jeffrey Bardzell and Shaowen Bardzell. 2013. What is "critical" about critical design? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 3297--3306.
[6]
Steve Benford, Gabriella Giannachi, Boriana Koleva, and Tom Rodden. 2009. From interaction to trajectories: designing coherent journeys through user experiences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 709--718.
[7]
Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 717--728.
[8]
Jeanne Brockmyer, Christine Fox, Kathleen Curtiss, Evan McBroom, Kimberly Burkhart, and Jaquelyn Pidruzny. 2009. The Development of the Game Engagement Questionnaire: A Measure of Engagement in Video Game Playing: Response to Reviews. Journal of Experimental Social Psychology 25, 4 (March 2009), 624--634.
[9]
Sylvain Chagué and Caecilia Charbonnier. 2016. Real Virtuality: A Multi-User Immersive Platform Connecting Real and Virtual Worlds, VRIC 2016 Virtual Reality International Conference - Laval Virtual, Laval, France, ACM New York, NY, USA.
[10]
Lung-Pan Cheng, Patrick Lühne, Pedro Lopes, Christoph Sterz, and Patrick Baudisch. 2014. Haptic turk: a motion platform based on people. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3463--3472.
[11]
Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Mutual Human Actuation. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 797--805.
[12]
Lung-Pan Cheng, Thijs Roumen, Hannes Rantzsch, Sven Köhler, Patrick Schmidt, Robert Kovacs, Johannes Jasper, Jonas Kemper, and Patrick Baudisch. 2015. TurkDeck: Physical Virtual Reality Based on People. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 417--426.
[13]
Lung-Pan Cheng, Eyal Ofek, Christian Holz, Hrvoje Benko, and Andrew D. Wilson. 2017. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3718--3728.
[14]
Alena Denisova, A. Imran Nordin, and Paul Cairns. 2016. The Convergence of Player Experience Questionnaires. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 33--37.
[15]
Jelle van Dijk and Caroline Hummels. 2017. Designing for Embodied Being-in-the-World: Two Cases, Seven Principles and One Framework. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). ACM, New York, NY, USA, 47--56.
[16]
Ruofei Du and Liang He. 2016. VRSurus: Enhancing Interactivity and Tangibility of Puppets in Virtual Reality. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 2454--2461.
[17]
William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a resource for design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 233--240.
[18]
Gheorghita Ghinea and Oluwakemi A. Ademoye. 2011. Olfaction-enhanced multimedia: perspectives and challenges. Multimedia Tools Appl. 55, 3 (December 2011), 601--626.
[19]
GotouchVR. 2017. Retrieved from: https://www.gotouchvr.com/
[20]
Jan Gugenheimer, Dennis Wolf, Gabriel Haas, Sebastian Krebs, and Enrico Rukzio. 2016. SwiVRChair: A Motorized Swivel Chair to Nudge Users' Orientation for 360 Degree Storytelling in Virtual Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1996--2000.
[21]
Daniel Harley, Jean Ho Chu, Jamie Kwan, and Ali Mazalek. 2016. Towards a Framework for Tangible Narratives. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 62--69.
[22]
Daniel Harley, Aneesh P. Tarun, Daniel Germinario, and Ali Mazalek. 2017. Tangible VR: Diegetic Tangible Objects for Virtual Reality Narratives. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 1253--1263.
[23]
Victoria Henshaw, Dominic Medway, Gary Warnaby, and Chris Perkins. 2016 Marketing the "city of smells". 16 2 (June 2016), 153--170.
[24]
Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1957--1967.
[25]
Philipp Hock, Sebastian Benedikter, Jan Gugenheimer, and Enrico Rukzio. 2017. CarVR: Enabling In-Car Virtual Reality Entertainment. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4034--4044.
[26]
Holovis. 2017. Retrieved from: http://www.holovis.com/
[27]
Eva Hornecker. 2006. Physicality in tangible interaction: bodies and the world. First Steps in Physicality, 21.
[28]
Eva Hornecker. 2008. "I don't understand it either, but it is cool"-visitor interactions with a multi-touch table in a museum. In Horizontal interactive human computer systems, 2008. TABLETOP 2008. 3rd IEEE International Workshop on, pp. 113--120. IEEE, 2008.
[29]
HTC Vive. 2017. Retrieved from: https://www.vive.com
[30]
Feelreal. 2017. Retrieved from: http://feelreal.com/.
[31]
Felix Hülsmann, Julia Fröhlich, Nikita Mattar, and Ipke Wachsmuth. 2014. Wind and warmth in virtual reality: implementation and evaluation. In Proceedings of the 2014 Virtual Reality International Conference (VRIC '14). ACM, New York, NY, USA, Article 24, 8 pages.
[32]
Charlene Jennett, Anna L. Cox, Paul Cairns, Samira Dhoparee, Andrew Epps, Tim Tijs, and Alison Walton. 2008. Measuring and defining the experience of immersion in games. Int. J. Hum.-Comput. Stud. 66, 9 (September 2008), 641--661.
[33]
Takayuki Kosaka and Takuya Iwamoto. 2013. Serious dietary education system for changing food preferences "food practice shooter". In Proceedings of the Virtual Reality International Conference: Laval Virtual (VRIC '13). ACM, New York, NY, USA, Article 23, 4 pages.
[34]
Maggie Kosek, Babis Koniaris, David Sinclair, Desislava Markova, Fraser Rothnie, Lanny Smoot, and Kenny Mitchell. 2017. IRIDiuM+: deep media storytelling with non-linear light field video. In ACM SIGGRAPH 2017 VR Village (SIGGRAPH '17). ACM, New York, NY, USA, Article 10, 2 pages.
[35]
Pascal Knierim, Thomas Kosch, Valentin Schwind, Markus Funk, Francisco Kiss, Stefan Schneegass, and Niels Henze. 2017. Tactile Drones - Providing Immersive Tactile Feedback in Virtual Reality through Quadcopters. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 433--436.
[36]
Kuka. 2017. Kuka Coaster. Retrieved from: https://www.kuka.com/en-ca/industries/other-industries/entertainment/kuka-coaster
[37]
Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating Physical Impact by Combining Tactile Stimulation with Electrical Muscle Stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 11--19.
[38]
Keigo Matsumoto, Yuki Ban, Takuji Narumi, Yohei Yanase, Tomohiro Tanikawa, and Michitaka Hirose. 2016. Unlimited corridor: redirected walking techniques using visuo haptic interaction. In ACM SIGGRAPH 2016 Emerging Technologies (SIGGRAPH '16). ACM, New York, NY, USA, Article 20, 2 pages.
[39]
Melanie McBride & Jason Nolan. (2016). "Including smell: An intersensory curriculum, by design." In Victoria Henshaw, Kate MacLean, Dominic Medway, Chris Perkins, & Gary Warnaby (eds.). Designing with smell: practices, techniques and challenges. New York: Routledge.
[40]
Michael Meehan, Brent Insko, Mary Whitton, and Frederick P. Brooks, Jr. 2002. Physiological measures of presence in stressful virtual environments. In Proceedings of the 29th annual conference on Computer graphics and interactive techniques (SIGGRAPH '02). ACM, New York, NY, USA, 645--652.
[41]
Janet Murray. 2005. Did it make you cry? Creating dramatic agency in immersive environments. In Virtual Storytelling. Using Virtual Reality Technologies for Storytelling (pp. 83--94). Springer Berlin Heidelberg.
[42]
Niall Murray, Brian Lee, Yuansong Qiao, and Gabriel-Miro Muntean. 2016. Olfaction-Enhanced Multimedia: A Survey of Application Domains, Displays, and Research Challenges. ACM Comput. Surv. 48, 4, Article 56 (May 2016), 34 pages.
[43]
Ryohei Nagao, Keigo Matsumoto, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. Infinite stairs: simulating stairs in virtual reality based on visuo-haptic interaction. In ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH '17). ACM, New York, NY, USA, Article 14, 2 pages.
[44]
Hiromi Nakamura and Homei Miyashita. 2011. Augmented gustation using electricity. In Proceedings of the 2nd Augmented Human International Conference (AH '11). ACM, New York, NY, USA, Article 34, 2 pages.
[45]
Takuya Nakano, Shota Saji, and Yasuyuki Yanagida. 2012. Indicating wind direction using a fan-based wind display. In Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part II (EuroHaptics'12), Poika Isokoski and Jukka Springare (Eds.), Vol. Part II. Springer-Verlag, Berlin, Heidelberg, 97--102.
[46]
Takuji Narumi. 2016. Multi-sensorial virtual reality and augmented human food interaction. In Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction (MHFI '16), Anton Nijholt, Carlos Velasco, Gijs Huisman, and Kasun Karunanayaka (Eds.). ACM, New York, NY, USA, Article, 6 pages.
[47]
Takuji Narumi, Shinya Nishizaka, Takashi Kajinami, Tomohiro Tanikawa, and Michitaka Hirose. 2011. Augmented reality flavors: gustatory display based on edible marker and cross-modal interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI '11). ACM, New York, NY, USA, 93--102.
[48]
Neo Sensory. 2017. Retrieved from: http://neosensory.com/
[49]
Don Norman. 2013 The design of everyday things: Revised and expanded edition, New York City, NY: Basic Books.
[50]
Daniela Petrelli, Alessandro Soranzo, Luigina Ciolfi, and John Reidy. 2016. Exploring the Aesthetics of Tangible Interaction: Experiments on the Perception of Hybrid Objects. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 100--108.
[51]
Punchdrunk. 2017. Sleep No More. Retrieved from: https://www.punchdrunk.org.uk/sleep-no-more/
[52]
ProjectiCan. 2017. Retrieved from: https://project-ican.com/
[53]
Nimesha Ranasinghe, Pravar Jain, Shienny Karwita, David Tolley, and Ellen Yi-Luen Do. 2017. Ambiotherm: Enhancing Sense of Presence in Virtual Reality by Simulating Real-World Environmental Conditions. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1731--1742.
[54]
Nimesha Ranasinghe and Ellen Yi-Luen Do. 2016. Digital Lollipop: Studying Electrical Stimulation on the Human Tongue to Simulate Taste Sensations. ACM Trans. Multimedia Comput. Commun. Appl. 13, 1, Article 5 (October 2016), 22 pages.
[55]
Michael Rietzler, Katrin Plaumann, Taras Kränzle, Marcel Erath, Alexander Stahl, and Enrico Rukzio. 2017. VaiR: Simulating 3D Airflows in Virtual Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 5669--5677.
[56]
Dominik Schmidt, Rob Kovacs, Vikram Mehta, Udayan Umapathi, Sven Köhler, Lung-Pan Cheng, and Patrick Baudisch. 2015. Level-Ups: Motorized Stilts that Simulate Stair Steps in Virtual Reality. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2157--2160.
[57]
Dominik Schmidt, Raf Ramakers, Esben W. Pedersen, Johannes Jasper, Sven Köhler, Aileen Pohl, Hannes Rantzsch, Andreas Rau, Patrick Schmidt, Christoph Sterz, Yanina Yurchenko, and Patrick Baudisch. 2014. Kickables: tangibles for feet. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3143--3152.
[58]
Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3115--3119.
[59]
Six Flags. 2017. Galactic Attack. https://www.sixflags.com/overtexas/newsroom/galactic-attack-vr-coaster
[60]
Mel Slater. 1999. Measuring Presence: A Response to the Witmer and Singer Presence Questionnaire. Presence: Teleoper. Virtual Environ. 8, 5 (October 1999), 560--565.
[61]
Dorothé Smit, Doenja Oogjes, Bruna Goveia de Rocha, Ambra Trotto, Yeup Hur, and Caroline Hummels. 2016. Ideating in Skills: Developing Tools for Embodied Co-Design. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '16). ACM, New York, NY, USA, 78--85.
[62]
Charles Spence, Marianna Obrist, Carlos Velasco, and Nimesha Ranasinghe. 2017. Digitizing the chemical senses: possibilities & pitfalls. International Journal of Human-Computer Studies (2017), 1071--5819.
[63]
Misha Sra, and Chris Schmandt. 2015. MetaSpace II: Object and Full-body Tracking for Interaction and Navigation in Social VR. arXiv preprint arXiv:1512.02922.
[64]
Evan A. Suma, Mahdi Azmandian, Timofey Grechkin, Thai Phan, and Mark Bolas. 2015. Making small spaces feel large: infinite walking in virtual reality. In ACM SIGGRAPH 2015 Emerging Technologies (SIGGRAPH '15). ACM, New York, NY, USA, Article 16, 1 pages.
[65]
Paul Tennent, Joe Marshall, Brendan Walker, Patrick Brundell, and Steve Benford. 2017. The Challenges of Visual-Kinaesthetic Experience. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 1265--1276.
[66]
Vaqso. 2017. Retrieved from: https://vaqso.com/
[67]
Eduardo Velloso, Dominik Schmidt, Jason Alexander, Hans Gellersen, and Andreas Bulling. 2015. The Feet in Human-Computer Interaction: A Survey of Foot-Based Interaction. ACM Comput. Surv. 48, 2, Article 21 (September 2015), 35 pages.
[68]
Virtuix. 2017. Retrieved from: http://www.virtuix.com/
[69]
VIRZOOM. 2017. Retrieved from: https://www.virzoom.com/
[70]
ViveNChill. 2017. Retrieved from: https://www.indiegogo.com/projects/vivenchill-vr#/
[71]
The Void. 2017. Retrieved from: https://www.thevoid.com/
[72]
VR Go. 2017. Retrieved from: http://www.vrgochair.com/
[73]
VR Studios. 2017. VRCade. Retrieved from: https://www.vrstudios.com/vrcade/
[74]
VR Zone. 2017. Retrieved from: https://vrzone-pic.com/en/
[75]
Sarah Wiseman, Janet van der Linden, Ad Spiers, and Maria Oshodi. 2017. Control and Being Controlled: Exploring the use of Technology in an Immersive Theatre Performance. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 3--14.
[76]
Bob G. Witmer and Michael J. Singer. 1998. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoper. Virtual Environ. 7, 3 (June 1998), 225--240.
[77]
Masasuke Yasumoto and Takehiro Teraoka. 2015. Shadow Shooter. In Proceedings of the 2015 Virtual Reality International Conference (VRIC '15). ACM, New York, NY, USA, Article 17, 2 pages.
[78]
Andre Zenner and Antonio Kruger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (April 2017), 1285--1294.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction
March 2018
763 pages
ISBN:9781450355681
DOI:10.1145/3173225
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. diegetic design
  2. interactive narratives
  3. non-digital.
  4. sensory design
  5. tangible and embodied interaction
  6. virtual reality

Qualifiers

  • Research-article

Funding Sources

  • Canadian Foundation for Innovation
  • Canada Research Chairs
  • Ontario Ministry of Research and Innovation

Conference

TEI '18
Sponsor:

Acceptance Rates

TEI '18 Paper Acceptance Rate 37 of 130 submissions, 28%;
Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)226
  • Downloads (Last 6 weeks)31
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media