skip to main content
10.1145/3586182.3616667acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
poster

AwakenFlora: Exploring Proactive Smell Experience in Virtual Reality through Mid-Air Gestures

Published: 29 October 2023 Publication History

Abstract

We explored mid-air gestural interactions for proactive smell experiences in Virtual Reality (VR). With a wearable scent-delivery device, a set of gestures that interact with virtual objects are mapped to corresponding olfactory tasks, i.e., scent release, scent intensity adjustment, and scent switch. We conducted a user study for preliminary validation, revealing significant advantages of gestural interactions over the traditional handle controller for scent release. Our findings demonstrate the potential of gestural interactions in enhancing proactive smell experiences in VR and contribute insights into how proactive gestural input can benefit engaging olfactory experiences in virtual environments.

Supplemental Material

MP4 File
presentation video -short version
ZIP File
Supplemental File

References

[1]
Remi Alkemade, Fons J. Verbeek, and Stephan G. Lukosch. 2017. On the Efficiency of a VR Hand Gesture-Based Interface for 3D Object Manipulations in Conceptual Design. International Journal of Human–Computer Interaction 33, 11 (2017), 882–901. https://doi.org/10.1080/10447318.2017.1296074 arXiv:https://doi.org/10.1080/10447318.2017.1296074
[2]
Jas Brooks, Steven Nagels, and Pedro Lopes. 2020. Trigeminal-Based Temperature Illusions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376806
[3]
Mario Covarrubias, Monica Bordegoni, Mauro Rosini, Eleonora Guanziroli, Umberto Cugini, and Franco Molteni. 2015. VR System for Rehabilitation Based on Hand Gestural and Olfactory Interaction. In Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology (Beijing, China) (VRST ’15). Association for Computing Machinery, New York, NY, USA, 117–120. https://doi.org/10.1145/2821592.2821619
[4]
Miguel A Garcia-Ruiz, Arthur Edwards, Raul Aquino-Santos, Omar Alvarez-Cardenas, and Margarita Glenda Mayoral-Baldivia. 2008. Integrating the sense of smell in virtual reality for second language learning. In E-learn: world conference on E-learning in corporate, government, healthcare, and higher education. Association for the Advancement of Computing in Education (AACE), 2647–2652.
[5]
Masoumehsadat Hosseini, Tjado Ihmels, Ziqian Chen, Marion Koelle, Heiko Müller, and Susanne Boll. 2023. Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across Domains. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 311, 24 pages. https://doi.org/10.1145/3544548.3581420
[6]
Joseph" Jofish" Kaye. 2004. Making scents: Aromatic output for HCI. interactions 11, 1 (2004), 48–61.
[7]
Arito Mochizuki, Takashi Amada, Sayuri Sawa, Tadayuki Takeda, Shogo Motoyashiki, Kazuhiro Kohyama, Masataka Imura, and Kunihiro Chihara. 2004. Fragra: A Visual-Olfactory VR Game. In ACM SIGGRAPH 2004 Sketches (Los Angeles, California) (SIGGRAPH ’04). Association for Computing Machinery, New York, NY, USA, 123. https://doi.org/10.1145/1186223.1186377
[8]
Takamichi Nakamoto, Shigeki Otaguro, Masashi Kinoshita, Masahiko Nagahama, Keita Ohinishi, and Taro Ishida. 2008. Cooking Up an Interactive Olfactory Game Display. IEEE Computer Graphics and Applications 28, 1 (2008), 75–78. https://doi.org/10.1109/MCG.2008.3
[9]
Simon Niedenthal, William Fredborg, Peter Lundén, Marie Ehrndal, and Jonas K Olofsson. 2023. A graspable olfactory display for virtual reality. International journal of human-computer studies 169 (2023), 102928.
[10]
J. Pair, B. Allen, M. Dautricourt, A. Treskunov, M. Liewer, K. Graap, and G. Reger. 2006. A Virtual Reality Exposure Therapy Application for Iraq War Post Traumatic Stress Disorder. In IEEE Virtual Reality Conference (VR 2006). 67–72. https://doi.org/10.1109/VR.2006.23
[11]
Nimesha Ranasinghe, David Tolley, Thi Ngoc Tram Nguyen, Liangkun Yan, Barry Chew, and Ellen Yi-Luen Do. 2019. Augmented flavours: Modulation of flavour experiences through electric taste augmentation. Food Research International 117 (2019), 60–68.
[12]
Gang Ren and Eamonn O’Neill. 2013. 3D selection with freehand gesture. Computers & Graphics 37, 3 (2013), 101–120. https://doi.org/10.1016/j.cag.2012.12.006
[13]
Emily Shaw, Tessa Roper, Tommy Nilsson, Glyn Lawson, Sue V.G. Cobb, and Daniel Miller. 2019. The Heat is On: Exploring User Behaviour in a Multisensory Virtual Environment for Fire Evacuation. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300856
[14]
Shou-En Tsai, Wan-Lun Tsai, Tse-Yu Pan, Chia-Ming Kuo, and Min-Chun Hu. 2021. Does virtual odor representation influence the perception of olfactory intensity and directionality in vr?. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, 279–285.
[15]
Eulalie Verhulst, Paul Richard, Emmanuelle Richard, Philippe Allain, and Pierre Nolin. 2016. 3D Interaction Techniques for Virtual Shopping: Design and Preliminary Study. In VISIGRAPP (1: GRAPP). 271–279.
[16]
Yanan Wang, Zhitong Cui, Hebo Gong, and Ting Chen. 2023. OlfacKit: A Toolkit for Integrating Atomization-Based Olfactory Interfaces into Daily Scenarios. International Journal of Human–Computer Interaction (2023), 1–20. https://doi.org/10.1080/10447318.2023.2212512
[17]
Yuting Wang and Ziqing Li. 2022. Living with Smell Dysfunction: A Multi-Sensory VR Experience. In ACM SIGGRAPH 2022 Immersive Pavilion (Vancouver, BC, Canada) (SIGGRAPH ’22). Association for Computing Machinery, New York, NY, USA, Article 10, 2 pages. https://doi.org/10.1145/3532834.3536219
[18]
Shangyin Zou, Xianyin Hu, Yuki Ban, and Shin’ichi Warisawa. 2022. Simulating Olfactory Cocktail Party Effect in VR: A Multi-odor Display Approach Based on Attention. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 474–482.

Cited By

View all

Index Terms

  1. AwakenFlora: Exploring Proactive Smell Experience in Virtual Reality through Mid-Air Gestures

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '23 Adjunct: Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology
    October 2023
    424 pages
    ISBN:9798400700965
    DOI:10.1145/3586182
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 October 2023

    Check for updates

    Author Tags

    1. mid-air gestures
    2. proactive olfactory interactions
    3. virtual reality

    Qualifiers

    • Poster
    • Research
    • Refereed limited

    Funding Sources

    Conference

    UIST '23

    Acceptance Rates

    Overall Acceptance Rate 355 of 1,733 submissions, 20%

    Upcoming Conference

    UIST '25
    The 38th Annual ACM Symposium on User Interface Software and Technology
    September 28 - October 1, 2025
    Busan , Republic of Korea

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)146
    • Downloads (Last 6 weeks)9
    Reflects downloads up to 06 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media