Article

Towards Effective Odor Diffusion with Fuzzy Logic in an Olfactory Interface for a Serious Game

Authors:

Miguel Garcia-Ruiz,

Genaro Rebolledo-MendezAuthors Info & Claims

HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings

Pages 3 - 16

https://doi.org/10.1007/978-3-030-90963-5_1

Published: 24 July 2021 Publication History

Abstract

The real world is multisensory and our experiences in this world are constructed by the stimulation of all our senses including visual, auditory, touch, olfactory, and taste. However, virtual environments including virtual simulations and serious games, and the human-computer interface more generally, have focused on the visual and auditory senses. Simulating the other senses such as the sense of smell (olfaction) can be beneficial for supporting learning. In this paper we present a simple and cost-effective olfactory interface constructed using an Arduino Uno microcontroller board, a small fan, an off-the-shelf air freshener to deliver scents to a user of a serious game. A fuzzy logic system regulated the amount of scent delivered to the user based on their distance to the display. As a proof-of-concept, we developed a serious game intended to teach basic math (counting) skills to children. Learners (players) collect pineapples from the scene and then enter the amount of pineapples collected. As the pineapples are collected, a pineapple scent is emitted from the olfactory interface thus serving to supplement or complement the learner’s senses and stimulate their affection and cognition. As part of our proof-of-concept, a 10 year old learner played the game and provided us with feedback regarding the olfactory interface and illustrated the potential of the system.

References

[1]

Seitz AR, van Wassenhove V, and Shams L Simultaneous and independent acquisition of multisensory and unisensory associations Perception 2007 36 1445-1453

[2]

Howes D Senses and Perception: Critical and Primary Sources 2018 London Bloomsbury

[3]

Sheridan, T.B.: Musings on telepresence and virtual presence. Pres. Teleoper. Virtual Environ. 1(1), 120–125 (1992).

[4]

Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Pres. Teleoper. Virtual Environ. 7(3), 225–240 (1998).

[5]

Adelstein, B.D., Begault, D.R., Anderson, M.R., Wenzel, E.M.: Sensitivity to haptic-audio asynchrony. In: Proceedings of the 5th International Conference on Multimodal Interfaces, pp. 73–76. New York, NY (2003).

[6]

Gault RH Touch as a substitute for hearing in the interpretation and control of speech Arch. Otolaryngol. 1926 3 121-213

[7]

Bach-y-Rital P and Kercel SW Sensory substitution and the human-machine interface Trends Cogn. Sci. 2003 7 12 541-546

[8]

Olsén JE Vicariates of the Eye: Blindness Sense Substitution, and Writing Devices in the Nineteenth Century Mosaic Interdisc. Crit. J. 2013 46 3 75-91

[9]

Visell Y Tactile sensory substitution: models for enaction in HCI Interact. Comput. 2009 21 1–2 38-53

[10]

Flavian C, Ibanez-Sanchez S, and Orus C The influence of scent on virtual reality experiences: the role of aroma-content congruence J. Bus. Res. 2021 123 289-301

[11]

Persky, S., Dolwick, A.P.: Olfactory perception and presence in a virtual reality food environment. Front. Virtual Real. 1, 571812 (2020).

[12]

Youngblut, C.: Educational use of virtual reality technology. Tech. Report. Inst. Defense Analyses, US (1998).

[13]

Richard E, Tijou A, Richard P, and Ferrier JL Multi-modal virtual environments for education with haptic and olfactory feedback Virtual Reality 2006 10 3–4 207-225

[14]

Aiken MP and Berry MJ Posttraumatic stress disorder: possibilities for olfaction and virtual reality exposure therapy Virtual Reality 2015 19 2 95-109

[15]

Tomasi D, Ferris H, Booraem P, Enman L, Gates S, and Reyns E Olfactory virtual reality (OVR) for wellbeing and reduction of stress J. Med. Res. Health Sci. 2021 4 3 1212-1221

[16]

Kaye JJ Making scents: aromatic output for HCI Interactions 2004 11 1 48-61

[17]

The Smell of Success. Instructables. https://www.instructables.com/Smell-of-Success/. Accessed 18 May 2021

[18]

IoT Air Freshener (with NodeMCU, Arduino, IFTTT and Adafruit.io)., https://www.instructables.com/IoT-Air-Freshner-with-NodeMCU-Arduino-IFTTT-and-Ad/#step1. Accessed 19 May 2021

[19]

Herrera, N., McMahan, R.: Development of a simple and low-cost olfactory display for immersive media experiences. In: ImmersiveMe 2014, ACM (2014)

[20]

Garcia-Ruiz MA and Santana-Mancilla PC Creative DIY Microcontroller Projects with C: A Practical Guide to Building PIC and STM32 Microcontroller Board Applications with C Programming 2021 Birmingham, UK Packt Publishing

[21]

Sardo, J.D., Pereira, J.A., Veiga, R.J., Semião, J., Cardoso, P.J., Rodrigues, J.M.: Multisensorial portable device for augmented reality experiences in museums. Int. J. Educ. Learn. Syst. 3 (2018)

[22]

Vuppalapati, C., Vuppalapati, R., Kedari, S., Ilapakurti, A., Vuppalapati, J.S., Kedari, S.: Fuzzy logic infused intelligent scent dispenser for creating memorable customer experience of long-tail connected venues. In: IEEE International Conference on Machine Learning and Cybernetics (ICMLC), vol. 1, pp. 149–154 (2018)

[23]

Zadeh LA Is there a need for fuzzy logic? Inf. Sci. 2008 178 13 2751-2779

[24]

Kumar, L., Rawat, T. S., Pandey, M., Kumar, U.: Automatic control of fan speed using fuzzy logic. Int. J. Eng. Technol. Manag. Appl. Sci. 3(4) (2015)

[25]

Garcia-Ruiz MA, Santana-Mancilla PC, and Gaytan-Lugo LS Integrating microcontroller-based projects in a human-computer interaction course Int. J. Comput. Inf. Eng. 2018 12 10 946-950

[26]

Garcia-Ruiz, M.A., Santana-Mancilla, P.C.: Development and usability testing of simulated wind in a racing video game. In: Proceedings of The 2015 IEEE Games, Entertainment, and Media (GEM) Conference, Toronto, Canada (2015)

[27]

Zadeh LA Fuzzy sets Inf. Control 1965 8 338-353

[28]

PWM, https://www.arduino.cc/en/Tutorial/PWM. Accessed 18 May 2021

[29]

Fuzzy Library for Arduino, https://github.com/amimaro/FuzzyLibrary. Accessed 18 May 2021

[30]

Bai, Y., Wang, D.: Fundamentals of fuzzy logic control — fuzzy sets, fuzzy rules and defuzzifications. In: Bai, Y., Zhuang, H., Wang, D. (eds.) Advanced Fuzzy Logic Technologies in Industrial Applications. Advances in Industrial Control. Springer, London (2006).

[31]

Bertolino, A.: Software testing research: achievements, challenges, dreams. In: 2007 Future of Software Engineering, pp. 85–103. IEEE Computer Society (2007)

[32]

Panda3D. https://www.panda3d.org/. Accessed 18 May 2021

[33]

Henrich, V., Reuter, T.: CarDriver–Using Python and Panda3D to construct a Virtual Environment for Teaching Driving. Reykjavík University RUTR-CS08003 (2008)

[34]

Garcia-Ruiz, M.A., Santana-Mancilla, P.C.: Towards a usable serious game app to support children’s language therapy. In: Proceedings of the IX Latin American Conference on Human Computer Interaction, pp. 1–4 (2019)

[35]

Canadian Centre for Occupational Health and Safety. https://www.ccohs.ca/oshanswers/ergonomics/office/monitor_positioning.html. Accessed 19 May 2021

[36]

Kapralos, B., Moussa, F., Collins, K., Dubrowski, A.: Fidelity and multimodal interactions. In: Wouters, P., van Oostendorp, H. (eds.) Instructional Techniques to Facilitate Learning and Motivation of Serious Games. Advances in Game-Based Learning. Springer, Cham (2017).

[37]

Melaisi, M., Rojas, D., Kapralos, B., Uribe-Quevedo, A., Collins, K.: Multimodal interaction of contextual and non-contextual sound and haptics in virtual simulations. Informatics 5(4), 43 (2018)

[38]

Garcia-Ruiz, M.A., Edwards, A., Aquino-Santos, R., Alvarez-Cardenas, O., Mayoral Baldivia, G.M.: Integrating the sense of smell in virtual reality for second language learning. In: Proceedings of Elearn conference, Las Vegas, NV. Association for the Advancement of Computing in Education (AACE) (2008)

Cited By

Garcia-Ruiz MSantana-Mancilla PGaytan-Lugo LAquino-Santos R(2022)Smelling on the Edge: Using Fuzzy Logic in Edge Computing to Control an Olfactory Display in a Video Game2022 IEEE Conference on Games (CoG)10.1109/CoG51982.2022.9893551(508-511)Online publication date: 21-Aug-2022
https://dl.acm.org/doi/10.1109/CoG51982.2022.9893551

Index Terms

Towards Effective Odor Diffusion with Fuzzy Logic in an Olfactory Interface for a Serious Game

Index terms have been assigned to the content through auto-classification.

Recommendations

Towards Efficient Odor Diffusion with an Olfactory Display Using an Electronic Nose
HCI International 2022 - Late Breaking Papers. Multimodality in Advanced Interaction Environments
Abstract
Olfactory displays (human-computer interfaces that generate and diffuse odors to a user with a purpose) have been researched to complement or supplement other human sensory modalities, as well as using odors as effective sensory stimuli. We ...
Towards a Constructionist Serious Game Engine
CompSysTech '16: Proceedings of the 17th International Conference on Computer Systems and Technologies 2016

Game developers have been using commercial game engines to create serious games. The development of serious game is a process that requires game and instructional design. Constructionist environments and games are becoming more popular in the last years ...
Fuzzy-based dynamic difficulty adjustment of an educational 3D-game
Abstract
An educational game aims to employ the pleasant and fascinating environment of a game for educational purpose. However, when the game’s educational content or playing environment does not match with the player’s learning needs or game-playing ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence: 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings

Jul 2021

612 pages

ISBN:978-3-030-90962-8

DOI:10.1007/978-3-030-90963-5

Editors:
Constantine Stephanidis
University of Creteand Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece
,
Masaaki Kurosu
The Open University of Japan, Chiba, Japan
,
Jessie Y. C. Chen
U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA
,
Gino Fragomeni
U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA
,
Norbert Streitz
Smart Future Initiative, Frankfurt am Main, Hessen, Germany
,
Shin'ichi Konomi
Faculty of Arts and Science, Kyushu University, Fukuoka, Japan
,
Helmut Degen
Siemens (United States), Princeton, NJ, USA
,
Stavroula Ntoa
Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

© Springer Nature Switzerland AG 2021.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 24 July 2021

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Garcia-Ruiz MSantana-Mancilla PGaytan-Lugo LAquino-Santos R(2022)Smelling on the Edge: Using Fuzzy Logic in Edge Computing to Control an Olfactory Display in a Video Game2022 IEEE Conference on Games (CoG)10.1109/CoG51982.2022.9893551(508-511)Online publication date: 21-Aug-2022
https://dl.acm.org/doi/10.1109/CoG51982.2022.9893551

View Options

View options

Figures

Tables

Media

View Table of Conten