research-article

Too Hot to Handle: An Evaluation of the Effect of Thermal Visual Representation on User Grasping Interaction in Virtual Reality

Authors:

Andreea Dalia Blaga,

Maite Frutos-Pascual,

Ian WilliamsAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 16

https://doi.org/10.1145/3313831.3376554

Published: 23 April 2020 Publication History

Abstract

Influence of interaction fidelity and rendering quality on perceived user experience have been largely explored in Virtual Reality (VR). However, differences in interaction choices triggered by these rendering cues have not yet been explored. We present a study analysing the effect of thermal visual cues and contextual information on 50 participants' approach to grasp and move a virtual mug. This study comprises 3 different temperature cues (baseline empty, hot and cold) and 4 contextual representations; all embedded in a VR scenario. We evaluate 2 different hand representations (abstract and human) to assess grasp metrics. Results show temperature cues influenced grasp location, with the mug handle being predominantly grasped with a smaller grasp aperture for the hot condition, while the body and top were preferred for baseline and cold conditions.

Supplementary Material

MP4 File (paper427pv.mp4)

Preview video

Download
1.91 MB

MP4 File (a427-blaga-presentation.mp4)

Download
68.54 MB

References

[1]

Merwan Achibet, Adrien Girard, Anthony Talvas, Maud Marchal, and Anatole Le´ cuyer. 2015. Elastic-Arm: Human-scale passive haptic feedback for augmenting interaction and perception in virtual environments. In 2015 IEEE Virtual Reality (VR). 63--68.

[2]

Vamsi Kiran Adhikarla, Pawel Woz´ niak, Attila Barsi, Dave Singhal, Petér T. Kova´ cs, and Tibor Balogh. 2014. Freehand interaction with large-scale 3D map data. In 2014 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON). 1--4.

[3]

Maadh Al-Kalbani, Ian Williams, and Maite Frutos-Pascual. 2016a. Analysis of Medium Wrap Freehand Virtual Object Grasping in Exocentric Mixed Reality. In Mixed and Augmented Reality (ISMAR), 2016 IEEE International Symposium on. IEEE, 84--93.

[4]

Maadh Al-Kalbani, Ian Williams, and Maite Frutos-Pascual. 2016b. Improving freehand placement for grasping virtual objects via dual view visual feedback in mixed reality. In Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology. ACM, 279--282.

Digital Library

[5]

Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI'16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 218--226.

Digital Library

[6]

R Barkokebas, C Ritter, V Sirbu, X Li, and M Al-Hussein. 2019. Application of Virtual Reality in Task Training in the Construction Manufacturing Industry. In ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction, Vol. 36. IAARC Publications, 796--803.

[7]

Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, 717--728.

Digital Library

[8]

Corwin A. Bennett and Paule Rey. 1972. What's So Hot about Red? Human Factors 14, 2 (1972), 149--154. 5022474.

[9]

VG Bharath and Rajashekar Patil. 2018. Solid modelling interaction with sensors for virtual reality welding. In MATEC Web of Conferences, Vol. 144. EDP Sciences, 01008.

[10]

Frank Biocca. 1995. Communication Applications of Virtual Reality. (06 1995).

[11]

Frank Biocca, Jin Kim, and Yung Choi. 2001. Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions. Presence: Teleoperators and Virtual Environments 10, 3 (2001), 247--265.

Digital Library

[12]

Christoph W Borst and Arun P Indugula. 2005. Realistic virtual grasping. In IEEE Proceedings. VR 2005. Virtual Reality, 2005. 91--98.

[13]

Christoph W Borst and Arun P Indugula. 2006. A spring model for whole-hand virtual grasping. Presence: Teleoperators and Virtual Environments 15, 1 (2006), 47--61.

Digital Library

[14]

Doug A. Bowman, Ryan P. McMahan, and Eric D. Ragan. 2012. Questioning Naturalism in 3D User Interfaces. Commun. ACM 55, 9 (Sept. 2012), 78--88.

Digital Library

[15]

Volkert Buchmann, Trond Nilsen, and Mark Billinghurst. 2005. Interaction with Partially Transparent Hands and Objects. In Proceedings of the Sixth Australasian Conference on User Interface - Volume 40 (AUIC '05). 17--20. http://dl.acm.org/citation.cfm?id=1082243.1082246

Digital Library

[16]

Ian M. Bullock, Thomas Feix, and Aaron M. Dollar. 2013. Finding small, versatile sets of human grasps to span common objects. In 2013 IEEE International Conference on Robotics and Automation. 1068--1075.

[17]

Ian M Bullock, Thomas Feix, and Aaron M Dollar. 2015. The Yale human grasping dataset: Grasp, object, and task data in household and machine shop environments. The International Journal of Robotics Research 34, 3 (2015), 251--255.

Digital Library

[18]

Inrak Choi, Eyal Ofek, Hrvoje Benko, Mike Sinclair, and Christian Holz. 2018. CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Article 654, 13 pages.

Digital Library

[19]

Natalia Cooper, Ferdinando Milella, Carlo Pinto, Iain Cant, Mark White, and Georg Meyer. 2018. The effects of substitute multisensory feedback on task performance and the sense of presence in a virtual reality environment. PloS one 13, 2 (2018), e0191846.

[20]

James J. Cummings and Jeremy N. Bailenson. 2016. How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence. Media Psychology 19, 2 (2016), 272--309.

[21]

Mark R. Cutkosky. 1989. On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Transactions on Robotics and Automation 5, 3 (Jun 1989), 269--279.

[22]

Dragos Datcu and Stephan Lukosch. 2013. Free-hands Interaction in Augmented Reality. In Proceedings of the 1st Symposium on Spatial User Interaction (SUI '13). ACM, 33--40.

Digital Library

[23]

Huong Q. Dinh, Neff Walker, Larry F. Hodges, Chang Song, and Akira Kobayashi. 1999. Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments. In Proceedings IEEE Virtual Reality (Cat. No. 99CB36316). 222--228.

[24]

Pierre Dragicevic. 2016. Fair statistical communication in HCI. In Modern Statistical Methods for HCI. Springer, 291--330.

[25]

T. Feix, I. M. Bullock, and A. M. Dollar. 2014a. Analysis of Human Grasping Behavior: Object Characteristics and Grasp Type. IEEE Transactions on Haptics 7, 3 (July 2014), 311--323.

[26]

Thomas Feix, Ian M. Bullock, and Aaron M. Dollar. 2014b. Analysis of Human Grasping Behavior: Object Characteristics and Grasp Type. IEEE Transactions on Haptics 7, 3 (July 2014), 311--323.

[27]

Thomas Feix, Roland Pawlik, Heinz-Bodo Schmiedmayer, Javier Romero, and Danica Kragiç. 2009. A comprehensive grasp taxonomy. Robotics, Science and Systems Conference: Workshop on Understanding the Human Hand for Advancing Robotic Manipulation (2009), 2--3.

[28]

Thomas Feix, Javier Romero, Heinz-Bodo Schmiedmayer, Aaron M. Dollar, and Danica Kragiç. 2016. The GRASP Taxonomy of Human Grasp Types. IEEE Transactions on Human-Machine Systems 46, 1 (Feb 2016), 66--77.

[29]

Scott Fisher, M McGreevy, J Humphries, and W Robinett. 1987. Virtual environment display system. Proceedings of the Workshop on Interactive 3-D Graphics 1 (01 1987), 77--87.

Digital Library

[30]

J. Randall Flanagan and Roland S. Johansson. 2001. Hand Movements.

[31]

Milton Friedman. 1940. A comparison of alternative tests of significance for the problem of m rankings. The Annals of Mathematical Statistics 11, 1 (1940), 86--92.

[32]

Julia Fröhlich and Ipke Wachsmuth. 2013. The Visual, the Auditory and the Haptic- A User Study on Combining Modalities in Virtual Worlds, Vol. 8021. 159--168.

[33]

Daniel Harley, Alexander Verni, Mackenzie Willis, Ashley Ng, Lucas Bozzo, and Ali Mazalek. 2018. Sensory VR: Smelling, Touching, and Eating Virtual Reality. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). ACM, NY, NY, USA, 386--397.

Digital Library

[34]

Otmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, and Andrew Wilson. 2012. HoloDesk: direct 3d interactions with a situated see-through display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2421--2430.

Digital Library

[35]

Daniel Holz, Sebastian Ullrich, Marc Wolter, and Torsten Kuhlen. 2008. Multi-Contact Grasp Interaction for Virtual Environments. JVRB - Journal of Virtual Reality and Broadcasting 5(2008), 7 (2008).

[36]

Sarah Hudson, Sheila Matson-Barkat, Nico Pallamin, and Guillaume Jegou. 2018. With or without you? Interaction and immersion in a virtual reality experience. Journal of Business Research (2018).

[37]

Jacek Jankowski and Martin Hachet. 2015. Advances in interaction with 3D environments. In Computer Graphics Forum, Vol. 34. Wiley Online Library, 152--190.

[38]

Yukun Jia and Abraham G. Campbell. 2017. Immersive Virtual Reality Training Tool for IoT Device Placement. In Proceedings of the 10th EAI International Conference on Simulation Tools and Techniques (SIMUTOOLS '17). 81--86.

Digital Library

[39]

Noriko Kamakura, Michiko Matsuo, Harumi Ishii, Fumiko Mitsuboshi, and Yoriko Miura. 1980. Patterns of Static Prehension in Normal Hands. 34 (08 1980), 437--45.

[40]

Konstantina Kilteni, Raphaela Groten, and Mel Slater. 2012. The Sense of Embodiment in Virtual Reality. Presence Teleoperators amp Virtual Environments 21 (11 2012).

Digital Library

[41]

David Kim, Otmar Hilliges, Shahram Izadi, Alex D. Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: Freehand 3D Interactions Anywhere Using a Wrist-worn Gloveless Sensor. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, NY, NY, USA, 167--176.

Digital Library

[42]

Pascal Knierim, Valentin Schwind, Anna Maria Feit, Florian Nieuwenhuizen, and Niels Henze. 2018. Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article 345, 9 pages.

Digital Library

[43]

Przemyslaw Krompiec and Kyoungju Park. 2019. Enhanced Player Interaction Using Motion Controllers for First-Person Shooting Games in Virtual Reality. IEEE Access 7 (2019), 124548--124557.

[44]

Piyush Kumar, Jyoti Verma, and Shitala Prasad. 2012. Hand data glove: A wearable real-time device for human-computer interaction. 43 (01 2012), 15--26.

[45]

Glyn Lawson, Davide Salanitri, and Brian Waterfield. 2016. Future directions for the development of virtual reality within an automotive manufacturer. Applied Ergonomics 53 (2016), 323 -- 330. Transport in the 21st Century: The Application of Human Factors to Future User Needs.

[46]

Susan J Lederman and Roberta L Klatzky. 1987. Hand movements: A window into haptic object recognition. Cognitive Psychology 19, 3 (1987), 342 -- 368.

[47]

Jaeyeon Lee, Michael Sinclair, Mar Gonzalez-Franco, Eyal Ofek, and Christian Holz. 2019. TORC: A Virtual Reality Controller for In-Hand High-Dexterity Finger Interaction. 1--13.

Digital Library

[48]

Lorraine Lin and Sophie Jörg. 2016. Need a Hand?: How Appearance Affects the Virtual Hand Illusion. In Proceedings of the ACM Symposium on Applied Perception (SAP '16). 69--76.

Digital Library

[49]

Sikun Lin, Hao Fei Cheng, Weikai Li, Zhanpeng Huang, Pan Hui, and Christoph Peylo. 2017. Ubii: Physical World Interaction Through Augmented Reality. IEEE Transactions on Mobile Computing 16, 3 (2017), 872--885.

Digital Library

[50]

Axel Loewe, Emanuel Poremba, Tobias G. Oesterlein, Nicolas Pilia, Micha Pfeiffer, Olaf Doessel, and Stefanie Speidel. 2017. An interactive virtual reality environment for analysis of clinical atrial arrhythmias and ablation planning. In 2017 Computing in Cardiology (CinC). 1--4.

[51]

Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls; Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 1471--1482.

Digital Library

[52]

Jean-Luc Lugrin, Johanna Latt, and Marc Latoschik. 2015. Avatar Anthropomorphism and Illusion of Body Ownership in VR.

[53]

Damian Lyons. 1985. A simple set of grasps for a dextrous hand. In Robotics and Automation. Proceedings. 1985 IEEE International Conference, Vol. 2. 588 -- 593.

[54]

Eliane Magdalon, Stella Michaelsen, Antonio Quevedo, and Mindy Levin. 2011. Comparison of grasping movements made by healthy subjects in a 3-dimensional immersive virtual versus physical environment. Acta psychologica 138 (06 2011), 126--34.

[55]

M. Nabiyouni, A. Saktheeswaran, D. A. Bowman, and A. Karanth. 2015. Comparing the performance of natural, semi-natural, and non-natural locomotion techniques in virtual reality. In 2015 IEEE Symposium on 3D User Interfaces (3DUI). 3--10.

[56]

Tao Ni, Doug A Bowman, Chris North, and Ryan P McMahan. 2011. Design and evaluation of freehand menu selection interfaces using tilt and pinch gestures. International Journal of Human-Computer Studies 69, 9 (2011), 551--562.

Digital Library

[57]

Austin Nichols and Jon Maner. 2008. The Good-Subject Effect: Investigating Participant Demand Characteristics. The Journal of General Psychology 135 (05 2008), 151--65.

[58]

Ryuma Niiyama, Lining Yao, and Hiroshi Ishii. 2013. Weight and Volume Changing Device with Liquid Metal Transfer. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). 49--52.

Digital Library

[59]

Kristine Nowak and Frank Biocca. 2003. The Effect of the Agency and Anthropomorphism on Users' Sense of Telepresence, Copresence, and Social Presence in Virtual Environments. Presence Teleoperators amp Virtual Environments 12 (10 2003), 481--494.

Digital Library

[60]

Alex Peer and Kevin Ponto. 2017. Evaluating perceived distance measures in room-scale spaces using consumer-grade head mounted displays. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 83--86.

[61]

Roshan Lalitha Peiris, Yuan-Ling Feng, Liwei Chan, and Kouta Minamizawa. 2019. ThermalBracelet: Exploring Thermal Haptic Feedback Around the Wrist. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 170, 11 pages.

Digital Library

[62]

Roshan Lalintha Peiris, Wei Peng, Zikun Chen, Liwei Chan, and Kouta Minamizawa. 2017. ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 5452--5456.

Digital Library

[63]

Chao Peng, Jeffrey T. Hansberger, Lizhou Cao, and Vaidyanath A. Shanthakumar. 2017. Hand gesture controls for image categorization in immersive virtual environments. In 2017 IEEE Virtual Reality (VR). 331--332.

[64]

Thies Pfeiffer. 2012. Using virtual reality technology in linguistic research. In 2012 IEEE Virtual Reality Workshops (VRW). 83--84.

Digital Library

[65]

Jayesh S. Pillai, Azif Ismail, and Herold P. Charles. 2017. Grammar of VR Storytelling: Visual Cues. In Proceedings of the Virtual Reality International Conference - Laval Virtual 2017 (VRIC '17). Article 7, 4 pages.

Digital Library

[66]

Thammathip Piumsomboon, Adrian Clark, Mark Billinghurst, and Andy Cockburn. 2013. User-defined gestures for augmented reality. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. 955--960.

Digital Library

[67]

Mores Prachyabrued and Christoph W Borst. 2016. Design and evaluation of visual interpenetration cues in virtual grasping. IEEE Transactions on Visualization and Computer Graphics 22, 6 (2016), 1718--1731.

Digital Library

[68]

Angie Hill Price, Mathew Kuttolamadom, and Suleiman Obeidat. 2019. Using Virtual Reality Welding to Improve Manufacturing Process Education. (2019).

[69]

Steffen Puhlmann, Fabian Heinemann, Oliver Brock, and Marianne Maertens. 2016. A compact representation of human single-object grasping. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 1954--1959.

Digital Library

[70]

Andreas Pusch, Olivier Martin, and Sabine Coquillart. 2008. HEMP-Hand-Displacement-Based Pseudo-Haptics: A Study of a Force Field Application. 2008 IEEE Symposium on 3D User Interfaces (2008), 59--66.

Digital Library

[71]

Andreas Pusch, Olivier Martin, and Sabine Coquillart. 2009. HEMP-hand displacement-based pseudo-haptics: A study of a force field application and a behavioural analysis. International Journal of Human-Computer Studies 67, 3 (2009), 256 -- 268. Current trends in 3D user interface research.

Digital Library

[72]

Brittany Redmond, Rachel Aina, Tejaswi Gorti, and Blake Hannaford. 2010. Haptic Characteristics of Some Activities of Daily Living. In Proceedings of the 2010 IEEE Haptics Symposium (HAPTIC '10). IEEE Computer Society, 71--76.

Digital Library

[73]

Gang Ren and Eamonn O'Neill. 2013. 3D selection with freehand gesture. Computers & Graphics 37, 3 (2013), 101--120.

Digital Library

[74]

Michael Rietzler, Florian Geiselhart, Jan Gugenheimer, and Enrico Rukzio. 2018. Breaking the Tracking: Enabling Weight Perception Using Perceivable Tracking Offsets. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article 128, 12 pages.

Digital Library

[75]

Katja Rogers, Jana Funke, Julian Frommel, Sven Stamm, and Michael Weber. 2019. Exploring Interaction Fidelity in Virtual Reality: Object Manipulation and Whole-Body Movements. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 414, 14 pages.

Digital Library

[76]

Javier Romero, Hedvig Kjellström, Carl Henrik Ek, and Danica Kragiç. 2013. Non-parametric hand pose estimation with object context. Image and Vision Computing 31, 8 (2013), 555 -- 564. http://www.sciencedirect.com/science/article/pii/S0262885613000656

Digital Library

[77]

Pedro Rosas, Felix Wichmann, and Johan Wagemans. 2007. Texture and object motion in slant discrimination: Failure of reliability-based weighting of cues may be evidence for strong fusion. Journal of vision 7 (04 2007), 3.

[78]

Beatriz Sousa Santos, João Cardoso, Beatriz Quintino Ferreira, Carlos Ferreira, and Paulo Dias. 2016. Developing 3D Freehand Gesture-Based Interaction Methods for Virtual Walkthroughs: Using an Iterative Approach. In Handbook of Research on Human-Computer Interfaces, Developments, and Applications. IGI Global, 52--72.

[79]

Luisa Sartori, Elisa Straulino, and Umberto Castiello. 2011. How Objects Are Grasped: The Interplay between Affordances and End-Goals. PLOS ONE 6, 9 (09 2011), 1--10.

[80]

Peter Schulz, Dmitry Alexandrovsky, Felix Putze, Rainer Malaka, and Johannes Schöning. 2019. The Role of Physical Props in VR Climbing Environments.

Digital Library

[81]

Valentin Schwind, Pascal Knierim, Nico Haas, and Niels Henze. 2019. Using Presence Questionnaires in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 360, 12 pages.

Digital Library

[82]

Valentin Schwind, Pascal Knierim, Cagri Tasci, Patrick Franczak, Nico Haas, and Niels Henze. 2017. "These Are Not My Hands!": Effect of Gender on the Perception of Avatar Hands in Virtual Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 1577--1582.

Digital Library

[83]

Valentin Schwind, Sven Mayer, Alexandre Comeau-Vermeersch, Robin Schweigert, and Niels Henze. 2018. Up to the Finger Tip: The Effect of Avatars on Mid-Air Pointing Accuracy in Virtual Reality. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '18). ACM, NY, NY, USA, 477--488.

Digital Library

[84]

Andrea Serino, Adrian Alsmith, Marcello Costantini, Alisa Mandrigin, Ana Tajadura-Jimenez, and Christophe Lopez. 2013. Bodily ownership and self-location: Components of bodily self-consciousness. Consciousness and Cognition 22, 4 (2013), 1239 -- 1252.

[85]

Samuel S. Shapiro and Martin B. Wilk. 1965. An analysis of variance test for normality (complete samples). Biometrika 52, 3/4 (1965), 591--611.

[86]

David Somers and R. McNally. 2010. Kinesthetic visual capture induced by apparent motion. Journal of Vision J VISION 3 (10 2010), 35--35.

[87]

Sota Suzuki, Haruto Suzuki, and Mie Sato. 2014. Grasping a Virtual Object with a Bare Hand. In ACM SIGGRAPH 2014 Posters (SIGGRAPH '14). ACM, NY, NY, USA, Article 51, 1 pages.

Digital Library

[88]

Anthony Talvas, Maud Marchal, Christian Duriez, and Miguel A Otaduy. 2015. Aggregate constraints for virtual manipulation with soft fingers. IEEE transactions on visualization and computer graphics 21, 4 (2015), 452--461.

Digital Library

[89]

Jordan Tewell, Jon Bird, and George R. Buchanan. 2017a. The Heat is On: A Temperature Display for Conveying Affective Feedback. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 1756--1767.

Digital Library

[90]

Jordan Tewell, Jon Bird, and George R. Buchanan. 2017b. Heat-Nav: Using Temperature Changes As Navigation Cues. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 1131--1135.

Digital Library

[91]

Aurelijus Vaitkeviius, Mantas Taroza, Tomas Blaauskas, Robertas Damaeviius, Rytis Maskeli?nas, and Marcin Wozniak. 2019. Recognition of American Sign Language Gestures in a Virtual Reality Using Leap Motion. Applied Sciences 9, 3 (2019).

[92]

Antonin Viau, Anatol Feldman, Bradford McFadyen, and Mindy Levin. 2005. Reaching in reality and virtual reality: A comparison of movement kinematics in healthy subjects and in adults with hemiparesis. Journal of neuroengineering and rehabilitation 1 (01 2005), 11.

[93]

Toinon Vigier, Guillaume Moreau, and Daniel Siret. 2015. From visual cues to climate perception in virtual urban environments. In 2015 IEEE Virtual Reality (VR). 305--306.

[94]

Daniel Vogel and Ravin Balakrishnan. 2005. Distant Freehand Pointing and Clicking on Very Large, High Resolution Displays. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05). 33--42.

Digital Library

[95]

Emanuel Vonach, Clemens Gatterer, and Hannes Kaufmann. 2017. VRRobot: Robot actuated props in an infinite virtual environment. In 2017 IEEE Virtual Reality (VR). 74--83.

[96]

Supachai Vorapojpisut, Kevin Hillairet, Artit Boriboonsak, and Phongsit Misa. 2016. A Myo Armband-based Measurement Platform for Hand Rehabilitation Applications. In Proceedings of the International Convention on Rehabilitation Engineering & Assistive Technology (i-CREATe 2016). Article 19, 4 pages. http://dl.acm.org.ezproxy.bcu.ac.uk/citation.cfm?id=3014393.3014417

Digital Library

[97]

Juan Pablo Wachs, Mathias Kölsch, Helman Stern, and Yael Edan. 2011. Vision-based hand-gesture applications. Commun. ACM 54, 2 (2011), 60--71.

Digital Library

[98]

Robert Whitwell, Tzvi Ganel, Caitlin Byrne, and Melvyn Goodale. 2015. Real-time vision, tactile cues, and visual form agnosia in pantomimed grasping: Removing haptic feedback induces a switch from natural to pantomime like grasps. Front. Hum. Neurosci. 9 (01 2015).

[99]

Raphael Wimmer. 2011. Grasp Sensing for Human-computer Interaction. In Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '11). ACM, NY, NY, USA, 221--228.

Digital Library

[100]

Bob G. Witmer and Michael J. Singer. 1998. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence 7, 3 (June 1998), 225--240.

Digital Library

[101]

Jacob O Wobbrock, Meredith Ringel Morris, and Andrew D Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1083--1092.

Digital Library

[102]

Seahwa Won and Stephen Westland. 2017. Colour meaning and context. Color Research & Application 42, 4 (2017), 450--459.

[103]

Yuan Yao, Po-Tsung Chiu, and Wai-Tat Fu. 2017. A Gestural Interface for Practicing Children's Spatial Skills. In Proceedings of the 22Nd International Conference on Intelligent User Interfaces Companion (IUI '17 Companion). ACM, 43--47.

Digital Library

[104]

Dianna Yim, Garance Nicole Loison, Fatemeh Hendijani Fard, Edwin Chan, Alec McAllister, and Frank Maurer. 2016. Gesture-driven Interactions on a Virtual Hologram in Mixed Reality. In Proceedings of the 2016 ACM Companion on Interactive Surfaces and Spaces (ISS Companion '16). ACM, 55--61.

Digital Library

[105]

André Zenner and Antonio Krüger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (April 2017), 1285--1294.

Digital Library

[106]

Yingwei Zhang, Yiqiang Chen, Hanchao Yu, Xiaodong Yang, Wang Lu, and Hong Liu. 2018. Wearing-independent Hand Gesture Recognition Method Based on EMG Armband. Personal Ubiquitous Comput. 22, 3 (June 2018), 511--524.

Digital Library

[107]

Yun Zhou, Shangpeng Ji, Tao Xu, and Zi Wang. 2018. Promoting Knowledge Construction: A Model for Using Virtual Reality Interaction to Enhance Learning. Procedia Computer Science 130 (2018), 239 -- 246.

Digital Library

[108]

Mounia Ziat, Taylor Rolison, Andrew Shirtz, Daniel Wilbern, and Carrie Anne Balcer. 2014. Enhancing virtual immersion through tactile feedback. In Proceedings of the adjunct publication of the 27th annual ACM symposium on User interface software and technology. 65--66.

Digital Library

Cited By

Frata Furlan Peres FNunes FTeixeira JMaurício CConceição KYoshida L(2024)Methods for Evaluating Immersive 3D Virtual Environments: a Systematic Literature ReviewProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691595(140-151)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691595
Villa SWeiss YHirsch NWiethoff A(2024)An Examination of Ultrasound Mid-air Haptics for Enhanced Material and Temperature Perception in Virtual EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/36764888:MHCI(1-21)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676488
Normand EPacchierotti CMarchand EMarchal M(2024)How Different Is the Perception of Vibrotactile Texture Roughness in Augmented versus Virtual Reality?Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687738(1-10)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687738
Show More Cited By

Index Terms

Too Hot to Handle: An Evaluation of the Effect of Thermal Visual Representation on User Grasping Interaction in Virtual Reality
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Influence of hand representation on a grasping task in augmented reality
ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction

Research has shown that modifying the aspect of the virtual hand in immersive virtual reality can convey objects properties to users. Whether we can achieve the same results in augmented reality is still to be determined since the user’s real hand is ...
Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head-Mounted Displays
SUI '21: Proceedings of the 2021 ACM Symposium on Spatial User Interaction

An increasing number of consumer-oriented head-mounted displays (HMD) for augmented and virtual reality (AR/VR) are capable of finger and hand tracking. We report on the accuracy of off-the-shelf VR and AR HMDs when used for touch-based tasks such as ...
The Importance of Virtual Hands and Feet for Virtual Reality Climbing
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Virtual reality (VR) climbing systems registering physical climbing walls with immersive virtual environments (IVEs) have been a focus of past research. Such systems can provide physical user experiences similar to climbing in (extreme) outdoor ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
858
Total Downloads

Downloads (Last 12 months)135
Downloads (Last 6 weeks)13

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Frata Furlan Peres FNunes FTeixeira JMaurício CConceição KYoshida L(2024)Methods for Evaluating Immersive 3D Virtual Environments: a Systematic Literature ReviewProceedings of the 26th Symposium on Virtual and Augmented Reality10.1145/3691573.3691595(140-151)Online publication date: 30-Sep-2024
https://dl.acm.org/doi/10.1145/3691573.3691595
Villa SWeiss YHirsch NWiethoff A(2024)An Examination of Ultrasound Mid-air Haptics for Enhanced Material and Temperature Perception in Virtual EnvironmentsProceedings of the ACM on Human-Computer Interaction10.1145/36764888:MHCI(1-21)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676488
Normand EPacchierotti CMarchand EMarchal M(2024)How Different Is the Perception of Vibrotactile Texture Roughness in Augmented versus Virtual Reality?Proceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687738(1-10)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687738
Dufresne FDubosc CGorisse GChristmann O(2024)Understanding the Impact of Coherence between Virtual Representations and Possible Interactions on Embodiment in VR: an Affordance PerspectiveExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650752(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650752
Bhatia APohl HHirzle TSeifi HHornbæk K(2024)Using the Visual Language of Comics to Alter Sensations in Augmented RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642351(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642351
Pizzo MViola ESolari FChessa M(2024)Evaluation of 3D Reconstruction Techniques for the Blending of Real and Virtual Environments2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00071(360-367)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VRW62533.2024.00071
Fan PThanyadit SPong T(2024)VisTA-LIVE: A Visualization Tool for Assessment of Laboratories in Virtual EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.334107930:10(6813-6825)Online publication date: Oct-2024
https://doi.org/10.1109/TVCG.2023.3341079
Blaga AFrutos-Pascual MCreed CWilliams I(2024)VR-Grasp: A Human Grasp Taxonomy for Virtual RealityInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2351719(1-17)Online publication date: 26-May-2024
https://doi.org/10.1080/10447318.2024.2351719
Bouzbib EPacchierotti CLécuyer A(2023)When Tangibles Become Deformable: Studying Pseudo-Stiffness Perceptual Thresholds in a VR Grasping TaskIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324708329:5(2743-2752)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247083
Spittle BFrutos-Pascual MCreed CWilliams I(2023)A Review of Interaction Techniques for Immersive EnvironmentsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.317480529:9(3900-3921)Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3174805
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents