research-article

VRHapticDrones: Providing Haptics in Virtual Reality through Quadcopters

Authors:

Matthias Hoppe,

Pascal Knierim,

Stefan Schneegass,

Albrecht Schmidt,

Tonja MachullaAuthors Info & Claims

MUM '18: Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia

Pages 7 - 18

https://doi.org/10.1145/3282894.3282898

Published: 25 November 2018 Publication History

Abstract

We present VRHapticDrones, a system utilizing quadcopters as levitating haptic feedback proxy. A touchable surface is attached to the side of the quadcopters to provide unintrusive, flexible, and programmable haptic feedback in virtual reality. Since the users' sense of presence in virtual reality is a crucial factor for the overall user experience, our system simulates haptic feedback of virtual objects. Quadcopters are dynamically positioned to provide haptic feedback relative to the physical interaction space of the user. In a first user study, we demonstrate that haptic feedback provided by VRHapticDrones significantly increases users' sense of presence compared to vibrotactile controllers and interactions without additional haptic feedback. In a second user study, we explored the quality of induced feedback regarding the expected feeling of different objects. Results show that VRHapticDrones is best suited to simulate objects that are expected to feel either light-weight or have yielding surfaces. With VRHapticDrones we contribute a solution to provide unintrusive and flexible feedback as well as insights for future VR haptic feedback systems.

References

[1]

Muhammad Abdullah, Minji Kim, Waseem Hassan, Yoshihiro Kuroda, and Seokhee Jeon. 2017. HapticDrone: An Encountered-Type Kinesthetic Haptic Interface with Controllable Force Feedback: Initial Example for 1D Haptic Feedback. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 115--117.

Digital Library

[2]

Parastoo Abtahi, David Y. Zhao, L. E. Jane, and James A. Landay. 2017. Drone Near Me: Exploring Touch-Based Human-Drone Interaction. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 34 (Sept. 2017), 8 pages.

Digital Library

[3]

Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI'16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. ACM, 218--226.

Digital Library

[4]

Mauro Avila, Markus Funk, and Niels Henze. 2015. Dronenavigator: Using drones for navigating visually impaired persons. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. ACM, 327--328.

Digital Library

[5]

Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D Wilson. 2016. Haptic retargeting: Dynamic repurposing of passive haptics for enhanced virtual reality experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1968--1979.

Digital Library

[6]

Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 717--728.

Digital Library

[7]

Jonathan Blake and Hakan B Gurocak. 2009. Haptic glove with MR brakes for virtual reality. IEEE/ASME Transactions On Mechatronics 14, 5 (2009), 606--615.

[8]

Grigore C Burdea. 2000. Haptics issues in virtual environments. In Computer Graphics International, 2000. Proceedings. IEEE, 295--302.

Digital Library

[9]

Lung-Pan Cheng, Patrick Lühne, Pedro Lopes, Christoph Sterz, and Patrick Baudisch. 2014. Haptic turk: a motion platform based on people. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 3463--3472.

Digital Library

[10]

Lung-Pan Cheng, Thijs Roumen, Hannes Rantzsch, Sven Köhler, Patrick Schmidt, Robert Kovacs, Johannes Jasper, Jonas Kemper, and Patrick Baudisch. 2015. Turkdeck: Physical virtual reality based on people. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 417--426.

Digital Library

[11]

Ashley Colley, Lasse Virtanen, Pascal Knierim, and Jonna Häkkilä. 2017. Investigating Drone Motion As Pedestrian Guidance. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM '17). ACM, New York, NY, USA, 143--150.

Digital Library

[12]

Sean Follmer, Daniel Leithinger, Alex Olwal, Akimitsu Hogge, and Hiroshi Ishii. 2013. inFORM: dynamic physical affordances and constraints through shape and object actuation. In Uist, Vol. 13. 417--426.

Digital Library

[13]

Markus Funk. 2018. Human-drone Interaction: Let's Get Ready for Flying User Interfaces! Interactions 25, 3 (April 2018), 78--81.

Digital Library

[14]

Antonio Gomes, Calvin Rubens, Sean Braley, and Roel Vertegaal. 2016. Bitdrones: Towards using 3d nanocopter displays as interactive self-levitating programmable matter. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 770--780.

Digital Library

[15]

Xiaochi Gu, Yifei Zhang, Weize Sun, Yuanzhe Bian, Dao Zhou, and Per Ola Kristensson. 2016. Dexmo: An Inexpensive and Lightweight Mechanical Exoskeleton for Motion Capture and Force Feedback in VR. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1991--1995.

Digital Library

[16]

Jan Gugenheimer, Dennis Wolf, Eythor R Eiriksson, Pattie Maes, and Enrico Rukzio. 2016a. Gyrovr: Simulating inertia in virtual reality using head worn flywheels. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, 227--232.

Digital Library

[17]

Jan Gugenheimer, Dennis Wolf, Gabriel Haas, Sebastian Krebs, and Enrico Rukzio. 2016b. Swivrchair: A motorized swivel chair to nudge users' orientation for 360 degree storytelling in virtual reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1996--2000.

Digital Library

[18]

Zhenyi He, Fengyuan Zhu, Aaron Gaudette, and Ken Perlin. 2017. Robotic Haptic Proxies for Collaborative Virtual Reality. arXiv preprint arXiv:1701.08879 (2017).

[19]

Seongkook Heo, Christina Chung, Geehyuk Lee, and Daniel Wigdor. 2018. Thor's Hammer: An Ungrounded Force Feedback Device Utilizing Propeller-Induced Propulsive Force. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 525, 11 pages.

Digital Library

[20]

Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing reality: Enabling opportunistic use of everyday objects as tangible proxies in augmented reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1957--1967.

Digital Library

[21]

Seungzoo Jeong, Naoki Hashimoto, and Sato Makoto. 2004. A Novel Interaction System with Force Feedback Between Real - and Virtual Human: An Entertainment System: "Virtual Catch Ball". In Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE '04). ACM, New York, NY, USA, 61--66.

Digital Library

[22]

Pascal Knierim, Thomas Kosch, Alexander Achberger, and Markus Funk. 2018. Flyables: Exploring 3D Interaction Spaces for Levitating Tangibles. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '18). ACM, New York, NY, USA, 8.

Digital Library

[23]

Pascal Knierim, Thomas Kosch, Valentin Schwind, Markus Funk, Francisco Kiss, Stefan Schneegass, and Niels Henze. 2017. Tactile Drones-Providing Immersive Tactile Feedback in Virtual Reality through Quadcopters. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 433--436.

Digital Library

[24]

Pascal Knierim, Steffen Maurer, Katrin Wolf, and Markus Funk. 2018. Quadcopter-Projected In-Situ Navigation Cues for Improved Location Awareness. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 433, 6 pages.

Digital Library

[25]

Thomas Kosch, Markus Funk, Daniel Vietz, Marc Weise, Tamara Müller, and Albrecht Schmidt. 2018. DroneCTRL: A Tangible Remote Input Control for Quadcopters. Proceedings of the 31th Annual ACM Symposium on User Interface Software and Technology (2018).

Digital Library

[26]

Robert W Lindeman, Yasuyuki Yanagida, Haruo Noma, and Kenichi Hosaka. 2006. Wearable vibrotactile systems for virtual contact and information display. Virtual Reality 9, 2-3 (2006), 203--213.

Digital Library

[27]

Pedro Lopes, Alexandra Ion, and Patrick Baudisch. 2015. Impacto: Simulating physical impact by combining tactile stimulation with electrical muscle stimulation. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 11--19.

Digital Library

[28]

Pedro Lopes, Sijing You, Lung-Pan Cheng, Sebastian Marwecki, and Patrick Baudisch. 2017. Providing Haptics to Walls & Heavy Objects in Virtual Reality by Means of Electrical Muscle Stimulation. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1471--1482.

Digital Library

[29]

Kazuki Nagai, Soma Tanoue, Katsuhito Akahane, and Makoto Sato. 2015. Wearable 6-DoF wrist haptic device SPIDAR-W. In SIGGRAPH Asia 2015 Haptic Media And Contents Design. ACM, 19.

Digital Library

[30]

Jürgen Scheible, Markus Funk, Klen Copic Pucihar, Matjaz Kljun, Mark Lochrie, Paul Egglestone, and Peter Skrlj. 2017. Using Drones for Art and Exergaming. IEEE Pervasive Computing 16, 1 (2017), 48--56.

Digital Library

[31]

Dominik Schmidt, Rob Kovacs, Vikram Mehta, Udayan Umapathi, Sven Köhler, Lung-Pan Cheng, and Patrick Baudisch. 2015. Level-ups: Motorized stilts that simulate stair steps in virtual reality. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2157--2160.

Digital Library

[32]

Valentin Schwind, Pascal Knierim, Cagri Tasci, Patrick Franczak, Nico Haas, and Niels Henze. 2017. "These are not my hands!": Effect of Gender on the Perception of Avatar Hands in Virtual Reality. In CHI '17 Proceedings of the 2017 Annual Symposium on Computer-Human Interaction (2017-01-01). ACM Press, New York, NY, USA. Honorable Mention Award.

Digital Library

[33]

Beat Signer and Timothy J Curtin. 2017. Tangible Holograms: Towards Mobile Physical Augmentation of Virtual Objects. arXiv preprint arXiv:1703.08288 (2017).

[34]

Adalberto L Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional reality: Using the physical environment to design virtual reality experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 3307--3316.

Digital Library

[35]

Qi Sun, Li-Yi Wei, and Arie Kaufman. 2016. Mapping Virtual and Physical Reality. ACM Trans. Graph. 35, 4, Article 64 (July 2016), 12 pages.

Digital Library

[36]

Koji Tsukada and Michiaki Yasumura. 2004. Activebelt: Belt-type wearable tactile display for directional navigation. In International Conference on Ubiquitous Computing. Springer, 384--399.

[37]

Bob G. Witmer and Michael J. Singer. 1998. Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoper. Virtual Environ. 7, 3 (June 1998), 225--240.

Digital Library

[38]

Katrin Wolf and Timm Bäder. 2015. Illusion of surface changes induced by tactile and visual touch feedback. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1355--1360.

Digital Library

[39]

Kotaro Yamaguchi, Ginga Kato, Yoshihiro Kuroda, Kiyoshi Kiyokawa, and Haruo Takemura. 2016. A Non-grounded and Encountered-type Haptic Display Using a Drone. In Proceedings of the 2016 Symposium on Spatial User Interaction. ACM, 43--46.

Digital Library

Cited By

Clarence AKnibbe JCordeil MWybrow M(2024)Stacked Retargeting: Combining Redirected Walking and Hand Redirection to Expand Haptic Retargeting's CoverageProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642228(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642228
Gomi RSuzuki RTakashima KFujita KKitamura Y(2024)InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642069(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642069
Seo MKang KKang H(2024)VR Blowing: A Physically Plausible Interaction Method for Blowing Air in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323847830:7(3680-3692)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3238478
Show More Cited By

Index Terms

VRHapticDrones: Providing Haptics in Virtual Reality through Quadcopters
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction paradigms
      1. Virtual reality

Recommendations

Evaluation of different types of haptic feedback influencing the task-based presence and performance in virtual reality
PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Haptic feedback may support immersion and presence in virtual reality (VR) environments. The emerging market of consumer devices offers first devices which are expected to increase the degree of feeling being actually present in a virtual environment. ...
Wearable head-mounted 3D tactile display application scenarios
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Current generation virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs) usually include no or only a single vibration motor for haptic feedback and do not use it for guidance. In a previous work, we presented HapticHead, a ...
Using a preamble to increase presence in digital virtual environments

Immersion in a digital virtual environment (DVE) increases the likelihood that individuals will feel present in the DVE and hence respond as they would in a similar physically grounded environment. Previous research utilizing high-fidelity technology ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '18: Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia

November 2018

548 pages

ISBN:9781450365949

DOI:10.1145/3282894

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 November 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

German Federal Ministry of Education and Research
European Research Council (ERC)

Conference

MUM 2018

MUM 2018: 17th International Conference on Mobile and Ubiquitous Multimedia

November 25 - 28, 2018

Cairo, Egypt

Acceptance Rates

MUM '18 Paper Acceptance Rate 37 of 82 submissions, 45%;

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

73
Total Citations
View Citations
1,629
Total Downloads

Downloads (Last 12 months)219
Downloads (Last 6 weeks)23

Reflects downloads up to 15 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Clarence AKnibbe JCordeil MWybrow M(2024)Stacked Retargeting: Combining Redirected Walking and Hand Redirection to Expand Haptic Retargeting's CoverageProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642228(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642228
Gomi RSuzuki RTakashima KFujita KKitamura Y(2024)InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VRProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642069(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642069
Seo MKang KKang H(2024)VR Blowing: A Physically Plausible Interaction Method for Blowing Air in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323847830:7(3680-3692)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3238478
Chen YAlimohammadzadeh HGhandeharizadeh SCulbertson H(2024)Force-Feedback Through Touch-based Interactions With A Nanocopter2024 IEEE Haptics Symposium (HAPTICS)10.1109/HAPTICS59260.2024.10520851(271-277)Online publication date: 7-Apr-2024
https://doi.org/10.1109/HAPTICS59260.2024.10520851
Li YMuschalla B(2024)Virtual Reality Mental Health Interventions in Geriatric Care for Functional or Well-being Enhancement – A Scoping ReviewDie Rehabilitation10.1055/a-2316-654163:04(209-219)Online publication date: 17-Jun-2024
https://doi.org/10.1055/a-2316-6541
Liu Y(2023)Analysis of Interaction Methods in VR Virtual RealityHighlights in Science, Engineering and Technology10.54097/hset.v39i.655939(395-407)Online publication date: 1-Apr-2023
https://doi.org/10.54097/hset.v39i.6559
Dongye XWeng DJiang HFeng L(2023)A Modular Haptic Agent System with Encountered-Type Active InteractionElectronics10.3390/electronics1209206912:9(2069)Online publication date: 30-Apr-2023
https://doi.org/10.3390/electronics12092069
Wilson-Small NGoedicke DPetersen KAzenkot SCastellano GRiek LCakmak MLeite I(2023)A Drone TeacherProceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3568162.3576985(311-320)Online publication date: 13-Mar-2023
https://dl.acm.org/doi/10.1145/3568162.3576985
Harley DMacArthur C(2023)Sharing Play Spaces: Design Lessons from Reddit Posts Showing Virtual Reality in the HomeProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596005(509-522)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596005
Lin TYang WNakagaki K(2023)ThrowIO: Actuated TUIs that Facilitate “Throwing and Catching” Spatial Interaction with Overhanging Mobile Wheeled RobotsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581267(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581267
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents