Redirected Placement: Evaluating the Redirection of Passive Props during Reach-to-Place in Virtual Reality
Authors: 
Xuanhui Yang, Yan Zhang, Xubo YangAuthors Info & Claims
Xuanhui Yang, Yan Zhang, Xubo YangAuthors Info & ClaimsArticle No.: 36, Pages 1 - 11
Abstract
Hand redirection is an effective technique that can provide users with haptic feedback in virtual reality (VR) when a disparity exists between virtual objects and their physical counterparts. Psychophysiological research has revealed the distinct motion profiles of different kinematic phases when people operate hand-object interaction. In this paper, we proposed the Redirected Placement (RP), which determines the new placement of a physical prop using a constrained optimization problem. The visual illusion is used during the "reach-to-place" kinematic phase in the proposed RP method rather than the "reach-to-grasp" phase in the typical Redirected Reach (RR) method. We conducted two experiments based on the proposed RP method. Our first experiment showed that detection thresholds are generally higher with the proposed method compared to the RR method. The second experiment evaluated the embodiment experience with hand redirection using RR-only, RP-only, and RR&RP methods. The results report an enhanced sense of embodiment with the combined use of both RR and RP techniques. Our study further indicates that a 1:1 combination ratio of RR&RP resulted in the closest subjective experience to the baseline.
References
[1]
Mahdi Azmandian, Mark Hancock, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2016. Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 1968–1979. https://doi.org/10.1145/2858036.2858226
[2]
Brett Benda, Shaghayegh Esmaeili, and Eric D. Ragan. 2020. Determining Detection Thresholds for Fixed Positional Offsets for Virtual Hand Remapping in Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 269–278. https://doi.org/10.1109/ISMAR50242.2020.00050
[3]
Joanna Bergström, Aske Mottelson, and Jarrod Knibbe. 2019. Resized Grasping in VR: Estimating Thresholds for Object Discrimination. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 1175–1183. https://doi.org/10.1145/3332165.3347939
[4]
Eric Burns, Sharif Razzaque, Abigail T. Panter, Mary C. Whitton, Matthew R. McCallus, and Frederick P. Brooks. 2006. The Hand Is More Easily Fooled than the Eye: Users Are More Sensitive to Visual Interpenetration than to Visual-Proprioceptive Discrepancy. Presence 15, 1 (2006), 1–15. https://doi.org/10.1162/pres.2006.15.1.1
[5]
Lung-Pan Cheng, Eyal Ofek, Christian Holz, Hrvoje Benko, and Andrew D. Wilson. 2017. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3718–3728. https://doi.org/10.1145/3025453.3025753
[6]
Michel Desmurget, Denis Pélisson, Yves Rossetti, and Claude Prablanc. 1998. From eye to hand: planning goal-directed movements. Neuroscience & Biobehavioral Reviews 22, 6 (1998), 761–788.
[7]
Shaghayegh Esmaeili, Brett Benda, and Eric D. Ragan. 2020. Detection of Scaled Hand Interactions in Virtual Reality: The Effects of Motion Direction and Task Complexity. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 453–462. https://doi.org/10.1109/VR46266.2020.00066
[8]
Cathy Mengying Fang. 2021. Retargeted Self-Haptics for Increased Immersion in VR without Instrumentation. In Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology. 1109–1121. https://doi.org/10.1145/3472749.3474810
[9]
Martin Feick, Kora P. Regitz, Anthony Tang, Tobias Jungbluth, Maurice Rekrut, and Antonio Krüger. 2023. Investigating Noticeable Hand Redirection in Virtual Reality using Physiological and Interaction Data. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). 194–204. https://doi.org/10.1109/VR55154.2023.00035
[10]
J Randall Flanagan, Miles C Bowman, and Roland S Johansson. 2006. Control strategies in object manipulation tasks. Current Opinion in Neurobiology 16, 6 (Dec. 2006), 650–659. https://doi.org/10.1016/j.conb.2006.10.005
[11]
Henrique Galvan Debarba, Ronan Boulic, Roy Salomon, Olaf Blanke, and Bruno Herbelin. 2018. Self-attribution of distorted reaching movements in immersive virtual reality. Computers & Graphics 76 (Nov. 2018), 142–152. https://doi.org/10.1016/j.cag.2018.09.001
[12]
Benoit Geslain, Simon Besga, Flavien Lebrun, and Gilles Bailly. 2022. Generalizing the Hand Redirection Function in Virtual Reality. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces(AVI 2022). 1–9. https://doi.org/10.1145/3531073.3531100
[13]
J. J. Gibson. 1933. Adaptation, after-effect and contrast in the perception of curved lines.Journal of Experimental Psychology 16, 1 (1933), 1–31. https://doi.org/10.1037/h0074626
[14]
Eric J. Gonzalez, Parastoo Abtahi, and Sean Follmer. 2020. REACH+: Extending the Reachability of Encountered-type Haptics Devices through Dynamic Redirection in VR. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 236–248. https://doi.org/10.1145/3379337.3415870
[15]
Eric J. Gonzalez and Sean Follmer. 2019. Investigating the Detection of Bimanual Haptic Retargeting in Virtual Reality. In 25th ACM Symposium on Virtual Reality Software and Technology. 1–5. https://doi.org/10.1145/3359996.3364248
[16]
Mar Gonzalez-Franco and Jaron Lanier. 2017. Model of Illusions and Virtual Reality. Frontiers in Psychology 8 (2017). https://www.frontiersin.org/articles/10.3389/fpsyg.2017.01125
[17]
Mar Gonzalez-Franco and Tabitha C. Peck. 2018. Avatar Embodiment. Towards a Standardized Questionnaire. Frontiers in Robotics and AI 5 (2018). https://www.frontiersin.org/articles/10.3389/frobt.2018.00074
[18]
Dustin T. Han, Mohamed Suhail, and Eric D. Ragan. 2018. Evaluating Remapped Physical Reach for Hand Interactions with Passive Haptics in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 24, 4 (April 2018), 1467–1476. https://doi.org/10.1109/TVCG.2018.2794659
[19]
Judith Hartfill, Jenny Gabel, Lucie Kruse, Susanne Schmidt, Kevin Riebandt, Simone Kühn, and Frank Steinicke. 2021. Analysis of Detection Thresholds for Hand Redirection during Mid-Air Interactions in Virtual Reality. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology. 1–10. https://doi.org/10.1145/3489849.3489866
[20]
Flavien Lebrun, Sinan Haliyo, and Gilles Bailly. 2021. A Trajectory Model for Desktop-Scale Hand Redirection in Virtual Reality. In Human-Computer-Interaction – INTERACT 2021(Lecture Notes in Computer Science), Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, and Kori Inkpen (Eds.). 105–124. https://doi.org/10.1007/978-3-030-85607-6_8
[21]
Lei Liu, Robert van Liere, Catharina Nieuwenhuizen, and Jean-Bernard Martens. 2009. Comparing Aimed Movements in the Real World and in Virtual Reality. In 2009 IEEE Virtual Reality Conference. 219–222. https://doi.org/10.1109/VR.2009.4811026 ISSN: 2375-5334.
[22]
Andreas L. Lohse, Christoffer K. Kjær, Ervin Hamulic, Ingrid G. A. Lima, Tilde H. Jensen, Luis E. Bruni, and Niels C. Nilsson. 2019. Leveraging Change Blindness for Haptic Remapping in Virtual Environments. In 2019 IEEE 5th Workshop on Everyday Virtual Reality (WEVR). 1–5. https://doi.org/10.1109/WEVR.2019.8809587
[23]
Jaime Maldonado and Christoph Zetzsche. 2021. Object Manipulations in VR Show Task- and Object-Dependent Modulation of Motor Patterns. In Proceedings of the 27th ACM Symposium on Virtual Reality Software and Technology(VRST ’21). Association for Computing Machinery, New York, NY, USA, 1–9. https://doi.org/10.1145/3489849.3489858
[24]
Brandon J. Matthews, Bruce H. Thomas, G. Stewart Von Itzstein, and Ross T. Smith. 2022. Shape Aware Haptic Retargeting for Accurate Hand Interactions. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 625–634. https://doi.org/10.1109/VR51125.2022.00083 ISSN: 2642-5254.
[25]
Brandon J. Matthews, Bruce H. Thomas, Stewart Von Itzstein, and Ross T. Smith. 2019. Remapped Physical-Virtual Interfaces with Bimanual Haptic Retargeting. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 19–27. https://doi.org/10.1109/VR.2019.8797974
[26]
Niels Christian Nilsson, André Zenner, and Adalberto L. Simeone. 2021. Propping Up Virtual Reality With Haptic Proxies. IEEE Computer Graphics and Applications 41, 5 (Sept. 2021), 104–112. https://doi.org/10.1109/MCG.2021.3097671
[27]
Nami Ogawa, Takuji Narumi, and Michitaka Hirose. 2021. Effect of Avatar Appearance on Detection Thresholds for Remapped Hand Movements. IEEE Transactions on Visualization and Computer Graphics 27, 7 (July 2021), 3182–3197. https://doi.org/10.1109/TVCG.2020.2964758
[28]
Shahina Pardhan, Amy Scarfe, Rupert Bourne, and Matthew Timmis. 2017. A Comparison of Reach-to-Grasp and Transport-to-Place Performance in Participants With Age-Related Macular Degeneration and Glaucoma. Invest. Ophthalmol. Vis. Sci. 58, 3 (March 2017), 1560. https://doi.org/10.1167/iovs.16-20273
[29]
Cristian Patras, Mantas Cibulskis, and Niels Christian Nilsson. 2022. Body Warping Versus Change Blindness Remapping: A Comparison of Two Approaches to Repurposing Haptic Proxies for Virtual Reality. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 205–212. https://doi.org/10.1109/VR51125.2022.00039
[30]
Mohamed Suhail Mohamed Yousuf Sait, Shyam Prathish Sargunam, Dustin T. Han, and Eric D. Ragan. 2018. Physical hand interaction for controlling multiple virtual objects in virtual reality. In Proceedings of the 3rd International Workshop on Interactive and Spatial Computing(IWISC ’18). Association for Computing Machinery, 64–74. https://doi.org/10.1145/3191801.3191814
[31]
Majed Samad, Elia Gatti, Anne Hermes, Hrvoje Benko, and Cesare Parise. 2019. Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300550
[32]
Albulena Shaqiri, Maya Roinishvili, Lukasz Grzeczkowski, Eka Chkonia, Karin Pilz, Christine Mohr, Andreas Brand, Marina Kunchulia, and Michael H Herzog. 2018. Sex-related differences in vision are heterogeneous. Scientific reports 8, 1 (2018), 7521.
[33]
Patrick L. Strandholt, Oana A. Dogaru, Niels C. Nilsson, Rolf Nordahl, and Stefania Serafin. 2020. Knock on Wood: Combining Redirected Touching and Physical Props for Tool-Based Interaction in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13. https://doi.org/10.1145/3313831.3376303
[34]
Mohamed Suhail, Shyam Prathish Sargunam, Dustin T. Han, and Eric D. Ragan. 2017. Redirected reach in virtual reality: Enabling natural hand interaction at multiple virtual locations with passive haptics. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 245–246. https://doi.org/10.1109/3DUI.2017.7893363
[35]
Matthew A. Timmis and Shahina Pardhan. 2012. The Effect of Central Visual Impairment on Manual Prehension When Tasked with Transporting-to-Place an Object Accurately to a New Location. Invest. Ophthalmol. Vis. Sci. 53, 6 (May 2012), 2812. https://doi.org/10.1167/iovs.11-8860
[36]
Xavier de Tinguy, Claudio Pacchierotti, Mathieu Emily, Mathilde Chevalier, Aurélie Guignardat, Morgan Guillaudeux, Chloé Six, Anatole Lécuyer, and Maud Marchal. 2019. How Different Tangible and Virtual Objects Can Be While Still Feeling the Same?. In 2019 IEEE World Haptics Conference (WHC). 580–585. https://doi.org/10.1109/WHC.2019.8816164
[37]
Jackie (Junrui) Yang, Hiroshi Horii, Alexander Thayer, and Rafael Ballagas. 2018. VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology(UIST ’18). 889–899. https://doi.org/10.1145/3242587.3242643
[38]
Andre Zenner and Antonio Kruger. 2019. Estimating Detection Thresholds for Desktop-Scale Hand Redirection in Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 47–55. https://doi.org/10.1109/VR.2019.8798143
[39]
André Zenner and Antonio Krüger. 2020. Shifting & Warping: A Case for the Combined Use of Dynamic Passive Haptics and Haptic Retargeting in VR. In Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology(UIST ’20 Adjunct). 1–3. https://doi.org/10.1145/3379350.3416166
[40]
Andre Zenner, Kora Persephone Regitz, and Antonio Kruger. 2021. Blink-Suppressed Hand Redirection. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, 75–84. https://doi.org/10.1109/VR50410.2021.00028
[41]
Andre Zenner, Kristin Ullmann, and Antonio Kruger. 2021. Combining Dynamic Passive Haptics and Haptic Retargeting for Enhanced Haptic Feedback in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 27, 5 (May 2021), 2627–2637. https://doi.org/10.1109/TVCG.2021.3067777
Index Terms
- Redirected Placement: Evaluating the Redirection of Passive Props during Reach-to-Place in Virtual Reality
Recommendations
Instant Hand Redirection in Virtual Reality Through Electrical Muscle Stimulation-Triggered Eye Blinks
VRST '23: Proceedings of the 29th ACM Symposium on Virtual Reality Software and TechnologyIn this paper we investigate the use of electrical muscle stimulation (EMS) to trigger eye blinks for instant hand redirection in virtual reality (VR). With the rapid development of VR technology and increasing user expectations for realistic experiences,...
Physical hand interaction for controlling multiple virtual objects in virtual reality
IWISC '18: Proceedings of the 3rd International Workshop on Interactive and Spatial ComputingImmersive virtual reality systems often strive to support realistic physical interaction through direct hand control, but it is not often possible to configure the physical environment to exactly match the virtual environment. We study methods that ...
TableMorph: Haptic Experience with Movable Tables and Redirection
SA '23: SIGGRAPH Asia 2023 Emerging TechnologiesWe presented ”TableMorph,” a novel method that combines redirection techniques and encountered-type haptic displays. In this method, concave and convex-shaped tables with mobile robots move through the real environment according to the relative ...
Comments
Information & Contributors
Information
Published In
October 2023
542 pages
ISBN:9798400703287
DOI:10.1145/3611659
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 October 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
VRST 2023: 29th ACM Symposium on Virtual Reality Software and Technology
October 9 - 11, 2023
Christchurch, New Zealand
Acceptance Rates
Overall Acceptance Rate 66 of 254 submissions, 26%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 161Total Downloads
- Downloads (Last 12 months)161
- Downloads (Last 6 weeks)11
Reflects downloads up to 14 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format