research-article

Open access

VoxelHap: A Toolkit for Constructing Proxies Providing Tactile and Kinesthetic Haptic Feedback in Virtual Reality

Authors:

Antonio KrügerAuthors Info & Claims

UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Article No.: 104, Pages 1 - 13

https://doi.org/10.1145/3586183.3606722

Published: 29 October 2023 Publication History

All formats PDF

Abstract

Experiencing virtual environments is often limited to abstract interactions with objects. Physical proxies allow users to feel virtual objects, but are often inaccessible. We present the VoxelHap toolkit which enables users to construct highly functional proxy objects using Voxels and Plates. Voxels are blocks with special functionalities that form the core of each physical proxy. Plates increase a proxy’s haptic resolution, such as its shape, texture or weight. Beyond providing physical capabilities to realize haptic sensations, VoxelHap utilizes VR illusion techniques to expand its haptic resolution. We evaluated the capabilities of the VoxelHap toolkit through the construction of a range of fully functional proxies across a variety of use cases and applications. In two experiments with 24 participants, we investigate a subset of the constructed proxies, studying how they compare to a traditional VR controller. First, we investigated VoxelHap’s combined haptic feedback and second, the trade-offs of using ShapePlates. Our findings show that VoxelHap’s proxies outperform traditional controllers and were favored by participants.

Supplemental Material

ZIP File

Supplemental File.

Download
66.67 MB

References

[1]

Adilzhan Adilkhanov, Amir Yelenov, Ramakanth Singal Reddy, Alexander Terekhov, and Zhanat Kappassov. 2020. VibeRo: Vibrotactile Stiffness Perception Interface for Virtual Reality. IEEE Robotics and Automation Letters 5, 2 (2020), 2785–2792. https://doi.org/10.1109/LRA.2020.2972793

[2]

Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (Eindhoven, Netherlands) (TEI ’16). Association for Computing Machinery, New York, NY, USA, 218–226. https://doi.org/10.1145/2839462.2839484

Digital Library

[3]

Jatin Arora, Aryan Saini, Nirmita Mehra, Varnit Jain, Shwetank Shrey, and Aman Parnami. 2019. VirtualBricks: Exploring a Scalable, Modular Toolkit for Enabling Physical Manipulation in VR. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300286

Digital Library

[4]

Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2014. Controlling Perceived Stiffness of Pinched Objects using Visual Feedback of Hand Deformation. In 2014 IEEE Haptics Symposium (HAPTICS). 557–562. https://doi.org/10.1109/HAPTICS.2014.6775516

[5]

Yuki Ban, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2014. Displaying Shapes with Various Types of Surfaces Using Visuo-Haptic Interaction. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology (Edinburgh, Scotland) (VRST ’14). Association for Computing Machinery, New York, NY, USA, 191–196. https://doi.org/10.1145/2671015.2671028

Digital Library

[6]

Christopher C Berger, Mar Gonzalez-Franco, Eyal Ofek, and Ken Hinckley. 2018. The Uncanny Valley of Haptics. Science Robotics 3, 17 (2018), eaar7010.

[7]

Joanna Bergström, Aske Mottelson, and Jarrod Knibbe. 2019. Resized Grasping in VR: Estimating Thresholds for Object Discrimination. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 1175–1183. https://doi.org/10.1145/3332165.3347939

Digital Library

[8]

Elodie Bouzbib, Claudio Pacchierotti, and Anatole Lécuyer. 2023. When Tangibles Become Deformable: Studying Pseudo-Stiffness Perceptual Thresholds in a VR Grasping Task. IEEE Transactions on Visualization and Computer Graphics (2023), 1–10. https://doi.org/10.1109/TVCG.2023.3247083

Digital Library

[9]

Lung-Pan Cheng, Eyal Ofek, Christian Holz, Hrvoje Benko, and Andrew D. Wilson. 2017. Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3718–3728. https://doi.org/10.1145/3025453.3025753

Digital Library

[10]

Inrak Choi, Heather Culbertson, Mark R. Miller, Alex Olwal, and Sean Follmer. 2017. Grabity: A Wearable Haptic Interface for Simulating Weight and Grasping in Virtual Reality. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 119–130. https://doi.org/10.1145/3126594.3126599

Digital Library

[11]

Donald Degraen, Bruno Fruchard, Frederik Smolders, Emmanouil Potetsianakis, Seref Güngör, Antonio Krüger, and Jürgen Steimle. 2021. Weirding Haptics: In-Situ Prototyping of Vibrotactile Feedback in Virtual Reality through Vocalization. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 936–953. https://doi.org/10.1145/3472749.3474797

Digital Library

[12]

Donald Degraen, André Zenner, and Antonio Krüger. 2019. Enhancing Texture Perception in Virtual Reality Using 3D-Printed Hair Structures. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland UK) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1––12. https://doi.org/10.1145/3290605.3300479

Digital Library

[13]

Tim Düwel, Martin Feick, and Antonio Krüger. 2021. Considering Interaction Types for Geometric Primitive Matching. In Everyday Proxy Objects for Virtual Reality Workshop of the 2021 CHI Conference on Human Factors in Computing Systems. http://epo4vr.dfki.de/

[14]

Martin Feick, Scott Bateman, Anthony Tang, André Miede, and Nicolai Marquardt. 2020. Tangi: Tangible Proxies for Embodied Object Exploration and Manipulation in Virtual Reality. In 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 195–206. https://doi.org/10.1109/ISMAR50242.2020.00042

[15]

Martin Feick, Donald Degraen, Fabian Hupperich, and Antonio Krüger. 2023. MetaReality: Enhancing Tactile Experiences using Actuated 3D-printed Metamaterials in Virtual Reality. Frontiers in Virtual Reality 4 (2023). https://doi.org/10.3389/frvir.2023.1172381

[16]

Martin Feick, Niko Kleer, Anthony Tang, and Antonio Krüger. 2020. The Virtual Reality Questionnaire Toolkit. In Adjunct Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology, AP UIST 2020 (Virtual Event, USA) (UIST ’20 Adjunct). ACM, 68–69. https://dl.acm.org/doi/10.1145/3379350.3416188

[17]

Martin Feick, Niko Kleer, André Zenner, Anthony Tang, and Antonio Krüger. 2021. Visuo-Haptic Illusions for Linear Translation and Stretching Using Physical Proxies in Virtual Reality. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 220, 13 pages. https://doi.org/10.1145/3411764.3445456

Digital Library

[18]

Martin Feick, Terrance Mok, Anthony Tang, Lora Oehlberg, and Ehud Sharlin. 2018. Perspective on and Re-Orientation of Physical Proxies in Object-Focused Remote Collaboration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173855

Digital Library

[19]

Martin Feick, Kora Persephone Regitz, Anthony Tang, and Antonio Krüger. 2022. Designing Visuo-Haptic Illusions with Proxies in Virtual Reality: Exploration of Grasp, Movement Trajectory and Object Mass. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 635, 15 pages. https://doi.org/10.1145/3491102.3517671

Digital Library

[20]

Martin Feick, André Zenner, Oscar Javier Ariza Nunez, Anthony Tang, Biyikli Cihan, and Antonio Krüger. 2023. Turn-It-Up: Rendering Resistance for Knobs in Virtual Reality through Undetectable Pseudo-Haptics. In Proceedings of the 36nd Annual ACM Symposium on User Interface Software and Technology (San Francisco, CA, USA) (UIST ’23). Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3586183.3606722

Digital Library

[21]

James J. Gibson. 1933. Adaption, After-effect and Contrast in the Perception of Curved Lines. Journal of Experimental Psychology 16, 1 (1933), 1–31. https://doi.org/10.1037/h0074626

[22]

Daniel Groeger, Martin Feick, Anusha Withana, and Jürgen Steimle. 2019. Tactlets: Adding Tactile Feedback to 3D Objects Using Custom Printed Controls. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 923–936. https://doi.org/10.1145/3332165.3347937

Digital Library

[23]

Seongkook Heo, Jaeyeon Lee, and Daniel Wigdor. 2019. PseudoBend: Producing Haptic Illusions of Stretching, Bending, and Twisting Using Grain Vibrations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 803–813. https://doi.org/10.1145/3332165.3347941

Digital Library

[24]

Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1957–1967. https://doi.org/10.1145/2858036.2858134

Digital Library

[25]

Ken Hinckley, Randy Pausch, John C. Goble, and Neal F. Kassell. 1994. Passive Real-World Interface Props for Neurosurgical Visualization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI ’94). Association for Computing Machinery, New York, NY, USA, 452–458. https://doi.org/10.1145/191666.191821

Digital Library

[26]

Carmen Hull and Wesley Willett. 2017. Building with Data: Architectural Models as Inspiration for Data Physicalization. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 1217–1264. https://doi.org/10.1145/3025453.3025850

Digital Library

[27]

Brent Edward Insko. 2001. Passive Haptics Significantly Enhances Virtual Environments. Ph. D. Dissertation. The University of North Carolina at Chapel Hill, Chapel Hill. http://www.cs.unc.edu/techreports/01-017.pdf

[28]

Seunggon Jeon, Seungwon Paik, Ungyeon Yang, Patrick C Shih, and Kyungsik Han. 2021. The More, the Better? Improving VR Firefighting Training System with Realistic Firefighter Tools as Controllers. Sensors (Basel, Switzerland) 21, 21 (2021), 7193.

[29]

Sergi Jordà, Günter Geiger, Marcos Alonso, and Martin Kaltenbrunner. 2007. The ReacTable: Exploring the Synergy between Live Music Performance and Tabletop Tangible Interfaces. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (Baton Rouge, Louisiana) (TEI ’07). Association for Computing Machinery, New York, NY, USA, 139–146. https://doi.org/10.1145/1226969.1226998

Digital Library

[30]

Johan Kildal. 2012. Kooboh: Variable Tangible Properties in a Handheld Haptic-Illusion Box. In Proceedings of the 2012 International Conference on Haptics: Perception, Devices, Mobility, and Communication - Volume Part II (Tampere, Finland) (EuroHaptics’12). Springer-Verlag, Berlin, Heidelberg, 191–194. https://doi.org/10.1007/978-3-642-31404-9_33

Digital Library

[31]

Yoshifumi Kitamura, Yuichi Itoh, and Fumio Kishino. 2001. Real-Time 3D Interaction with ActiveCube. In CHI ’01 Extended Abstracts on Human Factors in Computing Systems (Seattle, Washington) (CHI EA ’01). Association for Computing Machinery, New York, NY, USA, 355–356. https://doi.org/10.1145/634067.634277

Digital Library

[32]

Eun Kwon, Gerard J. Kim, and Sangyoon Lee. 2009. Effects of sizes and shapes of props in tangible augmented reality. In 2009 8th IEEE International Symposium on Mixed and Augmented Reality. 201–202. https://doi.org/10.1109/ISMAR.2009.5336463

Digital Library

[33]

Anatole Lécuyer. 2009. Simulating haptic feedback using vision: A survey of research and applications of pseudo-haptic feedback. Presence: Teleoperators and Virtual Environments 18, 1 (2009), 39–53.

Digital Library

[34]

David Ledo, Steven Houben, Jo Vermeulen, Nicolai Marquardt, Lora Oehlberg, and Saul Greenberg. 2018. Evaluation Strategies for HCI Toolkit Research. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3173574.3173610

Digital Library

[35]

Danny Leen, Raf Ramakers, and Kris Luyten. 2017. StrutModeling: A Low-Fidelity Construction Kit to Iteratively Model, Test, and Adapt 3D Objects. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST ’17). Association for Computing Machinery, New York, NY, USA, 471–479. https://doi.org/10.1145/3126594.3126643

Digital Library

[36]

Nianlong Li, Han-Jong Kim, LuYao Shen, Feng Tian, Teng Han, Xing-Dong Yang, and Tek-Jin Nam. 2020. HapLinkage: Prototyping Haptic Proxies for Virtual Hand Tools Using Linkage Mechanism. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 1261–1274. https://doi.org/10.1145/3379337.3415812

Digital Library

[37]

John C. McClelland, Robert J. Teather, and Audrey Girouard. 2017. Haptobend: Shape-Changing Passive Haptic Feedback in Virtual Reality. In Proceedings of the 5th Symposium on Spatial User Interaction (Brighton, United Kingdom) (SUI ’17). Association for Computing Machinery, New York, NY, USA, 82–90. https://doi.org/10.1145/3131277.3132179

Digital Library

[38]

William A. McNeely. 1993. Robotic Graphics: A New Approach to Force Feedback for Virtual Reality. In Proceedings of IEEE Virtual Reality Annual International Symposium(VRAIS ’93). 336–341. https://doi.org/10.1109/VRAIS.1993.380761

Digital Library

[39]

Stefanie Mueller, Tobias Mohr, Kerstin Guenther, Johannes Frohnhofen, and Patrick Baudisch. 2014. FaBrickation: Fast 3D Printing of Functional Objects by Integrating Construction Kit Building Blocks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). Association for Computing Machinery, New York, NY, USA, 3827–3834. https://doi.org/10.1145/2556288.2557005

Digital Library

[40]

Thomas Muender, Anke V. Reinschluessel, Sean Drewes, Dirk Wenig, Tanja Döring, and Rainer Malaka. 2019. Does It Feel Real? Using Tangibles with Different Fidelities to Build and Explore Scenes in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland, UK) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3290605.3300903

Digital Library

[41]

Niels Christian Nilsson, Andre Zenner, and Adalberto L. Simeone. 2021. Propping Up Virtual Reality With Haptic Proxies. IEEE Computer Graphics and Applications 41, 5 (Sept. 2021), 104–112. https://doi.org/10.1109/MCG.2021.3097671

[42]

Tommy Nilsson, Flavie Rometsch, Leonie Becker, Florian Dufresne, Paul Demedeiros, Enrico Guerra, Andrea Emanuele Maria Casini, Anna Vock, Florian Gaeremynck, and Aidan Cowley. 2023. Using Virtual Reality to Shape Humanity’s Return to the Moon: Key Takeaways from a Design Study. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 305, 16 pages. https://doi.org/10.1145/3544548.3580718

Digital Library

[43]

Martin Nisser, Leon Cheng, Yashaswini Makaram, Ryo Suzuki, and Stefanie Mueller. 2022. ElectroVoxel: Electromagnetically Actuated Pivoting for Scalable Modular Self-Reconfigurable Robots. In 2022 International Conference on Robotics and Automation (ICRA). 4254–4260. https://doi.org/10.1109/ICRA46639.2022.9811746

Digital Library

[44]

Chaeyong Park, Jinhyuk Yoon, Seungjae Oh, and Seungmoon Choi. 2020. Augmenting Physical Buttons with Vibrotactile Feedback for Programmable Feels. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 924–937. https://doi.org/10.1145/3379337.3415837

Digital Library

[45]

A. Roudaut, D. Krusteva, M. McCoy, A. Karnik, K Ramani, and S. Subramanian. 2016. Cubimorph: Designing modular interactive devices. In 2016 IEEE International Conference on Robotics and Automation (ICRA). 3339–3345. https://doi.org/10.1109/ICRA.2016.7487508

Digital Library

[46]

Shahabedin Sagheb, Frank Wencheng Liu, Alireza Bahremand, Assegid Kidane, and Robert LiKamWa. 2019. SWISH: A Shifting-Weight Interface of Simulated Hydrodynamics for Haptic Perception of Virtual Fluid Vessels. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 751–761. https://doi.org/10.1145/3332165.3347870

Digital Library

[47]

Majed Samad, Elia Gatti, Anne Hermes, Hrvoje Benko, and Cesare Parise. 2019. Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects by Manipulating Control-Display Ratio. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300550

Digital Library

[48]

Philipp Schoessler, Daniel Windham, Daniel Leithinger, Sean Follmer, and Hiroshi Ishii. 2015. Kinetic Blocks: Actuated Constructive Assembly for Interaction and Display. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (Charlotte, NC, USA) (UIST ’15). Association for Computing Machinery, New York, NY, USA, 341–349. https://doi.org/10.1145/2807442.2807453

Digital Library

[49]

Eric Schweikardt and Mark D Gross. 2008. The Robot is the Program: Interacting with RoBlocks. In Proceedings of the 2nd International Conference on Tangible and Embedded Interaction (Bonn, Germany) (TEI ’08). Association for Computing Machinery, New York, NY, USA, 167–168. https://doi.org/10.1145/1347390.1347427

Digital Library

[50]

Adalberto L. Simeone, Eduardo Velloso, and Hans Gellersen. 2015. Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3307–3316. https://doi.org/10.1145/2702123.2702389

Digital Library

[51]

Alexa F. Siu, Eric J. Gonzalez, Shenli Yuan, Jason B. Ginsberg, and Sean Follmer. 2018. ShapeShift: 2D Spatial Manipulation and Self-Actuation of Tabletop Shape Displays for Tangible and Haptic Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173865

Digital Library

[52]

Antun Skuric, Hasan Sinan Bank, Richard Unger, Owen Williams, and David González-Reyes. 2022. SimpleFOC: A Field Oriented Control (FOC) Library for Controlling Brushless Direct Current (BLDC) and Stepper Motors. Journal of Open Source Software 7, 74 (2022), 4232. https://doi.org/10.21105/joss.04232

[53]

Patrick L. Strandholt, Oana A. Dogaru, Niels C. Nilsson, Rolf Nordahl, and Stefania Serafin. 2020. Knock on Wood: Combining Redirected Touching and Physical Props for Tool-Based Interaction in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376303

Digital Library

[54]

Paul Strohmeier and Kasper Hornbæk. 2017. Generating Haptic Textures with a Vibrotactile Actuator. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 4994–5005. https://doi.org/10.1145/3025453.3025812

Digital Library

[55]

Ryo Suzuki, Eyal Ofek, Mike Sinclair, Daniel Leithinger, and Mar Gonzalez-Franco. 2021. HapticBots: Distributed Encountered-Type Haptics for VR with Multiple Shape-Changing Mobile Robots. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 1269–1281. https://doi.org/10.1145/3472749.3474821

Digital Library

[56]

Yudai Tanaka, Arata Horie, and Xiang ’Anthony’ Chen. 2020. DualVib: Simulating Haptic Sensation of Dynamic Mass by Combining Pseudo-Force and Texture Feedback. In Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology (Virtual Event, Canada) (VRST ’20). Association for Computing Machinery, New York, NY, USA, Article 1, 10 pages. https://doi.org/10.1145/3385956.3418964

Digital Library

[57]

Shan-Yuan Teng, K. D. Wu, Jacqueline Chen, and Pedro Lopes. 2022. Prolonging VR Haptic Experiences by Harvesting Kinetic Energy from the User. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (Bend, OR, USA) (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 39, 18 pages. https://doi.org/10.1145/3526113.3545635

Digital Library

[58]

Xavier de Tinguy, Claudio Pacchierotti, Mathieu Emily, Mathilde Chevalier, Aurélie Guignardat, Morgan Guillaudeux, Chloé Six, Anatole Lécuyer, and Maud Marchal. 2019. How Different Tangible and Virtual Objects Can Be While Still Feeling the Same?. In 2019 IEEE World Haptics Conference (WHC). 580–585. https://doi.org/10.1109/WHC.2019.8816164

[59]

Hsin-Ruey Tsai, Ching-Wen Hung, Tzu-Chun Wu, and Bing-Yu Chen. 2020. ElastOscillation: 3D Multilevel Force Feedback for Damped Oscillation on VR Controllers. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376408

Digital Library

[60]

Ryoichi Watanabe, Yuichi Itoh, Masatsugu Asai, Yoshifumi Kitamura, Fumio Kishino, and Hideo Kikuchi. 2004. The Soul of ActiveCube: Implementing a Flexible, Multimodal, Three-Dimensional Spatial Tangible Interface. Comput. Entertain. 2, 4 (oct 2004), 15. https://doi.org/10.1145/1037851.1037874

Digital Library

[61]

Jackie (Junrui) Yang, Hiroshi Horii, Alexander Thayer, and Rafael Ballagas. 2018. VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 889–899. https://doi.org/10.1145/3242587.3242643

Digital Library

[62]

Shigeo Yoshida, Yuqian Sun, and Hideaki Kuzuoka. 2020. PoCoPo: Handheld Pin-Based Shape Display for Haptic Rendering in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376358

Digital Library

[63]

André Zenner and Antonio Krüger. 2017. Shifty: A Weight-Shifting Dynamic Passive Haptic Proxy to Enhance Object Perception in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 23, 4 (2017), 1285–1294. https://doi.org/10.1109/TVCG.2017.2656978

Digital Library

[64]

André Zenner, Kristin Ullmann, and Antonio Krüger. 2021. Combining Dynamic Passive Haptics and Haptic Retargeting for Enhanced Haptic Feedback in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 27, 5 (2021), 2627–2637. https://doi.org/10.1109/TVCG.2021.3067777

[65]

Yiwei Zhao, Lawrence H. Kim, Ye Wang, Mathieu Le Goc, and Sean Follmer. 2017. Robotic Assembly of Haptic Proxy Objects for Tangible Interaction and Virtual Reality. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (Brighton, United Kingdom) (ISS ’17). Association for Computing Machinery, New York, NY, USA, 82–91. https://doi.org/10.1145/3132272.3134143

Digital Library

[66]

Kening Zhu, Taizhou Chen, Feng Han, and Yi-Shiun Wu. 2019. HapTwist: Creating Interactive Haptic Proxies in Virtual Reality Using Low-Cost Twistable Artefacts. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300923

Digital Library

Cited By

Ueda YLiu CAndo TNishimaki YWatanabe YFukushima NHirata SNakamura HMori H(2024)Lighting-Based Assembly Guidance for Reconfigurable ControllerSIGGRAPH Asia 2024 Emerging Technologies10.1145/3681755.3688946(1-3)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3681755.3688946
Feick MZenner ASeibert STang AKrüger A(2024)The Impact of Avatar Completeness on Embodiment and the Detectability of Hand Redirection in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641933(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641933
Mishra ASingh HParnami AShukla J(2024)MobiTangibles: Enabling Physical Manipulation Experiences of Virtual Precision Hand-Held Tools' Miniature Control in VRIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345619130:11(7321-7331)Online publication date: 13-Sep-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456191
Show More Cited By

Index Terms

VoxelHap: A Toolkit for Constructing Proxies Providing Tactile and Kinesthetic Haptic Feedback in Virtual Reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Virtual reality

Recommendations

Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
Can Haptic Feedback on One Virtual Object Increase the Presence of Another Virtual Object?
VRST '22: Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology

This paper investigated whether increased presence from experiencing haptic feedback on one virtual object can transfer to another virtual object. Two similar studies were run in different environments: an immersive virtual environment and a mixed ...
Enabling Reusable Haptic Props for Virtual Reality by Hand Displacement
MuC '21: Proceedings of Mensch und Computer 2021

Virtual Reality (VR) enables compelling visual experiences. However, providing haptic feedback is still challenging. Previous work suggests utilizing haptic props to overcome such limitations and presents evidence that props could function as a single ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

October 2023

1825 pages

ISBN:9798400701320

DOI:10.1145/3586183

Editors:
Sean Follmer
Stanford University, USA
,
Jeff Han,
Jürgen Steimle
Saarland University, Germany
,
Nathalie Henry Riche
Microsoft Research, USA

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

German Federal Ministry of Education and Research (BMBF)

Conference

UIST '23

Sponsor:

UIST '23: The 36th Annual ACM Symposium on User Interface Software and Technology

October 29 - November 1, 2023

CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
1,059
Total Downloads

Downloads (Last 12 months)964
Downloads (Last 6 weeks)103

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ueda YLiu CAndo TNishimaki YWatanabe YFukushima NHirata SNakamura HMori H(2024)Lighting-Based Assembly Guidance for Reconfigurable ControllerSIGGRAPH Asia 2024 Emerging Technologies10.1145/3681755.3688946(1-3)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3681755.3688946
Feick MZenner ASeibert STang AKrüger A(2024)The Impact of Avatar Completeness on Embodiment and the Detectability of Hand Redirection in Virtual RealityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641933(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641933
Mishra ASingh HParnami AShukla J(2024)MobiTangibles: Enabling Physical Manipulation Experiences of Virtual Precision Hand-Held Tools' Miniature Control in VRIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345619130:11(7321-7331)Online publication date: 13-Sep-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456191
Hutson JHutson PHarper-Nichols MHutson JHutson PHarper-Nichols M(2024)Conclusion: Future Applications, Technologies, and DirectionsSensemaking and Neuroaesthetics10.1007/978-3-031-58045-1_5(243-271)Online publication date: 9-May-2024
https://doi.org/10.1007/978-3-031-58045-1_5
Feick MZenner AAriza OTang ABiyikli CKrüger A(2023)Turn-It-Up: Rendering Resistance for Knobs in Virtual Reality through Undetectable Pseudo-HapticsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606787(1-10)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606787

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents