abstract

Development of MirrorShape: High Fidelity Large-Scale Shape Rendering Framework for Virtual Reality

Authors:

Aleksey Fedoseev,

Nikita Chernyadev,

Dzmitry TsetserukouAuthors Info & Claims

VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

Article No.: 105, Pages 1 - 2

https://doi.org/10.1145/3359996.3365049

Published: 12 November 2019 Publication History

Get Access

Abstract

Today there is a high variety of haptic devices capable of providing tactile feedback. Although most of existing designs are aimed at realistic simulation of the surface properties, their capabilities are limited in attempts of displaying shape and position of virtual objects.

This paper suggests a new concept of distributed haptic display for realistic interaction with virtual object of complex shape by a collaborative robot with shape display end-effector. MirrorShape renders the 3D object in virtual reality (VR) system by contacting the user hands with the robot end-effector at the calculated point in real-time. Our proposed system makes it possible to synchronously merge the position of contact point in VR and end-effector in real world. This feature provides presentation of different shapes, and at the same time expands the working area comparing to desktop solutions.

The preliminary user study revealed that MirrorShape was effective at reducing positional error in VR interactions. Potentially this approach can be used in the virtual systems for rendering versatile VR objects with wide range of sizes with high fidelity large-scale shape experience.

References

[1]

Bruno Araujo, Ricardo Jota, Varun Perumal, Jia Xian Yao, Karan Singh, and Daniel Wigdor. 2016. Snake Charmer: Physically Enabling Virtual Objects. In Proceedings of the TEI ’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction(TEI ’16). ACM, New York, NY, USA, 218–226. https://doi.org/10.1145/2839462.2839484

Digital Library

Google Scholar

[2]

Hrvoje Benko, Christian Holz, Mike Sinclair, and Eyal Ofek. 2016. NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology(UIST ’16). ACM, New York, NY, USA, 717–728. https://doi.org/10.1145/2984511.2984526

Digital Library

Google Scholar

[3]

Daniel Fitzgerald and Hiroshi Ishii. 2018. Mediate: A Spatial Tangible Interface for Mixed Reality. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems(CHI EA ’18). ACM, New York, NY, USA, Article LBW625, 6 pages. https://doi.org/10.1145/3170427.3188472

Digital Library

Google Scholar

[4]

Dzmitry Tsetserukou, Katsunari Sato, and Susumu Tachi. 2010. ExoInterfaces: novel exosceleton haptic interfaces for virtual reality, augmented sport and rehabilitation.1. https://doi.org/10.1145/1785455.1785456

Digital Library

Google Scholar

[5]

Vibol Yem and Hiroyuki Kajimoto. 2017. Wearable tactile device using mechanical and electrical stimulation for fingertip interaction with virtual world. 99–104. https://doi.org/10.1109/VR.2017.7892236

Crossref

Google Scholar

Cited By

View all

Lykov AFedoseev ATsetserukou D(2023)DeltaFinger: A 3-DoF Wearable Haptic Display Enabling High-Fidelity Force Vector Presentation at a User FingerHaptic Interaction10.1007/978-3-031-46839-1_11(135-146)Online publication date: 8-Nov-2023
https://doi.org/10.1007/978-3-031-46839-1_11
Fedoseev ABaza AGupta ADorzhieva EGujarathi RTsetserukou D(2022)DandelionTouch: High Fidelity Haptic Rendering of Soft Objects in VR by a Swarm of Drones2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53654.2022.9945390(1078-1083)Online publication date: 9-Oct-2022
https://doi.org/10.1109/SMC53654.2022.9945390
Nazarova ESautenkov OAltamirano Cabrera MTirado JSerpiva VRakhmatulin VTsetserukou D(2021)CobotAR: Interaction with Robots using Omnidirectionally Projected Image and DNN-based Gesture Recognition2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC52423.2021.9658827(2590-2595)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1109/SMC52423.2021.9658827
Show More Cited By

Recommendations

TeslaMirror: Multistimulus Encounter-Type Haptic Display for Shape and Texture Rendering in VR
SIGGRAPH '20: ACM SIGGRAPH 2020 Emerging Technologies

We propose a novel concept of a hybrid tactile display with multistimulus feedback, allowing the real-time experience of the position, shape, and texture of the virtual object. TeslaMirror consists of a gross shape display based on 6 DOF robot, fine ...
InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VR
CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

We introduce InflatableBots, shape-changing inflatable robots for large-scale encountered-type haptics in VR. Unlike traditional inflatable shape displays, which are immobile and limited in interaction areas, our approach combines mobile robots with fan-...
Experiencing 3D interactions in virtual reality and augmented reality
EUSAI '04: Proceedings of the 2nd European Union symposium on Ambient intelligence

We demonstrate basic 2D and 3D interactions in both a Virtual Reality (VR) system, called the Personal Space Station, and an Augmented Reality (AR) system, called the Visual Interaction Platform. Since both platforms use identical (optical) tracking ...

Comments

Information & Contributors

Information

Published In

VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

November 2019

498 pages

ISBN:9781450370011

DOI:10.1145/3359996

Editors:
Tomas Trescak
Western Sydney University
,
Simeon Simoff
Western Sydney University
,
Deborah Richards
Macquarie University
,
Anton Bogdanovych
Western Sydney University
,
Thierry Duval
IMT Atlantique
,
Torsten Kuhlen
RWTH Aachen University
,
Huyen Nguyen
University of New South Wales
,
Shigeo Morishima
University of Waseda
,
Yuichi Itoh
University of Osaka
,
Richard Skarbez
La Trobe
,
Anton Bogdanovych
Western Sydney University
,
Martin Masek
Edith Cowan University

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2019

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Conference

VRST '19

Sponsor:

VRST '19: 25th ACM Symposium on Virtual Reality Software and Technology

November 12 - 15, 2019

NSW, Parramatta, Australia

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
156
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lykov AFedoseev ATsetserukou D(2023)DeltaFinger: A 3-DoF Wearable Haptic Display Enabling High-Fidelity Force Vector Presentation at a User FingerHaptic Interaction10.1007/978-3-031-46839-1_11(135-146)Online publication date: 8-Nov-2023
https://doi.org/10.1007/978-3-031-46839-1_11
Fedoseev ABaza AGupta ADorzhieva EGujarathi RTsetserukou D(2022)DandelionTouch: High Fidelity Haptic Rendering of Soft Objects in VR by a Swarm of Drones2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC53654.2022.9945390(1078-1083)Online publication date: 9-Oct-2022
https://doi.org/10.1109/SMC53654.2022.9945390
Nazarova ESautenkov OAltamirano Cabrera MTirado JSerpiva VRakhmatulin VTsetserukou D(2021)CobotAR: Interaction with Robots using Omnidirectionally Projected Image and DNN-based Gesture Recognition2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC)10.1109/SMC52423.2021.9658827(2590-2595)Online publication date: 17-Oct-2021
https://dl.acm.org/doi/10.1109/SMC52423.2021.9658827
Ponomareva PTrinitatova DFedoseev AKalinov ITsetserukou D(2021)GraspLook: a VR-based Telemanipulation System with R-CNN-driven Augmentation of Virtual Environment2021 20th International Conference on Advanced Robotics (ICAR)10.1109/ICAR53236.2021.9659460(166-171)Online publication date: 6-Dec-2021
https://doi.org/10.1109/ICAR53236.2021.9659460

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Recommendations

TeslaMirror: Multistimulus Encounter-Type Haptic Display for Shape and Texture Rendering in VR

InflatableBots: Inflatable Shape-Changing Mobile Robots for Large-Scale Encountered-Type Haptics in VR

Experiencing 3D interactions in virtual reality and augmented reality

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations