research-article

Realizing a low-latency virtual reality environment for motor learning

Authors:

Thomas Waltemate,

Felix Hülsmann,

Thies Pfeiffer,

Mario BotschAuthors Info & Claims

VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology

Pages 139 - 147

https://doi.org/10.1145/2821592.2821607

Published: 13 November 2015 Publication History

Abstract

Virtual Reality (VR) has the potential to support motor learning in ways exceeding beyond the possibilities provided by real world environments. New feedback mechanisms can be implemented that support motor learning during the performance of the trainee and afterwards as a performance review. As a consequence, VR environments excel in controlled evaluations, which has been proven in many other application scenarios.

However, in the context of motor learning of complex tasks, including full-body movements, questions regarding the main technical parameters of such a system, in particular that of the required maximum latency, have not been addressed in depth. To fill this gap, we propose a set of requirements towards VR systems for motor learning, with a special focus on motion capturing and rendering. We then assess and evaluate state-of-the-art techniques and technologies for motion capturing and rendering, in order to provide data on latencies for different setups. We focus on the end-to-end latency of the overall system, and present an evaluation of an exemplary system that has been developed to meet these requirements.

Supplementary Material

MP4 File (p139-waltemate.mp4)

Download
9.92 MB

References

[1]

Bierbaum, A. D. 2000. VR Juggler: A Virtual Platform for Virtual Reality Application Development. PhD thesis, Iowa State University.

[2]

Chua, P. T., Crivella, R., Daly, B., Hu, N., Schaaf, R., Ventura, D., Camill, T., Hodgins, J., and Pausch, R. 2003. Training for physical tasks in virtual environments: Tai Chi. In Proc. of IEEE Virtual Reality, 87--94.

Digital Library

[3]

Covaci, A., Olivier, A.-H., and Multon, F. 2014. Third person view and guidance for more natural motor behaviour in immersive basketball playing. In Proc. of ACM Symposium on Virtual Reality Software and Technology, 55--64.

Digital Library

[4]

Eilemann, S., Makhinya, M., and Pajarola, R. 2009. Equalizer: A scalable parallel rendering framework. IEEE Transactions on Visualization and Computer Graphics 15, 3, 436--452.

Digital Library

[5]

Friston, S., and Steed, A. 2014. Measuring latency in virtual environments. IEEE Transactions on Visualization and Computer Graphics 20, 4, 616--625.

Digital Library

[6]

Gutwin, C. 2002. The effects of network delays on group work in real-time groupware. In Proc. of European Conference on Computer Supported Cooperative Work, 299--318.

Digital Library

[7]

Hämäläinen, P. 2004. Interactive video mirrors for sports training. In Proc. of the third Nordic conference on Human-computer interaction, ACM, 199--202.

Digital Library

[8]

Heron, J., Hanson, J. V., and Whitaker, D. 2009. Effect before cause: supramodal recalibration of sensorimotor timing. PLoS ONE 4, 11.

[9]

Jacobson, A., Deng, Z., Kavan, L., and Lewis, J. 2014. Skinning: Real-time shape deformation. In ACM SIGGRAPH Course Notes.

Digital Library

[10]

Jörg, S., Normoyle, A., and Safonova, A. 2012. How responsiveness affects players' perception in digital games. In Proc. of ACM Symposium on Applied Perception, 33--38.

Digital Library

[11]

Jota, R., Ng, A., Dietz, P., and Wigdor, D. 2013. How fast is fast enough? a study of the effects of latency in direct-touch pointing tasks. In Proc. of ACM SIGCHI Conference on Human Factors in Computing Systems, 2291--2300.

Digital Library

[12]

Keetels, M., and Vroomen, J. 2012. Exposure to delayed visual feedback of the hand changes motor-sensory synchrony perception. Experimental brain research 219, 4, 431--440.

[13]

Kennedy, R. S., Lane, N. E., Berbaum, K. S., and Lilienthal, M. G. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3, 203--220.

[14]

Liang, J., Shaw, C., and Green, M. 1991. On temporal-spatial realism in the virtual reality environment. In Proc. of ACM symposium on User interface software and technology, 19--25.

Digital Library

[15]

Lugrin, J.-L., Charles, F., Cavazza, M., Le Renard, M., Freeman, J., and Lessiter, J. 2012. CaveUDK: a VR game engine middleware. In Proc. of ACM symposium on Virtual reality software and technology, 137--144.

Digital Library

[16]

MacKenzie, I. S., and Ware, C. 1993. Lag as a determinant of human performance in interactive systems. In Proc. of the ACM INTERACT'93 and CHI'93 conference on Human factors in computing systems, 488--493.

Digital Library

[17]

Mania, K., Adelstein, B. D., Ellis, S. R., and Hill, M. I. 2004. Perceptual sensitivity to head tracking latency in virtual environments with varying degrees of scene complexity. In Proc. of ACM Symposium on Applied perception in graphics and visualization, 39--47.

Digital Library

[18]

Mauve, M., Vogel, J., Hilt, V., and Effelsberg, W. 2004. Local-lag and timewarp: providing consistency for replicated continuous applications. IEEE Transactions on Multimedia 6, 1, 47--57.

Digital Library

[19]

Meehan, M., Razzaque, S., Whitton, M. C., and Brooks Jr, F. P. 2003. Effect of latency on presence in stressful virtual environments. In Proc. of IEEE Virtual Reality, 141--148.

Digital Library

[20]

Park, K. S., and Kenyon, R. V. 1999. Effects of network characteristics on human performance in a collaborative virtual environment. In Proc. of IEEE Virtual Reality, 104--111.

Digital Library

[21]

Rector, K., Bennett, C. L., and Kientz, J. A. 2013. Eyes-free yoga: an exergame using depth cameras for blind & low vision exercise. In Proc. of International ACM SIGACCESS Conference on Computers and Accessibility, 12:1--12:8.

Digital Library

[22]

Rizzo, A., and Kim, G. 2005. A SWOT analysis of the field of virtual reality rehabilitation and therapy. Presence 14, 2, 119--146.

Digital Library

[23]

Roberts, D. J., Sharkey, P. M., and Sandoz, P. 1995. A real-time, predictive architecture for distributed virtual reality. In Proc. of ACM SIGGRAPH Workshop on Simulation & Interaction in Virtual Environments.

[24]

Rohde, M., and Ernst, M. O. 2012. To lead and to lag--forward and backward recalibration of perceived visuo-motor simultaneity. Frontiers in psychology 3.

[25]

Schack, T., Bertollo, M., Koester, D., Maycock, J., and Essig, K. 2014. Technological advancements in sport psychology. Routledge Companion to Sport and Exercise Psychology: Global perspectives and fundamental concepts. Routledge, 953--965.

[26]

Shneiderman, B. 1984. Response time and display rate in human performance with computers. ACM Computing Surveys 16, 3, 265--285.

Digital Library

[27]

Sigrist, R., Rauter, G., Marchal-Crespo, L., Riener, R., and Wolf, P. 2014. Sonification and haptic feedback in addition to visual feedback enhances complex motor task learning. Experimental brain research 233, 1--17.

[28]

Smeddinck, J. D., Voges, J., Herrlich, M., and Malaka, R. 2014. Comparing modalities for kinesiatric exercise instruction. In ACM CHI'14 Extended Abstracts on Human Factors in Computing Systems, 2377--2382.

Digital Library

[29]

Steed, A. 2008. A simple method for estimating the latency of interactive, real-time graphics simulations. In Proc. of ACM symposium on Virtual reality software and technology, 123--129.

Digital Library

[30]

Ware, C., and Balakrishnan, R. 1994. Reaching for objects in VR displays: lag and frame rate. ACM Transactions on Computer-Human Interaction 1, 4, 331--356.

Digital Library

[31]

Witmer, B. G., and Singer, M. J. 1998. Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and virtual environments 7, 3, 225--240.

Digital Library

Cited By

Unruh FLugrin JLatoschik M(2024)Out-Of-Virtual-Body Experiences: Virtual Disembodiment Effects on Time Perception in VRProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687717(1-11)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687717
Brübach LRöhm MWestermeier FWienrich CLatoschik M(2024)The Influence of a Low-Resolution Peripheral Display Extension on the Perceived Plausibility and PresenceProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687713(1-10)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687713
Seo MKang KKang H(2024)VR Blowing: A Physically Plausible Interaction Method for Blowing Air in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323847830:7(3680-3692)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3238478
Show More Cited By

Index Terms

Realizing a low-latency virtual reality environment for motor learning
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
        Tracking
      2. Computer vision tasks
        Scene understanding
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality

Recommendations

Thinning trainer based on forest-growth model, virtual reality and computer-aided virtual environment

Immersive virtual reality is applied in many human activities. This virtual reality can be used as a training tool for thinning operations in forests. The aim of this study is to describe the complex solution of Thinning Trainer, that we developed. This ...
Juggling in VR: Advantages of Immersive Virtual Reality in Juggling Learning
VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

In this paper, we follow up on research dealing with motion learning in Virtual Reality (VR). We investigate the impact of VR motion learning on motion performance, motivation for motion learning and willingness to continue with the motion learning. In ...
Speed reading on virtual reality and augmented reality
Abstract
Many virtual reality (VR) and augmented reality (AR) applications in education require speed reading. The current study aimed to explore whether the reading performance on VR and AR is different from that on traditional desktop display,...
Highlights
- We explored performance of speed reading on virtual and augmented reality.
- ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

VRST '15: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology

November 2015

237 pages

ISBN:9781450339902

DOI:10.1145/2821592

Conference Chairs:
Qinping Zhao
Beihang Univerisity
,
Daniel Thalmann
Nanyang Technological University
,
Editor:
Stephen N. Spencer
University of Washington
,
Program Chairs:
Enhua Wu
University of Macau & Institute of Software, Chinese Academy of Sciences
,
Ming C. Lin
University of North Carolina at Chapel Hill
,
Lili Wang
Beihang University

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

German Research Foundation (DFG)

Conference

VRST '15

Sponsor:

VRST '15: 21th ACM Symposium on Virtual Reality Software and Technology

November 13 - 15, 2015

Beijing, China

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
692
Total Downloads

Downloads (Last 12 months)55
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Unruh FLugrin JLatoschik M(2024)Out-Of-Virtual-Body Experiences: Virtual Disembodiment Effects on Time Perception in VRProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687717(1-11)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687717
Brübach LRöhm MWestermeier FWienrich CLatoschik M(2024)The Influence of a Low-Resolution Peripheral Display Extension on the Perceived Plausibility and PresenceProceedings of the 30th ACM Symposium on Virtual Reality Software and Technology10.1145/3641825.3687713(1-10)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3641825.3687713
Seo MKang KKang H(2024)VR Blowing: A Physically Plausible Interaction Method for Blowing Air in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323847830:7(3680-3692)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3238478
Nguyen SDevanne MNeris OLempereur MThépaut A(2024)A Medical Low-Back Pain Physical Rehabilitation Database for Human Body Movement Analysis2024 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN60899.2024.10650036(1-8)Online publication date: 30-Jun-2024
https://doi.org/10.1109/IJCNN60899.2024.10650036
Geris ACukurbasi BKilinc MTeke O(2024)Balancing performance and comfort in virtual reality: A study of FPS, latency, and batch valuesSoftware: Practice and Experience10.1002/spe.335654:12(2336-2348)Online publication date: 11-Jun-2024
https://doi.org/10.1002/spe.3356
Khan TZhu TDownes TCheng LKass NAndrews EBiehl J(2023)Understanding Effects of Visual Feedback Delay in AR on Fine Motor Surgical TasksIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332021429:11(4697-4707)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320214
Unruh FVogel DLandeck MLugrin JLatoschik M(2023)Body and Time: Virtual Embodiment and its Effect on Time PerceptionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324704029:5(2626-2636)Online publication date: 1-May-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247040
Grewe CLiu THildebrandt AZachow S(2022)The Open Virtual Mirror Framework for enfacement illusionsBehavior Research Methods10.3758/s13428-021-01761-955:2(867-882)Online publication date: 2-May-2022
https://doi.org/10.3758/s13428-021-01761-9
Blanchard ANguyen SDevanne MSimonnet MLe Goff-Pronost MRémy-Néris O(2022)Technical Feasibility of Supervision of Stretching Exercises by a Humanoid Robot Coach for Chronic Low Back Pain: The R‐COOL Randomized TrialBioMed Research International10.1155/2022/56672232022:1Online publication date: 9-Mar-2022
https://doi.org/10.1155/2022/5667223
Xia CFang XArakawa RSugiura Y(2022)VoLearnProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35345766:2(1-26)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534576
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents