research-article

Visuomotor adaptation to excessive visual displacement in video see-through HMDs

Authors:

Ji-Hyung ParkAuthors Info & Claims

Virtual Reality, Volume 24, Issue 2

Pages 211 - 221

https://doi.org/10.1007/s10055-019-00390-0

Published: 01 June 2020 Publication History

Abstract

A video see-through head-mounted display (VSHMD) is a modified HMD having an additional small digital camera set (see-through camera set) attached in front of the HMD, which allows users to view the real scene along with virtual information in digitally mixed form. However, although VSHMD has potential utility in augmented reality applications, the visual displacement problem must be overcome. This problem is caused by the distance between the see-through camera and human eye and induces visuomotor performance deterioration. Previous studies have revealed that human adaptation improves the visuomotor performance over time, by rearranging the proprioception. In this study, we extend the visual displacement excessively to 300 mm and investigate the eye–hand and eye–foot visuomotor coordination in two experiments. In Experiment 1, the prism adaptation paradigm is used to compare task performance under various visual displacement conditions. In Experiment 2, the procedures of Experiment 1 are implemented on 3 consecutive days to evaluate the relatively long-term adaptation trend. The results reveal distinct adaptations under all conditions. When excessive visual displacement is unavoidable, sufficient training can improve task performance, similar to the previously discovered perceptual adaptation. However, with increased visual displacement, the task performance improvement decelerates significantly. This improvement attenuation increases as the task performance becomes close to that achieved under bare eye conditions. Although humans can adapt to a large amount of visual displacement, a serious usage problem arises because of this slow adaptation improvement trend.

References

[1]

Alexander MS, Flodin BW, and Marigold DS Prism adaptation and generalization during visually guided locomotor tasks J Neurophysiol 2011 106 860-871

[2]

Arthur K (2000) Effects of field of view on performance with head-mounted displays. Dissertation, University of North Carolina

[3]

Bae H, Golparvar-Fard M, and White J High-precision vision-based mobile augmented reality system for context-aware architectural, engineering, construction and facility management (AEC/FM) applications J Vis Eng 2013 1 1-13

[4]

Chintamani K, Overgaard T, Tan CA, Ellis RD, Pandya A (2008) Physically-based augmented reality for remote robot tele-operation: applications in training and simulation. Proc 2008 IeRC 977–982

[5]

Cobb SVG Measurement of postural stability before and after immersion in a virtual environment Appl Ergon 1999 30 47-57

[6]

Fernandez-Ruiz J and Diaz R Prism adaptation and aftereffect: specifying the properties of a procedural memory system Learn Mem 1999 6 47-53

[7]

Fernandez-Ruiz J, Hall C, Vergara P, and Diaz R Prism adaptation in normal aging: slower adaptation rate and larger aftereffect Brain Res Cogn Brain Res 2000 9 223-226

[8]

Fernandez-Ruiz J, Wong W, Armstrong IT, and Flanagan JR Relation between reaction time and reach errors during visuomotor adaptation Behav Brain Res 2011 219 8-14

[9]

Frassinetti F, Angeli V, Meneghello F, Avanzi S, and Ladavas E Long-lasting amelioration of visuospatial neglect by prism adaptation Brain 2002 125 608-623

[10]

Hakkinen J, Vuori T, and Paakka M Postural stability and sickness symptoms after HMD use IEEE ICSMC 2002

[11]

Harris CS Adaptation to displaced vision: visual, motor, or proprioceptive change? Science 1963 140 812-813

[12]

Hay JC and Pick HL Jr Visual and proprioceptive adaptation to optical displacement of the visual stimulus J Exp Psychol 1966 71 150-158

[13]

Hughes CE, Stapleton CB, Hughes DE, and Smith EM Mixed reality in education, entertainment, and training IEEE Comput Graph Appl 2005 25 24-30

[14]

Kennedy RS, Lilienthal MG (1994) Measurement and control of motion sickness aftereffects from immersion in virtual reality. In: Proceedings of virtual reality and medicine: the cutting edge, SIG-advanced applications, Inc., New York, pp 111–119

[15]

Kennedy RS and Lilienthal MG Implications of balance disturbances following exposure to virtual reality systems Proc VRAIS 1995 1995 35-39

[16]

Kim SE, Lee JH, and Park JH The effects of visual displacement on simulator sickness in video see-through head mounted displays Proc ISWC 2014

[17]

Kollenberg T, Neumann A, Schneider D, Tews T-K, Hermann T, Ritter H, Dierker A, and Koesling H Visual search in the (un)real world: How head-mounted displays affect eye movements, head movements and target detection Proc ETRA 2010

[18]

Lang CE and Bastian AJ Cerebellar subjects show impaired adaptation of anticipatory EMG during catching J Neurophysiol 1999 82 2108-2119

[19]

Lang CE and Bastian AJ Additional somatosensory information does not improve cerebellar adaptation during catching Clin Neurophysiol 2001 112 5 895-907

[20]

LaViola JJ Jr A discussion of cybersickness in virtual environments SIGCHI Bull 2000 32 47-56

[21]

Lee JH, Kim SY, Yoon HC, Huh BK, and Park JH A preliminary investigation of human adaptations for various virtual eyes in video see-through HMDS Proc SIGCHI 2013 2013 309-312

[22]

Luaute J, Schwartz S, Rossetti Y, Spiridon M, Rode G, Boisson D, and Vuilleumier P Dynamic changes in brain activity during prism adaptation J Neurosci 2009 29 169-178

[23]

Martin TA, Keating JG, Goodkin HP, Bastian AJ, and Thach WT Throwing while looking through prisms. 1. Focal olivocerebellar lesions impair adaptation Brain 1996 119 1183-1198

[24]

McGonigle BO and Flook J Long-term retention of single and multistate prismatic adaptation by humans Nature 1978 272 364-366

[25]

Moss JD, Austin J, Salley J, Coats J, Williams K, and Muth ER The effects of display delay on simulator sickness Display 2011 32 159-168

[26]

Park M, Serefoglou S, Schmidt L, Radermacher K, Schlick C, and Luczak H Hand-eye coordination using a video see-through augmented reality system Ergon Open J 2008 1 46-53

[27]

Pretlove J Augmenting reality for telerobotics: unifying real and virtual worlds Ind Robot 1998 25 401-407

[28]

Reason JT Man in motion: the psychology of travel 1974 Reading Cox and Wyman Ltd

[29]

Reason JT Motion sickness adaptation: a neural mismatch model J R Soc Med 1978 71 819-829

[30]

Redding GM and Wallace B Effects on prism adaptation of duration and timing of visual feedback during pointing J Mot Behav 1990 22 209-224

[31]

Rolland JP, Holloway RL, and Fuchs H A comparison of optical and video see-through head-mounted displays SPIE Telemanipulator Telepresence Tech 1994 2351 293-307

[32]

Rolland JP, Barlow T, Biocca FA, and Kancherla A Quantification of adaptation to virtual-eye location in see-thru head-mounted displays Proc VRAIS 1995

[33]

Savin DN and Morton SM Asymmetric generalization between the arm and leg following prism-induced visuomotor adaptation Exp Brain Res 2008 186 175-182

[34]

Serino A, Bonifazi S, Pierfederici L, and Ladavas E Neglect treatment by prism adaptation: what recovers and for how long Neuropsychol Rehabil 2007 17 657-687

[35]

Stanney KM and Salvendy G Aftereffects and sense of presence in virtual environments: formulation of a research and development agenda Int J Hum Comput Interact 1998 10 135-187

[36]

Stanney KM, Kennedy RS, Drexler JM, and Harm DL Motion sickness and proprioceptive aftereffects following virtual environment exposure Appl Ergon 1999 30 27-38

[37]

von Helmholtz HEF (1909/1962) Treatise on physiological optics. Southall JPC (ed) and Trans. New York: Dover. (Original work published in 1909)

[38]

Wurpts M (2000) Application of a video see-through head-mounted display to infantry training. Presented at IMAGE 2000

Cited By

Guan PPenner EHegland JLetham BLanman D(2023)Perceptual Requirements for World-Locked Rendering in AR and VRSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618134(1-10)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618134
Kuo GPenner EMoczydlowski SChing ALanman DMatsuda N(2023)Perspective-Correct VR Passthrough Without ReprojectionACM SIGGRAPH 2023 Conference Proceedings10.1145/3588432.3591534(1-9)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1145/3588432.3591534
Wähnert SGerhards A(2022)Sensorimotor adaptation in VR: magnitude and persistence of the aftereffect increase with the number of interactionsVirtual Reality10.1007/s10055-022-00628-426:3(1217-1225)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s10055-022-00628-4
Show More Cited By

Index Terms

Visuomotor adaptation to excessive visual displacement in video see-through HMDs
1. Computing methodologies
  1. Artificial intelligence
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Index terms have been assigned to the content through auto-classification.

Recommendations

A preliminary investigation of human adaptations for various virtual eyes in video see-through HMDS
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

A video see-through head mounted display (HMD) has a different viewing point than does the real eye, resulting in visual displacement (VD). VD deteriorates visuomotor performance due to sensory conflict. Previous work has investigated this deterioration ...
The effects of visual displacement on simulator sickness in video see-through head-mounted displays
ISWC '14: Proceedings of the 2014 ACM International Symposium on Wearable Computers

We present an experiment exploring the role of visual displacement to simulator sickness in a video see-through head-mounted display (HMD). To identify the effect of visual displacement on simulator sickness, we examined the effect of visual ...
Augmented Reality Video See-through HMD Oriented to Product Design Assessment
VMR '09: Proceedings of the 3rd International Conference on Virtual and Mixed Reality: Held as Part of HCI International 2009

Current state of the art technology offers various solutions for developing virtual prototyping applications that also allow the interaction with the real environment. In particular, Augmented Reality (AR) technologies include tracking systems, ...

Comments

Information & Contributors

Information

Published In

cover image Virtual Reality

Virtual Reality Volume 24, Issue 2

Jun 2020

161 pages

ISSN:1359-4338

EISSN:1434-9957

Issue’s Table of Contents

© Springer-Verlag London Ltd., part of Springer Nature 2019.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 June 2020

Accepted: 09 July 2019

Received: 14 September 2018

Author Tags

Qualifiers

Research-article

Funding Sources

Youngsan University

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Guan PPenner EHegland JLetham BLanman D(2023)Perceptual Requirements for World-Locked Rendering in AR and VRSIGGRAPH Asia 2023 Conference Papers10.1145/3610548.3618134(1-10)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.1145/3610548.3618134
Kuo GPenner EMoczydlowski SChing ALanman DMatsuda N(2023)Perspective-Correct VR Passthrough Without ReprojectionACM SIGGRAPH 2023 Conference Proceedings10.1145/3588432.3591534(1-9)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1145/3588432.3591534
Wähnert SGerhards A(2022)Sensorimotor adaptation in VR: magnitude and persistence of the aftereffect increase with the number of interactionsVirtual Reality10.1007/s10055-022-00628-426:3(1217-1225)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s10055-022-00628-4
Ueyama YHarada M(2022)Effects of first- and third-person perspectives created using a head-mounted display on dart-throwing accuracyVirtual Reality10.1007/s10055-021-00562-x26:2(687-695)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1007/s10055-021-00562-x

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents