skip to main content
research-article
Open access

Method of Electrical Muscle Stimulation to Improve Hand-eye Coordination Training in Gaming

Published: 15 October 2024 Publication History

Abstract

Hand-eye coordination refers to the harmonization between visual information and hand movements. In this coordination, the information perceived by the eyes is used to guide the movements of the hands. In many games, hand-eye coordination is important for the player's experience. However, when players are faced with an unfamiliar activity, it can be a challenge to develop hand-eye coordination in a short period. This study proposes a method for hand-eye coordination training in gaming using Electrical Muscle Stimulation (EMS). By employing EMS, it is possible to enhance attention distribution during bilateral hand movements and improve hand-eye coordination, potentially enabling individuals to train hand coordination skills in a shorter period. To test the feasibility and effectiveness of our method, we first tested participants for attentional switching while wearing the EMS device to ensure that it did not negatively affect participants. Sixteen participants were then trained in hand-eye coordination with and without EMS, and the effects of the training were tested in a customized game and a real music game. The results showed that participants trained with EMS showed more significant improvements in scores and accuracy than those without EMS in both the custom game and the real game. We also conducted a retained effect experiment, which confirmed that participants retained the training effect one week after training. Thus, our study shows the possibility of using EMS as a new medium for training hand-eye coordination in games.

References

[1]
Jack A Adams. 1971. A closed-loop theory of motor learning. Journal of motor behavior, Vol. 3, 2 (1971), 111--150.
[2]
Claudia Alba-Jiménez, Daniel Moreno-Doutres, and Javier Pe na. 2022. Trends assessing neuromuscular fatigue in team sports: a narrative review. Sports, Vol. 10, 3 (2022), 33.
[3]
Arduino. 2010. Arduino UNO. https://store-usa.arduino.cc/products/arduino-uno-rev3 Retrieved January 23, 2024 from
[4]
Anil Ufuk Batmaz, Aunnoy K Mutasim, Morteza Malekmakan, Elham Sadr, and Wolfgang Stuerzlinger. 2020. Touch the wall: Comparison of virtual and augmented reality with conventional 2D screen eye-hand coordination training systems. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 184--193.
[5]
Miles C Bowman, Roland S Johannson, and John Randall Flanagan. 2009. Eye--hand coordination in a sequential target contact task. Experimental brain research, Vol. 195 (2009), 273--283.
[6]
Kajal T Claypool and Mark Claypool. 2007. On frame rate and player performance in first person shooter games. Multimedia systems, Vol. 13, 1 (2007), 3--17.
[7]
Michel Desmurget, Denis Pélisson, Yves Rossetti, and Claude Prablanc. 1998. From eye to hand: planning goal-directed movements. Neuroscience & Biobehavioral Reviews, Vol. 22, 6 (1998), 761--788.
[8]
Allison E DeVan and Douglas R Seals. 2012. Vascular health in the ageing athlete. Experimental physiology, Vol. 97, 3 (2012), 305--310.
[9]
H Paul Dijkstra, Noel Pollock, Rob Chakraverty, and JM24620040 Alonso. 2014. Managing the health of the elite athlete: a new integrated performance health management and coaching model. British journal of sports medicine, Vol. 48, 7 (2014), 523--531.
[10]
Carol S Dweck. 1986. Motivational processes affecting learning. American psychologist, Vol. 41, 10 (1986), 1040.
[11]
Graham B Erickson, Karl Citek, Michelle Cove, Jennifer Wilczek, Carolyn Linster, Brendon Bjarnason, and Nathan Langemo. 2011. Reliability of a computer-based system for measuring visual performance skills. Optometry-Journal of the American Optometric Association, Vol. 82, 9 (2011), 528--542.
[12]
Maximilian A Friehs, Iris Güldenpenning, Christian Frings, and Matthias Weigelt. 2020. Electrify your game! Anodal tDCS increases the resistance to head fakes in basketball. Journal of Cognitive Enhancement, Vol. 4 (2020), 62--70.
[13]
D Randy Garrison. 1997. Self-directed learning: Toward a comprehensive model. Adult education quarterly, Vol. 48, 1 (1997), 18--33.
[14]
Jerry L Griffith, Patricia Voloschin, Gerald D Gibb, and James R Bailey. 1983. Differences in eye-hand motor coordination of video-game users and non-users. Perceptual and motor skills, Vol. 57, 1 (1983), 155--158.
[15]
Juho Hamari, Kati Alha, Simo Järvelä, J Matias Kivikangas, Jonna Koivisto, and Janne Paavilainen. 2017. Why do players buy in-game content? An empirical study on concrete purchase motivations. Computers in Human Behavior, Vol. 68 (2017), 538--546.
[16]
Pilwon Heo, Gwang Min Gu, Soo-jin Lee, Kyehan Rhee, and Jung Kim. 2012. Current hand exoskeleton technologies for rehabilitation and assistive engineering. International Journal of Precision Engineering and Manufacturing, Vol. 13 (2012), 807--824.
[17]
Dean Herbert. 2007. OSU! https://osu.ppy.sh/home Retrieved August 23, 2022 from
[18]
Jesper F Hopstaken, Dimitri van der Linden, Arnold B Bakker, Michiel AJ Kompier, and Yik Kiu Leung. 2016. Shifts in attention during mental fatigue: Evidence from subjective, behavioral, physiological, and eye-tracking data. Journal of Experimental Psychology: Human Perception and Performance, Vol. 42, 6 (2016), 878.
[19]
Roland S Johansson, Göran Westling, Anders Bäckström, and J Randall Flanagan. 2001. Eye--hand coordination in object manipulation. Journal of neuroscience, Vol. 21, 17 (2001), 6917--6932.
[20]
Varun Kanal, James Brady, Harish Nambiappan, Maria Kyrarini, Glenn Wylie, and Fillia Makedon. 2020. Towards a serious game based human-robot framework for fatigue assessment. In Proceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 1--6.
[21]
Tuomas Kari and Veli-Matti Karhulahti. 2016. Do e-athletes move?: a study on training and physical exercise in elite e-sports. International Journal of Gaming and Computer-Mediated Simulations (IJGCMS), Vol. 8, 4 (2016), 53--66.
[22]
Shunichi Kasahara, Kazuma Takada, Jun Nishida, Kazuhisa Shibata, Shinsuke Shimojo, and Pedro Lopes. 2021. Preserving agency during electrical muscle stimulation training speeds up reaction time directly after removing EMS. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--9.
[23]
Dong Ju Kim, Chi-Yeon Lim, Namyi Gu, and Choul Yong Park. 2017. Visual fatigue induced by viewing a tablet computer with a high-resolution display. Korean Journal of Ophthalmology, Vol. 31, 5 (2017), 388--393.
[24]
Haneol Kim, Seonjin Kim, and Jianhua Wu. 2022. Perceptual-motor abilities of professional esports gamers and amateurs. Journal of Electronic Gaming and Esports, Vol. 1, 1 (2022).
[25]
John W Krakauer and Pietro Mazzoni. 2011. Human sensorimotor learning: adaptation, skill, and beyond. Current opinion in neurobiology, Vol. 21, 4 (2011), 636--644.
[26]
Junko Kuze and Kazuhiko Ukai. 2008. Subjective evaluation of visual fatigue caused by motion images. Displays, Vol. 29, 2 (2008), 159--166.
[27]
Daniel M Laby, David G Kirschen, Usha Govindarajulu, and Paul DeLand. 2018. The hand-eye coordination of professional baseball players: The relationship to batting. Optometry and Vision Science, Vol. 95, 7 (2018), 557--567.
[28]
Sheldon J Lachman. 1997. Learning is a process: Toward an improved definition of learning. The Journal of psychology, Vol. 131, 5 (1997), 477--480.
[29]
EVERYWAY MEDICAL. 2020. EV-804. http://www.everyway-medical.com/ProdDevice?productid=EV804 Retrieved January 23, 2024 from
[30]
Aunnoy K Mutasim, Wolfgang Stuerzlinger, and Anil Ufuk Batmaz. 2020. Gaze tracking for eye-hand coordination training systems in virtual reality. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1--9.
[31]
Eugen Nagorsky and Josef Wiemeyer. 2020. The structure of performance and training in esports. PloS one, Vol. 15, 8 (2020), e0237584.
[32]
Jun Nishida, Shunichi Kasahara, and Kenji Suzuki. 2017. Wired muscle: generating faster kinesthetic reaction by inter-personally connecting muscles. In ACM SIGGRAPH 2017 Emerging Technologies. 1--2.
[33]
Mohammadreza Asghari Oskoei, Huosheng Hu, and John Q Gan. 2008. Manifestation of fatigue in myoelectric signals of dynamic contractions produced during playing PC games. In 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE, 315--318.
[34]
Maman Paul, Sandeep Kumar Biswas, and Jaspal Singh Sandhu. 2011. Role of sports vision and eye hand coordination training in performance of table tennis players. Brazilian Journal of Biomotricity, Vol. 5, 2 (2011), 106--116.
[35]
C Prablanc, JF Echallier, E Komilis, and M Jeannerod. 1979. Optimal response of eye and hand motor systems in pointing at a visual target: I. Spatio-temporal characteristics of eye and hand movements and their relationships when varying the amount of visual information. Biological cybernetics, Vol. 35, 2 (1979), 113--124.
[36]
Sebastian Rutkowski, Mateusz Adamczyk, Agnieszka Pastuła, Edyta Gos, Carlos Luque-Moreno, and Anna Rutkowska. 2021. Training using a commercial immersive virtual reality system on hand--eye coordination and reaction time in young musicians: A pilot study. International Journal of Environmental Research and Public Health, Vol. 18, 3 (2021), 1297.
[37]
Uta Sailer, J Randall Flanagan, and Roland S Johansson. 2005. Eye--hand coordination during learning of a novel visuomotor task. Journal of Neuroscience, Vol. 25, 39 (2005), 8833--8842.
[38]
MHD Yamen Saraiji, Tomoya Sasaki, Reo Matsumura, Kouta Minamizawa, and Masahiko Inami. 2018. Fusion: full body surrogacy for collaborative communication. In ACM SIGGRAPH 2018 Emerging Technologies. 1--2.
[39]
Reza Shadmehr, Maurice A Smith, and John W Krakauer. 2010. Error correction, sensory prediction, and adaptation in motor control. Annual review of neuroscience, Vol. 33 (2010), 89--108.
[40]
Alexis D Souchet, Domitile Lourdeaux, Alain Pagani, and Lisa Rebenitsch. 2023. A narrative review of immersive virtual reality's ergonomics and risks at the workplace: cybersickness, visual fatigue, muscular fatigue, acute stress, and mental overload. Virtual Reality, Vol. 27, 1 (2023), 19--50.
[41]
Alexis D Souchet, Stéphanie Philippe, Domitile Lourdeaux, and Laure Leroy. 2022. Measuring visual fatigue and cognitive load via eye tracking while learning with virtual reality head-mounted displays: A review. International Journal of Human-Computer Interaction, Vol. 38, 9 (2022), 801--824.
[42]
Katja Stefan, Leonardo G Cohen, Julie Duque, Riccardo Mazzocchio, Pablo Celnik, Lumy Sawaki, Leslie Ungerleider, and Joseph Classen. 2005. Formation of a motor memory by action observation. Journal of Neuroscience, Vol. 25, 41 (2005), 9339--9346.
[43]
Akifumi Takahashi, Jas Brooks, Hiroyuki Kajimoto, and Pedro Lopes. 2021. Increasing electrical muscle stimulation's dexterity by means of back of the hand actuation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--12.
[44]
Nobuhiro Takahashi, Hayato Takahashi, and Hideki Koike. 2019. Soft exoskeleton glove enabling force feedback for human-like finger posture control with 20 degrees of freedom. In 2019 IEEE World Haptics Conference (WHC). IEEE, 217--222.
[45]
Tina Lynn Taylor. 2012. Raising the stakes: E-sports and the professionalization of computer gaming. Mit Press.
[46]
TONGLING. 2022. PETTOYA554. https://en.tonglingrelay.com/lang/ja/index.html Retrieved August 23, 2022 from
[47]
Thomas Tregel, Teodora Sarpe-Tudoran, Philipp Niklas Müller, and Stefan Göbel. 2021. Analyzing game-based training methods for selected esports titles in competitive gaming. In Serious Games: Joint International Conference, JCSG 2021, Virtual Event, January 12--13, 2022, Proceedings 7. Springer, 213--228.
[48]
Chen Wang, Rui Wang, Ajay Mandlekar, Li Fei-Fei, Silvio Savarese, and Danfei Xu. 2021. Generalization through hand-eye coordination: An action space for learning spatially-invariant visuomotor control. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 8913--8920.
[49]
Daniel M Wolpert, Jörn Diedrichsen, and J Randall Flanagan. 2011. Principles of sensorimotor learning. Nature reviews neuroscience, Vol. 12, 12 (2011), 739--751.
[50]
Shuo Zhou and Norihisa Segawa. 2022. Method for Music Game Control Using Myoelectric Sensors. In International Conference on Entertainment Computing. Springer, 238--246.
[51]
Shuo Zhou and Norihisa Segawa. 2023. Method of Electrical Muscle Stimulation for Training FPS Game Players in the Timing of Shots. Proceedings of the ACM on Human-Computer Interaction, Vol. 7, CHI PLAY (2023), 1234--1252.
[52]
Shuo Zhou and Norihisa Segawa. 2024. Electrical Muscle Stimulation-Based Approach for Enhancing Hand-eye Coordination Training. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. 1--6.
[53]
MJ Zwarts, G Bleijenberg, and BGM Van Engelen. 2008. Clinical neurophysiology of fatigue. Clinical neurophysiology, Vol. 119, 1 (2008), 2--10.

Cited By

View all

Index Terms

  1. Method of Electrical Muscle Stimulation to Improve Hand-eye Coordination Training in Gaming

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Proceedings of the ACM on Human-Computer Interaction
      Proceedings of the ACM on Human-Computer Interaction  Volume 8, Issue CHI PLAY
      CHI PLAY
      October 2024
      1726 pages
      EISSN:2573-0142
      DOI:10.1145/3700823
      Issue’s Table of Contents
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 15 October 2024
      Published in PACMHCI Volume 8, Issue CHI PLAY

      Check for updates

      Author Tags

      1. attention
      2. electrical muscle stimulation
      3. ems
      4. game
      5. hand control
      6. hand-eye coordination
      7. motion perception
      8. sensorimotor
      9. training

      Qualifiers

      • Research-article

      Funding Sources

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)186
      • Downloads (Last 6 weeks)59
      Reflects downloads up to 29 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Full Access

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media