poster

Adapting Fitts’ Law and N-Back to Assess Hand Proprioception

Authors:

Tamil Selvan Gunasekaran,

Chloe Dolma Si Ying Haigh,

Danielle Lottridge,

Mark BillinghurstAuthors Info & Claims

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 245, Pages 1 - 7

https://doi.org/10.1145/3411763.3451699

Published: 08 May 2021 Publication History

Abstract

Proprioception is the body’s ability to sense the position and movement of each limb, as well as the amount of effort exerted onto or by them. Methods to assess proprioception have been introduced before, yet there is little to no study on assessing the degree of proprioception on body parts for use cases like gesture recognition wearable computing. We propose the use of Fitts’ law coupled with the N-Back task to evaluate proprioception of the hand. We evaluate 15 distinct points at the back of the hand and assess the musing extended 3D Fitts’ law. Our results show that the index of difficulty of tapping point from thumb to pinky increases gradually with a linear regression factor of 0.1144. Additionally, participants perform the tap before performing the N-Back task. From these results, we discuss the fundamental limitations and suggest how Fitts’ law can be further extended to assess proprioception

Supplemental Material

M4V File

Supplemental video

Download
3.39 MB

References

[1]

Roger Adams, Kwee-Yum Lee, Gordon Wadddington, and Hae-Jung Lee. 2012. James McKeen Cattell and the method of constant stimuli in the psychophysics of movement. Proceedings of Fechner Day 28 (2012), 18–23.

[2]

Rachel F Adler and Raquel Benbunan-Fich. 2015. The effects of task difficulty and multitasking on performance. Interacting with Computers 27, 4 (2015), 430–439.

[3]

Mayra Donaji Barrera Machuca and Wolfgang Stuerzlinger. 2019. The effect of stereo display deficiencies on virtual hand pointing. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[4]

H Charlton Bastian. 1887. The “muscular sense”; its nature and cortical localisation. Brain 10, 1 (1887), 1–89.

[5]

Joanna Bergstrom-Lehtovirta, Sebastian Boring, and Kasper Hornbæk. 2017. Placing and recalling virtual items on the skin. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 1497–1507.

Digital Library

[6]

Eric Burns, Sharif Razzaque, Abigail T Panter, Mary C Whitton, Matthew R McCallus, and Frederick P Brooks. 2005. The hand is slower than the eye: A quantitative exploration of visual dominance over proprioception. In IEEE Proceedings. VR 2005. Virtual Reality, 2005.IEEE, 3–10.

[7]

Stuart K Card, William K English, and Betty J Burr. 1978. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics 21, 8 (1978), 601–613.

[8]

Yeonjoo Cha and Rohae Myung. 2013. Extended Fitts’ law for 3D pointing tasks using 3D target arrangements. International Journal of Industrial Ergonomics 43, 4(2013), 350 – 355.

[9]

Logan D Clark, Aakash B Bhagat, and Sara L Riggs. 2020. Extending Fitts’ law in three-dimensional virtual environments with current low-cost virtual reality technology. International Journal of Human-Computer Studies 139 (2020), 102413.

[10]

Barrett Ens, Aaron Quigley, Hui-Shyong Yeo, Pourang Irani, Thammathip Piumsomboon, and Mark Billinghurst. 2018. Counterpoint: Exploring Mixed-Scale Gesture Interaction for AR Applications. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems(Montreal QC, Canada) (CHI EA ’18). Association for Computing Machinery, New York, NY, USA, Article LBW120, 6 pages. https://doi.org/10.1145/3170427.3188513

Digital Library

[11]

Gustav Theodor Fechner. 1860. Elemente der psychophysik. Vol. 2. Breitkopf u. Härtel.

[12]

Paul M Fitts. 1954. The information capacity of the human motor system in controlling the amplitude of movement.Journal of experimental psychology 47, 6 (1954), 381.

[13]

Susan Foster. 2010. Choreographing empathy: Kinesthesia in performance. Routledge.

[14]

E Bruce Goldstein and James Brockmole. 2016. Sensation and perception. Cengage Learning.

[15]

Maas Goudswaard, Abel Abraham, Bruna Goveia da Rocha, Kristina Andersen, and Rong-Hao Liang. 2020. FabriClick: Interweaving Pushbuttons into Fabrics Using 3D Printing and Digital Embroidery. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. 379–393.

Digital Library

[16]

K. Gupta, R. Hajika, Y. S. Pai, A. Duenser, M. Lochner, and M. Billinghurst. 2020. Measuring Human Trust in a Virtual Assistant using Physiological Sensing in Virtual Reality. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 756–765. https://doi.org/10.1109/VR46266.2020.00099

[17]

Sean Gustafson, Christian Holz, and Patrick Baudisch. 2011. Imaginary phone: learning imaginary interfaces by transferring spatial memory from a familiar device. In Proceedings of the 24th annual ACM symposium on User interface software and technology. 283–292.

Digital Library

[18]

Sean G Gustafson, Bernhard Rabe, and Patrick M Baudisch. 2013. Understanding palm-based imaginary interfaces: the role of visual and tactile cues when browsing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 889–898.

Digital Library

[19]

Jia Han, Gordon Waddington, Roger Adams, Judith Anson, and Yu Liu. 2016. Assessing proprioception: a critical review of methods. Journal of Sport and Health Science 5, 1 (2016), 80–90.

[20]

Susan Hillier, Maarten Immink, and Dominic Thewlis. 2015. Assessing proprioception: a systematic review of possibilities. Neurorehabilitation and neural repair 29, 10 (2015), 933–949.

[21]

Errol R Hoffmann. 1991. A comparison of hand and foot movement times. Ergonomics 34, 4 (1991), 397–406.

[22]

Masahiko Izumizaki, Mikio Tsuge, Lena Akai, Uwe Proske, and Ikuo Homma. 2010. The illusion of changed position and movement from vibrating one arm is altered by vision or movement of the other arm. The Journal of physiology 588, 15 (2010), 2789–2800.

[23]

Roland S Johansson and AB Vallbo. 1979. Tactile sensibility in the human hand: relative and absolute densities of four types of mechanoreceptive units in glabrous skin.The Journal of physiology 286, 1 (1979), 283–300.

[24]

Chang-Yong Kim, Jong-Duk Choi, and Hyeong-Dong Kim. 2014. No correlation between joint position sense and force sense for measuring ankle proprioception in subjects with healthy and functional ankle instability. Clinical Biomechanics 29, 9 (2014), 977–983.

[25]

Wayne K Kirchner. 1958. Age differences in short-term retention of rapidly changing information.Journal of experimental psychology 55, 4 (1958), 352.

[26]

Matthew R Longo and Patrick Haggard. 2010. An implicit body representation underlying human position sense. Proceedings of the National Academy of Sciences 107, 26(2010), 11727–11732.

[27]

I Scott MacKenzie. 1992. Fitts’ law as a research and design tool in human-computer interaction. Human-computer interaction 7, 1 (1992), 91–139.

Digital Library

[28]

I Scott MacKenzie. 2018. Fitts’ law. Handbook of human-computer interaction 1 (2018), 349–370.

[29]

I Scott MacKenzie and William Buxton. 1992. Extending Fitts’ law to two-dimensional tasks. In Proceedings of the SIGCHI conference on Human factors in computing systems. 219–226.

Digital Library

[30]

Joseph A Maldjian, Allan Gottschalk, Rita S Patel, John A Detre, and David C Alsop. 1999. The sensory somatotopic map of the human hand demonstrated at 4 Tesla. Neuroimage 10, 1 (1999), 55–62.

[31]

Flavia Mancini, Armando Bauleo, Jonathan Cole, Fausta Lui, Carlo A Porro, Patrick Haggard, and Gian Domenico Iannetti. 2014. Whole-body mapping of spatial acuity for pain and touch. Annals of neurology 75, 6 (2014), 917–924.

[32]

Atsuo Murata and Hirokazu Iwase. 2001. Extending Fitts’ law to a three-dimensional pointing task. Human Movement Science 20, 6 (2001), 791 – 805.

[33]

Yun Suen Pai, Tilman Dingler, and Kai Kunze. 2019. Assessing hands-free interactions for VR using eye gaze and electromyography. Virtual Reality 23, 2 (2019), 119–131.

Digital Library

[34]

Charles Sherrington. 1952. The integrative action of the nervous system. CUP Archive.

[35]

Myrim Sillevis Smitt and HA Bird. 2013. Measuring and enhancing proprioception in musicians and dancers. Clinical rheumatology 32, 4 (2013), 469–473.

[36]

Jürgen Steimle, Joanna Bergstrom-Lehtovirta, Martin Weigel, Aditya Shekhar Nittala, Sebastian Boring, Alex Olwal, and Kasper Hornbæk. 2017. On-skin interaction using body landmarks. Computer 50, 10 (2017), 19–27.

Digital Library

[37]

Yuta Sugiura, Fumihiko Nakamura, Wataru Kawai, Takashi Kikuchi, and Maki Sugimoto. 2017. Behind the palm: Hand gesture recognition through measuring skin deformation on back of hand by using optical sensors. In 2017 56th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE). IEEE, 1082–1087.

[38]

William Taube Navaraj, Carlos García Núñez, Dhayalan Shakthivel, Vincenzo Vinciguerra, Fabrice Labeau, Duncan H Gregory, and Ravinder Dahiya. 2017. Nanowire FET based neural element for robotic tactile sensing skin. Frontiers in neuroscience 11 (2017), 501.

[39]

Martin Weigel, Aditya Shekhar Nittala, Alex Olwal, and Jürgen Steimle. 2017. Skinmarks: Enabling interactions on body landmarks using conformal skin electronics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3095–3105.

Digital Library

[40]

Erwin Wu, Ye Yuan, Hui-Shyong Yeo, Aaron Quigley, Hideki Koike, and Kris M Kitani. 2020. Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. 1147–1160.

Digital Library

[41]

AS Wycherley, PS Helliwell, and HA Bird. 2005. A novel device for the measurement of proprioception in the hand. Rheumatology 44, 5 (2005), 638–641.

Cited By

Hajika RGunasekaran THaigh CPai YHayashi ELien JLottridge DBillinghurst M(2024)RadarHand: A Wrist-Worn Radar for On-Skin Touch-Based Proprioceptive GesturesACM Transactions on Computer-Human Interaction10.1145/361736531:2(1-36)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3617365
Yi XWang XLi JLi H(2023)Examining the Fine Motor Control Ability of Linear Hand Movement in Virtual Reality2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00058(427-437)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00058

Recommendations

A Fitts' law study of pupil dilations in a head-mounted display
ETRA '19: Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications

Head-mounted displays offer full control over lighting conditions. When equipped with eye tracking technology, they are well suited for experiments investigating pupil dilation in response to cognitive tasks, emotional stimuli, and motor task complexity,...
A Sitting Balance Training Robot for Trunk Rehabilitation of Acute and Subacute Stroke Patients
ICBBS '17: Proceedings of the 6th International Conference on Bioinformatics and Biomedical Science

Objective: to test the stability of a sitting balance training robot and to verify the physiological effects on trunk muscles during the robot training.

Method: fundamental experiment and robot test experiment were conducted. EMG and kinematic data were ...
A Fitts' law study of click and dwell interaction by gaze, head and mouse with a head-mounted display
COGAIN '18: Proceedings of the Workshop on Communication by Gaze Interaction

Gaze and head tracking, or pointing, in head-mounted displays enables new input modalities for point-select tasks. We conducted a Fitts' law experiment with 41 subjects comparing head pointing and gaze pointing using a 300 ms dwell (n = 22) or click (n =...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

2965 pages

ISBN:9781450380959

DOI:10.1145/3411763

Editors:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
304
Total Downloads

Downloads (Last 12 months)49
Downloads (Last 6 weeks)7

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hajika RGunasekaran THaigh CPai YHayashi ELien JLottridge DBillinghurst M(2024)RadarHand: A Wrist-Worn Radar for On-Skin Touch-Based Proprioceptive GesturesACM Transactions on Computer-Human Interaction10.1145/361736531:2(1-36)Online publication date: 29-Jan-2024
https://dl.acm.org/doi/10.1145/3617365
Yi XWang XLi JLi H(2023)Examining the Fine Motor Control Ability of Linear Hand Movement in Virtual Reality2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR55154.2023.00058(427-437)Online publication date: Mar-2023
https://doi.org/10.1109/VR55154.2023.00058

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents