Representing microgestures interaction for wearable computing
Article No.: 40, Pages 1 - 4
Abstract
Microgestures, i.e. fast and subtle movements of the fingers, offer always available and versatile interaction that makes them promising for wearable computing. While research has been done to define sets of microgestures and sensing systems, we do not know how to best represent microgestures and their associated commands which is essential for the adoption of microgesture interaction. Thus, this thesis focuses on how microgestures and their corresponding commands can be represented to users and discovered by them.
References
[1]
Axel Antoine, Sylvain Malacria, Nicolai Marquardt, and Géry Casiez. 2021. Interaction Illustration Taxonomy: Classification of Styles and Techniques for Visually Representing Interaction Scenarios. In CHI 2021 - ACM Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3411764.3445586
[2]
Ronald Baecker, Ian Small, and Richard Mander. 1991. Bringing icons to life. In Proceedings of the SIGCHI conference on Human factors in computing systems Reaching through technology - CHI ’91. ACM Press, New Orleans, Louisiana, United States, 1–6. https://doi.org/10.1145/108844.108845
[3]
Jacques Bertin. 2011. Semiology of Graphics: Diagrams, Networks, Maps. Esri Press. https://www.esri.com/en-us/esri-press/browse/semiology-of-graphics-diagrams-networks-maps
[4]
Roger Boldu, Alexandru Dancu, Denys Matthies, Pablo Cascon, Shanaka Ransir, and Suranga Nanayakkara. 2018. Thumb-In-Motion: Evaluating Thumb-to-Ring Microgestures for Athletic Activity. In Proceedings of the Symposium on Spatial User Interaction. Association for Computing Machinery, 150–157. https://doi.org/10.1145/3267782.3267796
[5]
Adrien Chaffangeon, Alix Goguey, and Laurence Nigay. 2022. µGlyphe: une Notation Graphique pour Décrire les Microgestes. In 33ème conférence internationale francophone sur l’Interaction Humain-Machine (IHM’22). https://hal.archives-ouvertes.fr/hal-03655062
[6]
Amira Chalbi, Jacob Ritchie, Deokgun Park, Jungu Choi, Nicolas Roussel, Niklas Elmqvist, and Fanny Chevalier. 2019. Common Fate for Animated Transitions in Visualization. IEEE Transactions on Visualization and Computer Graphics (2019), 1–1. https://doi.org/10.1109/TVCG.2019.2934288
[7]
Edwin Chan, Teddy Seyed, Wolfgang Stuerzlinger, Xing-Dong Yang, and Frank Maurer. 2016. User Elicitation on Single-hand Microgestures. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, San Jose California USA, 3403–3414. https://doi.org/10.1145/2858036.2858589
[8]
Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: private and subtle interaction using fingertips. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, St. Andrews Scotland, United Kingdom, 255–260. https://doi.org/10.1145/2501988.2502016
[9]
M. Chen, S. Walton, K. Berger, J. Thiyagalingam, B. Duffy, H. Fang, C. Holloway, and A. E. Trefethen. 2014. Visual Multiplexing: Visual Multiplexing. Computer Graphics Forum 33, 3 (June 2014), 241–250. https://doi.org/10.1111/cgf.12380
[10]
Jamie Enoch, Leanne McDonald, Lee Jones, Pete R. Jones, and David P. Crabb. 2019. Evaluating Whether Sight Is the Most Valued Sense. JAMA Ophthalmology 137, 11 (Nov. 2019), 1317. https://doi.org/10.1001/jamaophthalmol.2019.3537 Number: 11.
[11]
Asaf Friedman. 2015. The Role of Visual Design in Game Design. Games and Culture 10, 3 (May 2015), 291–305. https://doi.org/10.1177/1555412014559977 Number: 3.
[12]
Huaiying Gao. 2005. The Effects of Still Images and Animated Images on Motion-Related and Non-Motion Related Learning Tasks in College Students of Different Levels of Field Dependence. Ph. D. Dissertation. Virginia Polytechnic Institute and State University.
[13]
Emmanouil Giannisakis, Gilles Bailly, Sylvain Malacria, and Fanny Chevalier. 2017. IconHK: Using Toolbar button Icons to Communicate Keyboard Shortcuts. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems(CHI ’17). Association for Computing Machinery, New York, NY, USA, 4715–4726. https://doi.org/10.1145/3025453.3025595
[14]
Michael Gleicher, Danielle Albers, Rick Walker, Ilir Jusufi, Charles D. Hansen, and Jonathan C. Roberts. 2011. Visual comparison for information visualization. Information Visualization 10, 4 (Oct. 2011), 289–309. https://doi.org/10.1177/1473871611416549
[15]
Alix Goguey, Sylvain Malacria, and Carl Gutwin. 2018. Improving Discoverability and Expert Performance in Force-Sensitive Text Selection for Touch Devices with Mode Gauges. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems(CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174051
[16]
Jeffrey T. Hansberger, Chao Peng, Shannon L. Mathis, Vaidyanath Areyur Shanthakumar, Sarah C. Meacham, Lizhou Cao, and Victoria R. Blakely. 2017. Dispelling the Gorilla Arm Syndrome: The Viability of Prolonged Gesture Interactions. In Virtual, Augmented and Mixed Reality. Vol. 10280. Springer International Publishing, Cham, 505–520. https://doi.org/10.1007/978-3-319-57987-0_41 Series Title: Lecture Notes in Computer Science.
[17]
Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. 2016. DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, San Jose California USA, 1526–1537. https://doi.org/10.1145/2858036.2858483
[18]
Waqas Javed and Niklas Elmqvist. 2012. Exploring the design space of composite visualization. In 2012 IEEE Pacific Visualization Symposium. IEEE, Songdo, Korea (South), 1–8. https://doi.org/10.1109/PacificVis.2012.6183556
[19]
Haiyan Jiang, Dongdong Weng, Zhenliang Zhang, and Feng Chen. 2019. HiFinger: One-Handed Text Entry Technique for Virtual Environments Based on Touches between Fingers. Sensors 19, 14 (July 2019), 3063. https://doi.org/10.3390/s19143063 Number: 14.
[20]
Guangchuan Li, David Rempel, Yue Liu, Weitao Song, and Carisa Harris Adamson. 2021. Design of 3D Microgestures for Commands in Virtual Reality or Augmented Reality. Applied Sciences 11, 14 (Jan. 2021), 6375. https://doi.org/10.3390/app11146375 Number: 14 Publisher: Multidisciplinary Digital Publishing Institute.
[21]
Christian Loclair and Sean Gustafson. 2010. PinchWatch: A Wearable Device for One-Handed Microinteractions. undefined (2010). https://www.semanticscholar.org/paper/PinchWatch%3A-A-Wearable-Device-for-One-Handed-Loclair-Gustafson/a13ff458d5e7461eaccec0bee2e856b93c6be172
[22]
Sehi LYi, Jaemin Jo, and Jinwook Seo. 2021. Comparative Layouts Revisited: Design Space, Guidelines, and Future Directions. IEEE Transactions on Visualization and Computer Graphics 27, 2 (Feb. 2021), 1525–1535. https://doi.org/10.1109/TVCG.2020.3030419
[23]
Eva Mackamul. 2022. Improving the Discoverability of Interactions in Interactive Systems. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. ACM, New Orleans LA USA, 1–5. https://doi.org/10.1145/3491101.3503813
[24]
Nathan Magrofuoco, Jorge-Luis Perez-Medina, Paolo Roselli, Jean Vanderdonckt, and Santiago Villarreal. 2019. Eliciting Contact-Based and Contactless Gestures With Radar-Based Sensors. IEEE Access 7 (2019), 176982–176997. https://doi.org/10.1109/ACCESS.2019.2951349
[25]
Sven Mayer, Lars Lischke, Adrian Lanksweirt, Huy Viet Le, and Niels Henze. 2018. How to communicate new input techniques. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction. ACM, Oslo Norway, 460–472. https://doi.org/10.1145/3240167.3240176
[26]
Erin McAweeney, Haihua Zhang, and Michael Nebeling. 2018. User-Driven Design Principles for Gesture Representations. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, Montreal QC Canada, 1–13. https://doi.org/10.1145/3173574.3174121
[27]
Nicole Ke Chen Pong and Sylvain Malacria. 2019. Awareness, Usage and Discovery of Swipe-revealed Hidden Widgets in iOS. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces(ISS ’19). Association for Computing Machinery, New York, NY, USA, 193–204. https://doi.org/10.1145/3343055.3359713
[28]
Manuel Prätorius, Dimitar Valkov, Ulrich Burgbacher, and Klaus Hinrichs. 2014. DigiTap: an eyes-free VR/AR symbolic input device. In Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology - VRST ’14. ACM Press, Edinburgh, Scotland, 9–18. https://doi.org/10.1145/2671015.2671029
[29]
Adwait Sharma, Joan Sol Roo, and Jürgen Steimle. 2019. Grasping Microgestures: Eliciting Single-hand Microgestures for Handheld Objects. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–13. https://doi.org/10.1145/3290605.3300632
[30]
Mohamed Soliman, Franziska Mueller, Lena Hegemann, Joan Sol Roo, Christian Theobalt, and Jürgen Steimle. 2018. FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces(ISS ’18). Association for Computing Machinery, New York, NY, USA, 177–187. https://doi.org/10.1145/3279778.3279799
[31]
Maxim Spur, Vincent Tourre, Erwan David, Guillaume Moreau, and Patrick Callet. 2020. MapStack: Exploring Multilayered Geospatial Data in Virtual Reality:. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications. SCITEPRESS - Science and Technology Publications, Valletta, Malta, 88–99. https://doi.org/10.5220/0008978600880099
[32]
Hsin-Ruey Tsai, Te-Yen Wu, Da-Yuan Huang, Min-Chieh Hsiu, Jui-Chun Hsiao, Yi-Ping Hung, Mike Y. Chen, and Bing-Yu Chen. 2017. SegTouch: Enhancing Touch Input While Providing Touch Gestures on Screens Using Thumb-To-Index-Finger Gestures. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, Denver Colorado USA, 2164–2171. https://doi.org/10.1145/3027063.3053109
[33]
Robert Walter. 2017. Whole Body Interaction with Public Displays. Springer Singapore, Singapore. https://doi.org/10.1007/978-981-10-4457-1
[34]
Jérémy Wambecke, Alix Goguey, Laurence Nigay, Lauren Dargent, Daniel Hauret, Stéphanie Lafon, and Jean-Samuel Louis de Visme. 2021. M[eye]cro: Eye-gaze+Microgestures for Multitasking and Interruptions. Proceedings of the ACM on Human-Computer Interaction 5, EICS (May 2021), 1–22. https://doi.org/10.1145/3461732 Number: EICS.
[35]
Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-mounted Displays. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (Sept. 2017), 1–21. https://doi.org/10.1145/3130978 Number: 3.
[36]
Alexandra Yeung, Siegbert Schmid, Adrian George, and Michael King. 2007. Still pictures, animations or interactivity – What is more effective for elearning?Proceedings of The Australian Conference on Science and Mathematics Education (2007). https://openjournals.library.sydney.edu.au/IISME/article/view/6355
[37]
Chun Yu, Xiaoying Wei, Shubh Vachher, Yue Qin, Chen Liang, Yueting Weng, Yizheng Gu, and Yuanchun Shi. 2019. HandSee: Enabling Full Hand Interaction on Smartphone with Front Camera-based Stereo Vision. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300935
Index Terms
- Representing microgestures interaction for wearable computing
Recommendations
Transferable Microgestures Across Hand Posture and Location Constraints: Leveraging the Middle, Ring, and Pinky Fingers
UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and TechnologyMicrogestures can enable auxiliary input when the hands are occupied. Although prior work has evaluated the comfort of microgestures performed by the index finger and thumb, these gestures cannot be performed while the fingers are constrained by specific ...
Grasping Microgestures: Eliciting Single-hand Microgestures for Handheld Objects
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsSingle-hand microgestures have been recognized for their potential to support direct and subtle interactions. While pioneering work has investigated sensing techniques and presented first sets of intuitive gestures, we still lack a systematic ...
User Elicitation on Single-hand Microgestures
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsGestural interaction has become increasingly popular, as enabling technologies continue to transition from research to retail. The mobility of miniaturized (and invisible) technologies introduces new uses for gesture recognition. This paper investigates ...
Comments
Information & Contributors
Information
Published In
September 2023
256 pages
ISBN:9781450399241
DOI:10.1145/3565066
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 September 2023
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Funding Sources
Conference
MobileHCI '23
Sponsor:
MobileHCI '23: 25th International Conference on Mobile Human-Computer Interaction
September 26 - 29, 2023
Athens, Greece
Acceptance Rates
Overall Acceptance Rate 202 of 906 submissions, 22%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 69Total Downloads
- Downloads (Last 12 months)48
- Downloads (Last 6 weeks)5
Reflects downloads up to 09 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format