research-article

A Design Space for User Interface Elements using Finger Orientation Input

Authors:

Jonas Vogelsang,

Francisco Kiss,

Sven MayerAuthors Info & Claims

MuC '21: Proceedings of Mensch und Computer 2021

Pages 1 - 10

https://doi.org/10.1145/3473856.3473862

Published: 13 September 2021 Publication History

Abstract

Despite touchscreens being used by billions of people every day, today’s touch-based interactions are limited in their expressiveness as they mostly reduce the rich information of the finger down to a single 2D point. Researchers have proposed using finger orientation as input to overcome these limitations, adding two extra dimensions – the finger’s pitch and yaw angles. While finger orientation has been studied in-depth over the last decade, we describe an updated design space. Therefore, we present expert interviews combined with a literature review to describe the wide range of finger orientation input opportunities. First, we present a comprehensive set of finger orientation input enhanced user interface elements supported by expert interviews. Second, we extract design implications as a result of the additional input parameters. Finally, we introduce a design space for finger orientation input.

References

[1]

Rami Ajaj, Frédéric Vernier, and Christian Jacquemin. 2009. Follow My Finger Navigation. In Human-Computer Interaction – INTERACT 2009(INTERACT ’09). Springer Berlin Heidelberg, Berlin, Heidelberg, 228–231. https://doi.org/10.1007/978-3-642-03658-3_29

[2]

Tobias Boceck, Sascha Sprott, Huy Viet Le, and Sven Mayer. 2019. Force Touch Detection on Capacitive Sensors using Deep Neural Networks. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’19). ACM, NY, USA, 6. https://doi.org/10.1145/3338286.3344389

Digital Library

[3]

Sebastian Boring, David Ledo, Xiang ’Anthony’ Chen, Nicolai Marquardt, Anthony Tang, and Saul Greenberg. 2012. The Fat Thumb: Using the Thumb’s Contact Size for Single-handed Mobile Interaction. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services (San Francisco, California, USA) (MobileHCI ’12). ACM, NY, USA, 39–48. https://doi.org/10.1145/2371574.2371582

Digital Library

[4]

Xiang Cao, A. D. Wilson, R. Balakrishnan, K. Hinckley, and S. E. Hudson. 2008. ShapeTouch: Leveraging contact shape on interactive surfaces. In 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems(TABLETOP 2008). 129–136. https://doi.org/10.1109/TABLETOP.2008.4660195

[5]

Stuart K. Card, Jock D. Mackinlay, and George G. Robertson. 1990. The Design Space of Input Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Seattle, Washington, USA) (CHI ’90). ACM, NY, USA, 117–124. https://doi.org/10.1145/97243.97263

Digital Library

[6]

Ashley Colley and Jonna Häkkilä. 2014. Exploring Finger Specific Touch Screen Interaction for Mobile Phone User Interfaces. In Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: The Future of Design (Sydney, New South Wales, Australia) (OzCHI ’14). ACM, NY, USA, 539–548. https://doi.org/10.1145/2686612.2686699

Digital Library

[7]

Christian Corsten, Simon Voelker, Andreas Link, and Jan Borchers. 2018. Use the Force Picker, Luke: Space-Efficient Value Input on Force-Sensitive Mobile Touchscreens. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174235

Digital Library

[8]

James L. Crowley, François Bérard, and Joëlle Coutaz Joëlle. 1995. Finger Tracking as an Input Device for Augmented Reality. In Proceedings of the International Workshop on Face and Gesture Recognition (Zurich, Switzerland) (the International Workshop on Face and Gesture Recognition). 195–200.

[9]

Chi Tai Dang and Elisabeth André. 2011. Usage and Recognition of Finger Orientation for Multi-Touch Tabletop Interaction. In Human-Computer Interaction – INTERACT 2011(INTERACT ’11). Springer Berlin Heidelberg, Berlin, Heidelberg, 409–426.

[10]

Julien Epps, Serge Lichman, and Mike Wu. 2006. A Study of Hand Shape Use in Tabletop Gesture Interaction. In CHI ’06 Extended Abstracts on Human Factors in Computing Systems (Montréal, Québec, Canada) (CHI EA ’06). ACM, NY, USA, 748–753. https://doi.org/10.1145/1125451.1125601

[11]

Dustin Freeman, Hrvoje Benko, Meredith Ringel Morris, and Daniel Wigdor. 2009. ShadowGuides: Visualizations for in-Situ Learning of Multi-Touch and Whole-Hand Gestures. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Banff, Alberta, Canada) (ITS ’09). ACM, NY, USA, 165–172. https://doi.org/10.1145/1731903.1731935

Digital Library

[12]

Hyunjae Gil, Hongmin Kim, and Ian Oakley. 2018. Fingers and Angles: Exploring the Comfort of Touch Input on Smartwatches. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 4, Article 164 (Dec. 2018), 21 pages. https://doi.org/10.1145/3287042

Digital Library

[13]

Alix Goguey, Géry Casiez, Daniel Vogel, and Carl Gutwin. 2018. Characterizing Finger Pitch and Roll Orientation During Atomic Touch Actions. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, NY, USA, Article 589, 12 pages. https://doi.org/10.1145/3173574.3174163

Digital Library

[14]

Alix Goguey, Sylvain Malacria, and Carl Gutwin. 2018. Improving Discoverability and Expert Performance in Force-Sensitive Text Selection for Touch Devices with Mode Gauges. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174051

Digital Library

[15]

Donatien Grolaux, Jean Vanderdonckt, Thanh-Diane Nguyen, and Iyad Khaddam. 2020. SketchADoodle: Touch-Surface Multi-Stroke Gesture Handling by Bézier Curves. Proc. ACM Hum.-Comput. Interact. 4, EICS, Article 87(2020), 30 pages. https://doi.org/10.1145/3397875

Digital Library

[16]

Anhong Guo, Robert Xiao, and Chris Harrison. 2015. CapAuth: Identifying and Differentiating User Handprints on Commodity Capacitive Touchscreens. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (Madeira, Portugal) (ITS ’15). ACM, NY, USA, 59–62. https://doi.org/10.1145/2817721.2817722

Digital Library

[17]

Aakar Gupta, Muhammed Anwar, and Ravin Balakrishnan. 2016. Porous Interfaces for Small Screen Multitasking Using Finger Identification. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). ACM, NY, USA, 145–156. https://doi.org/10.1145/2984511.2984557

Digital Library

[18]

Aakar Gupta and Ravin Balakrishnan. 2016. DualKey: Miniature Screen Text Entry via Finger Identification. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). ACM, NY, USA, 59–70. https://doi.org/10.1145/2858036.2858052

Digital Library

[19]

Gunnar Harboe and Elaine M. Huang. 2015. Real-World Affinity Diagramming Practices: Bridging the Paper-Digital Gap. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). ACM, NY, USA, 95–104. https://doi.org/10.1145/2702123.2702561

Digital Library

[20]

Chris Harrison, Julia Schwarz, and Scott E. Hudson. 2011. TapSense: Enhancing Finger Interaction on Touch Surfaces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11). ACM, NY, USA, 627–636. https://doi.org/10.1145/2047196.2047279

Digital Library

[21]

Chris Harrison, Robert Xiao, Julia Schwarz, and Scott E. Hudson. 2014. TouchTools: Leveraging Familiarity and Skill with Physical Tools to Augment Touch Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI ’14). ACM, NY, USA, 2913–2916. https://doi.org/10.1145/2556288.2557012

Digital Library

[22]

Christopher F. Herot and Guy Weinzapfel. 1978. One-Point Touch Input of Vector Information for Computer Displays. SIGGRAPH Comput. Graph. 12, 3 (Aug. 1978), 210–216. https://doi.org/10.1145/965139.807392

Digital Library

[23]

Christian Holz, Senaka Buthpitiya, and Marius Knaust. 2015. Bodyprint: Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). ACM, NY, USA, 3011–3014. https://doi.org/10.1145/2702123.2702518

Digital Library

[24]

Lei Jing, Zixue Cheng, Yinghui Zhou, Junbo Wang, and Tongjun Huang. 2013. Magic Ring: A Self-Contained Gesture Input Device on Finger. In Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia (Luleå, Sweden) (MUM ’13). ACM, NY, USA, Article 39, 4 pages. https://doi.org/10.1145/2541831.2541875

Digital Library

[25]

Kenrick Kin, Björn Hartmann, Tony DeRose, and Maneesh Agrawala. 2012. Proton++: A Customizable Declarative Multitouch Framework. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). ACM, NY, USA, 477–486. https://doi.org/10.1145/2380116.2380176

Digital Library

[26]

Sven Kratz, Patrick Chiu, and Maribeth Back. 2013. PointPose: Finger Pose Estimation for Touch Input on Mobile Devices Using a Depth Sensor. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (St. Andrews, Scotland, United Kingdom) (ITS ’13). ACM, NY, USA, 223–230. https://doi.org/10.1145/2512349.2512824

Digital Library

[27]

Russell Kruger, Sheelagh Carpendale, Stacey D. Scott, and Anthony Tang. 2005. Fluid Integration of Rotation and Translation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA) (CHI ’05). ACM, NY, USA, 601–610. https://doi.org/10.1145/1054972.1055055

Digital Library

[28]

Huy Viet Le, Thomas Kosch, Patrick Bader, Sven Mayer, and Niels Henze. 2018. PalmTouch: Using the Palm as an Additional Input Modality on Commodity Smartphones. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). ACM, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173934

Digital Library

[29]

Huy Viet Le, Sven Mayer, and Niels Henze. 2019. Investigating the Feasibility of Finger Identification on Capacitive Touchscreens using Deep Learning. In Proceedings of the 24th International Conference on Intelligent User Interfaces (2019-03-17) (IUI ’19). ACM, Marina del Ray, CA, USA. https://doi.org/10.1145/3301275.3302295

Digital Library

[30]

Jock Mackinlay, Stuart K Card, and George G Robertson. 1990. A semantic analysis of the design space of input devices. Human–Computer Interaction 5, 2-3 (1990), 145–190.

[31]

Allan MacLean, Richard M. Young, Victoria M.E. Bellotti, and Thomas P. Moran. 1991. Questions, Options, and Criteria: Elements of Design Space Analysis. Human–Computer Interaction 6, 3-4 (1991), 201–250. https://doi.org/10.1080/07370024.1991.9667168

[32]

Shahzad Malik and Joe Laszlo. 2004. Visual Touchpad: A Two-Handed Gestural Input Device. In Proceedings of the 6th International Conference on Multimodal Interfaces (State College, PA, USA) (ICMI ’04). ACM, NY, USA, 289–296. https://doi.org/10.1145/1027933.1027980

Digital Library

[33]

Nicolai Marquardt, Johannes Kiemer, David Ledo, Sebastian Boring, and Saul Greenberg. 2011. Designing User-, Hand-, and Handpart-Aware Tabletop Interactions with the TouchID Toolkit. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan) (ITS ’11). ACM, NY, USA, 21–30. https://doi.org/10.1145/2076354.2076358

Digital Library

[34]

Fabrice Matulic, Daniel Vogel, and Raimund Dachselt. 2017. Hand Contact Shape Recognition for Posture-Based Tabletop Widgets and Interaction. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces(Brighton, United Kingdom) (ISS ’17). ACM, NY, USA, 3–11. https://doi.org/10.1145/3132272.3134126

Digital Library

[35]

Sven Mayer, Perihan Gad, Katrin Wolf, Paweł W. Woźniak, and Niels Henze. 2017. Understanding the Ergonomic Constraints in Designing for Touch Surfaces. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (Vienna, Austria) (MobileHCI ’17). ACM, NY, USA, Article 33, 9 pages. https://doi.org/10.1145/3098279.3098537

Digital Library

[36]

Sven Mayer, Huy Viet Le, and Niels Henze. 2017. Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces(ISS ’17). ACM, Brighton, United Kingdom, 220–229. https://doi.org/10.1145/3132272.3134130

Digital Library

[37]

Sven Mayer, Huy Viet Le, and Niels Henze. 2018. Designing Finger Orientation Input for Mobile Touchscreens. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (Barcelona, Spain) (MobileHCI ’18). ACM, NY, USA, Article 29, 9 pages. https://doi.org/10.1145/3229434.3229444

Digital Library

[38]

Sven Mayer, Lars Lischke, Adrian Lanksweirt, Huy Viet Le, and Niels Henze. 2018. How to Communicate New Input Techniques. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction (Oslo, Norway) (NordiCHI ’18). ACM, NY, USA, 460–472. https://doi.org/10.1145/3240167.3240176

Digital Library

[39]

Sven Mayer, Michael Mayer, and Niels Henze. 2017. Feasibility Analysis of Detecting the Finger Orientation with Depth Cameras. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct(MobileHCI’17). ACM, NY, USA, 82:1–82:8. https://doi.org/10.1145/3098279.3122125

Digital Library

[40]

Sundar Murugappan, Vinayak, Niklas Elmqvist, and Karthik Ramani. 2012. Extended Multitouch: Recovering Touch Posture and Differentiating Users Using a Depth Camera. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (Cambridge, Massachusetts, USA) (UIST ’12). ACM, NY, USA, 487–496. https://doi.org/10.1145/2380116.2380177

Digital Library

[41]

Anh Nguyen and Amy Banic. 2015. 3DTouch: A wearable 3D input device for 3D applications. In 2015 IEEE Virtual Reality(VR ’15). 55–61.

[42]

Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic Books (AZ).

Digital Library

[43]

Ian Oakley, Carina Lindahl, Khanh Le, DoYoung Lee, and MD. Rasel Islam. 2016. The Flat Finger: Exploring Area Touches on Smartwatches. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (Santa Clara, California, USA) (CHI ’16). ACM, NY, USA, 4238–4249. https://doi.org/10.1145/2858036.2858179

Digital Library

[44]

Qeexo. 2020 (accessed April 12, 2020). FingerAngle. https://qeexo.com/fingerangle/

[45]

Simon Rogers, John Williamson, Craig Stewart, and Roderick Murray-Smith. 2011. AnglePose: Robust, Precise Capacitive Touch Tracking via 3D Orientation Estimation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). ACM, NY, USA, 2575–2584. https://doi.org/10.1145/1978942.1979318

Digital Library

[46]

Anne Roudaut, Eric Lecolinet, and Yves Guiard. 2009. MicroRolls: Expanding Touch-screen Input Vocabulary by Distinguishing Rolls vs. Slides of the Thumb. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). ACM, NY, USA, 927–936. https://doi.org/10.1145/1518701.1518843

Digital Library

[47]

Helen Sharp. 2003. Interaction design. John Wiley & Sons.

[48]

Ben Shneiderman, Catherine Plaisant, Maxine Cohen, Steven Jacobs, Niklas Elmqvist, and Nicholas Diakopoulos. 2016. Designing the User Interface: Strategies for Effective Human-Computer Interaction (6th ed.). Pearson.

Digital Library

[49]

Yoshiki Takeoka, Takashi Miyaki, and Jun Rekimoto. 2010. Z-touch: An Infrastructure for 3D Gesture Interaction in the Proximity of Tabletop Surfaces. In ACM International Conference on Interactive Tabletops and Surfaces (Saarbrücken, Germany) (ITS ’10). ACM, NY, USA, 91–94. https://doi.org/10.1145/1936652.1936668

Digital Library

[50]

Edward Tse, Saul Greenberg, Chia Shen, and Clifton Forlines. 2007. Multimodal Multiplayer Tabletop Gaming. Comput. Entertain. 5, 2, Article 12 (April 2007), 12 pages. https://doi.org/10.1145/1279540.1279552

[51]

Feng Wang, Xiang Cao, Xiangshi Ren, and Pourang Irani. 2009. Detecting and Leveraging Finger Orientation for Interaction with Direct-touch Surfaces. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST ’09). ACM, NY, USA, 23–32. https://doi.org/10.1145/1622176.1622182

Digital Library

[52]

Feng Wang and Xiangshi Ren. 2009. Empirical Evaluation for Finger Input Properties in Multi-touch Interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). ACM, NY, USA, 1063–1072. https://doi.org/10.1145/1518701.1518864

Digital Library

[53]

Gerard Wilkinson, Ahmed Kharrufa, Jonathan Hook, Bradley Pursglove, Gavin Wood, Hendrik Haeuser, Nils Y. Hammerla, Steve Hodges, and Patrick Olivier. 2016. Expressy: Using a Wrist-worn Inertial Measurement Unit to Add Expressiveness to Touch-based Interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (Santa Clara, California, USA) (CHI ’16). ACM, NY, USA, 2832–2844. https://doi.org/10.1145/2858036.2858223

Digital Library

[54]

Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-Defined Gestures for Surface Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, MA, USA) (CHI ’09). ACM, NY, USA, 1083–1092. https://doi.org/10.1145/1518701.1518866

Digital Library

[55]

Katrin Wolf, Marilyn McGee-Lennon, and Stephen Brewster. 2012. A Study of On-device Gestures. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services Companion (San Francisco, California, USA) (MobileHCI ’12). ACM, NY, USA, 11–16. https://doi.org/10.1145/2371664.2371669

Digital Library

[56]

Mike Wu and Ravin Balakrishnan. 2003. Multi-Finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (Vancouver, Canada) (UIST ’03). ACM, NY, USA, 193–202. https://doi.org/10.1145/964696.964718

Digital Library

[57]

Mike Wu, Chia Shen, Kathy Ryall, Clifton Forlines, and Ravin Balakrishnan. 2006. Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces. In First IEEE International Workshop on Horizontal Interactive Human-Computer Systems(TABLETOP ’06). IEEE, 8 pp.https://doi.org/10.1109/TABLETOP.2006.19

Digital Library

[58]

Robert Xiao, Julia Schwarz, and Chris Harrison. 2015. Estimating 3D Finger Angle on Commodity Touchscreens. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (Madeira, Portugal) (ITS ’15). ACM, NY, USA, 47–50. https://doi.org/10.1145/2817721.2817737

Digital Library

[59]

Chun Yu, Xiaoying Wei, Shubh Vachher, Yue Qin, Chen Liang, Yueting Weng, Yizheng Gu, and Yuanchun Shi. 2019. HandSee: Enabling Full Hand Interaction on Smartphone with Front Camera-Based Stereo Vision. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). ACM, NY, USA, Article 705, 13 pages. https://doi.org/10.1145/3290605.3300935

Digital Library

[60]

Vadim Zaliva. 2012. 3D Finger Posture Detection and Gesture Recognition on Touch Surfaces. In 12th International Conference on Control Automation Robotics Vision(ICARCV ’12, December). IEEE, 359–364. https://doi.org/10.1109/ICARCV.2012.6485185

[61]

Hong Zhang, Xing-Dong Yang, Barrett Ens, Hai-Ning Liang, Pierre Boulanger, and Pourang Irani. 2012. See Me, See You: A Lightweight Method for Discriminating User Touches on Tabletop Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). ACM, NY, USA, 2327–2336. https://doi.org/10.1145/2207676.2208392

Digital Library

Cited By

Li CYu JHe KFeng JZhou J(2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659584
He KLi CDuan YFeng JZhou J(2024)TrackPoseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314597:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631459
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Show More Cited By

A Design Space for User Interface Elements using Finger Orientation Input
1. Human-centered computing

Recommendations

Usage and recognition of finger orientation for multi-touch tabletop interaction
INTERACT'11: Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III

Building on the observation that finger orientation is an inherent part of human's interaction in the real world, exploiting finger orientation for multitouch tabletop interaction would facilitate more natural interaction techniques. We motivate this by ...
Designing finger orientation input for mobile touchscreens
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services

A large number of today's systems use interactive touch surfaces as the main input channel. Current devices reduce the richness of touch input to two-dimensional positions on the screen. A growing body of work develops methods that enrich touch input to ...
Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks
ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces

In the last years, touchscreens became the most common input device for a wide range of computers. While touchscreens are truly pervasive, commercial devices reduce the richness of touch input to two-dimensional positions on the screen. Recent work ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

MuC '21: Proceedings of Mensch und Computer 2021

September 2021

613 pages

ISBN:9781450386456

DOI:10.1145/3473856

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MuC '21

MuC '21: Mensch und Computer 2021

September 5 - 8, 2021

Ingolstadt, Germany

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
216
Total Downloads

Downloads (Last 12 months)61
Downloads (Last 6 weeks)4

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li CYu JHe KFeng JZhou J(2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659584
He KLi CDuan YFeng JZhou J(2024)TrackPoseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314597:4(1-22)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631459
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Duan YYu JFeng JHe KLu JZhou J(2023)3D Finger Rotation Estimation from Fingerprint ImagesProceedings of the ACM on Human-Computer Interaction10.1145/36264677:ISS(114-134)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626467
He KDuan YFeng JZhou J(2022)Estimating 3D Finger Angle via Fingerprint ImageProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172436:1(1-22)Online publication date: 29-Mar-2022
https://dl.acm.org/doi/10.1145/3517243

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents