demonstration

Gesture keyboard requiring only one camera

Authors:

Katsuhito FujimotoAuthors Info & Claims

UIST '11 Adjunct: Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology

Pages 9 - 10

https://doi.org/10.1145/2046396.2046402

Published: 16 October 2011 Publication History

Get Access

Abstract

In this paper, we propose a novel gesture-based virtual keyboard (Gesture Keyboard) of QWERTY key layout requiring only one camera. Gesture Keyboard tracks the user's fingers and recognizes gestures as the input, and each virtual key of it follows a corresponding finger. Therefore, it is possible to input characters at the user's preferred hand position even if displacing hands during inputting. Because Gesture Keyboard requires only one camera to obtain sensor information, keyboard-less devices can feature it easily.

Supplementary Material

JPG File (de176.jpg)

Download
14.81 KB

MOV File (de176.mov)

Download
32.83 MB

References

[1]

Emi Tamaki, et al. A Robust and Accurate 3D Hand Posture Estimation Method for Interactive Systems. Information Processing Society of Japan 2010.

Google Scholar

[2]

iPad : Apple Inc, http://www.apple.com/ipad.

Google Scholar

[3]

Japanese patent pending : patent publication number 2001--28242.

Google Scholar

[4]

Juan Pablo Wachs, et al. Vision-Based Hand-Gesture Applications in communications of the ACM (February 2011, vol.54, No2.

Digital Library

Google Scholar

[5]

Kinect: Microsoft Corporation, http://www.xbox.com/en-US/kinec.

Google Scholar

[6]

Mathias Kolsch, et al. Keyboards without Keyboards:A Survey of Virtual Keyboards. UCSB technical Report 2002--21, July 12, 200.

Google Scholar

[7]

Vkey: Virtual Devices, Inc., http://www.virtualdevices.net/index2.htm.

Google Scholar

Cited By

View all

Maman BBermano A(2022)TypeNet: Towards Camera Enabled Touch Typing on Flat Surfaces through Self-Refinement2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV51458.2022.00064(567-576)Online publication date: Jan-2022
https://doi.org/10.1109/WACV51458.2022.00064
kumar AYadav AKumar AKumar AKaushik A(2022)Leverage Computer Vision for Cost-Effective Learning ParadigmVirtual and Augmented Reality for Automobile Industry: Innovation Vision and Applications10.1007/978-3-030-94102-4_7(129-144)Online publication date: 24-Feb-2022
https://doi.org/10.1007/978-3-030-94102-4_7
Jiang CChen J(2019)A MLP-Based Skin Segmentation Method for Fingertip Recognition2019 IEEE 5th International Conference on Computer and Communications (ICCC)10.1109/ICCC47050.2019.9064329(1690-1695)Online publication date: Dec-2019
https://doi.org/10.1109/ICCC47050.2019.9064329
Show More Cited By

Index Terms

Gesture keyboard requiring only one camera
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Gesture keyboard with a machine learning requiring only one camera
AH '12: Proceedings of the 3rd Augmented Human International Conference

In this paper, the authors propose a novel gesture-based virtual keyboard (Gesture Keyboard) that uses a standard QWERTY keyboard layout, and requires only one camera, and employs a machine learning technique. Gesture Keyboard tracks the user's fingers ...
Bimanual gesture keyboard
UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology

Gesture keyboards represent an increasingly popular way to input text on mobile devices today. However, current gesture keyboards are exclusively unimanual. To take advantage of the capability of modern multi-touch screens, we created a novel bimanual ...
The Tap Strap 2: Evaluating Performance of One-Handed Wearable Keyboard and Mouse
HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence
Abstract
This paper presents an evaluation of Tap Strap 2, a one-handed wearable keyboard that uses tap combinations to type characters. The purpose of the Tap Strap 2 is to give the user a portable keyboard that is easier to use for mobile devices than ...

Comments

Information & Contributors

Information

Published In

UIST '11 Adjunct: Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology

October 2011

108 pages

ISBN:9781450310147

DOI:10.1145/2046396

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

Overall Acceptance Rate 355 of 1,733 submissions, 20%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
928
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Maman BBermano A(2022)TypeNet: Towards Camera Enabled Touch Typing on Flat Surfaces through Self-Refinement2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV51458.2022.00064(567-576)Online publication date: Jan-2022
https://doi.org/10.1109/WACV51458.2022.00064
kumar AYadav AKumar AKumar AKaushik A(2022)Leverage Computer Vision for Cost-Effective Learning ParadigmVirtual and Augmented Reality for Automobile Industry: Innovation Vision and Applications10.1007/978-3-030-94102-4_7(129-144)Online publication date: 24-Feb-2022
https://doi.org/10.1007/978-3-030-94102-4_7
Jiang CChen J(2019)A MLP-Based Skin Segmentation Method for Fingertip Recognition2019 IEEE 5th International Conference on Computer and Communications (ICCC)10.1109/ICCC47050.2019.9064329(1690-1695)Online publication date: Dec-2019
https://doi.org/10.1109/ICCC47050.2019.9064329
Choi DCho HSeo KLee SLee JKo J(2019)Designing Hand Pose Aware Virtual Keyboard With Hand Drift ToleranceIEEE Access10.1109/ACCESS.2019.29293107(96035-96047)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2929310
Lee SSeo Y(2019)Vision-Based Virtual Joystick InterfaceComputational Science/Intelligence and Applied Informatics10.1007/978-3-030-25225-0_5(65-78)Online publication date: 26-Jul-2019
https://doi.org/10.1007/978-3-030-25225-0_5
Ji HChen JLin QLi A(2018)A Local Fingertips Movement and Fingertips Clustering Based Virtual Keyboard Adopting a CameraProceedings of the 2018 International Conference on Computing and Pattern Recognition10.1145/3232829.3232840(61-67)Online publication date: 23-Jun-2018
https://dl.acm.org/doi/10.1145/3232829.3232840
Sun KWang WLiu ADai H(2018)Depth Aware Finger Tapping on Virtual DisplaysProceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services10.1145/3210240.3210315(283-295)Online publication date: 10-Jun-2018
https://dl.acm.org/doi/10.1145/3210240.3210315
Yin YLi QXie LYi SNovak ELu S(2018)CamK: Camera-Based Keystroke Detection and Localization for Small Mobile DevicesIEEE Transactions on Mobile Computing10.1109/TMC.2018.279863517:10(2236-2251)Online publication date: 1-Oct-2018
https://doi.org/10.1109/TMC.2018.2798635
Yin YLi QXie LYi SNovak ELu S(2016)CamK: A camera-based keyboard for small mobile devicesIEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications10.1109/INFOCOM.2016.7524400(1-9)Online publication date: Apr-2016
https://doi.org/10.1109/INFOCOM.2016.7524400
Choi DCho HCheong JLatulipe CHartmann BGrossman T(2015)Improving Virtual Keyboards When All Finger Positions Are KnownProceedings of the 28th Annual ACM Symposium on User Interface Software & Technology10.1145/2807442.2807491(529-538)Online publication date: 5-Nov-2015
https://dl.acm.org/doi/10.1145/2807442.2807491
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Gesture keyboard with a machine learning requiring only one camera

Bimanual gesture keyboard

The Tap Strap 2: Evaluating Performance of One-Handed Wearable Keyboard and Mouse