Work in Progress

Augmenting Indirect Multi-Touch Interaction with 3D Hand Contours and Skeletons

Authors:

Ilya Efanov,

Joel LanirAuthors Info & Claims

CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

Pages 989 - 994

https://doi.org/10.1145/2702613.2732897

Published: 18 April 2015 Publication History

Get Access

Abstract

This work in progress aims at making indirect multi-touch interaction more usable by providing 3D visualizations of the hands and fingers so the user can continuously know their positions before an interaction occurs. We use depth sensing cameras to track the user's hands above the surface and to recognize the point of interaction with a plain horizontal surface at a predefined height. This allows us to support various visual augmentation techniques such as visualizations of 3D hand contours, skeletons, and fingertips that provide visual cues for depth estimation when the hand is above the surface as well as cues for when touching the surface. The purpose is to provide the users with effective and intuitive indirect multi-touch interaction on a regular desktop PC.

References

[1]

Bi, Xiaojun, Tovi Grossman, Justin Matejka, and George Fitzmaurice. "Magic desk: bringing multi-touch surfaces into desktop work." In Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 2511--2520. ACM, 2011.

Digital Library

Google Scholar

[2]

Kim, David, Shahram Izadi, Jakub Dostal, Christoph Rhemann, Cem Keskin, Christopher Zach, Jamie Shotton et al. RetroDepth: 3D silhouette sensing for high-precision input on and above physical surfaces. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems (2014) 1377--1386. ACM.

Digital Library

Google Scholar

[3]

Knoedel, Sebastian, and Martin Hachet. Multi-touch RST in 2D and 3D spaces: Studying the impact of directness on user performance. 3D User Interfaces (3DUI), 2011 IEEE Symposium on (2011), 75--78.

Digital Library

Google Scholar

[4]

Leap Motion. https://www.leapmotion.com/

Google Scholar

[5]

Lee, J., Olwal, A., Ishii, H., and Boulanger, C. (2013). SpaceTop: Integrating 2D and Spatial 3D Interaction in See-through Desktop Environment. ACM CHI, 189--192.

Digital Library

Google Scholar

[6]

Moscovich, Tomer, and John F. Hughes. Indirect mappings of multi-touch input using one and two hands. In Proceedings of the SIGCHI conference on Human factors in computing systems (2008), 1275--1284. ACM.

Digital Library

Google Scholar

[7]

RealSense. http://www.intel.com/content/www/us/en/architectureand-technology/realsense-overview.html

Google Scholar

[8]

Schmidt, Dominik, Florian Block, and Hans Gellersen. A comparison of direct and indirect multitouch input for large surfaces. Human-Computer Interaction-INTERACT (2009), 582--594.

Digital Library

Google Scholar

[9]

Shoemaker, Garth, Anthony Tang, and Kellogg S. Booth. Shadow reaching: a new perspective on interaction for large displays. In Proceedings of the 20th annual ACM symposium on User interface software and technology (2007), 53--56. ACM.

Digital Library

Google Scholar

Cited By

View all

Sun XWang Yde Melo GGai WShi YZhao LBian YLiu JYang CMeng XBarrett RCummings RAgichtein EGabrilovich E(2017)Enabling Participatory Design of 3D Virtual Scenes on Mobile DevicesProceedings of the 26th International Conference on World Wide Web Companion10.1145/3041021.3054173(473-482)Online publication date: 3-Apr-2017
https://dl.acm.org/doi/10.1145/3041021.3054173
Son JLee G(2017)Comparison of Two Target Selection Methods for Two-Thumb Touchpad TypingInternational Journal of Human–Computer Interaction10.1080/10447318.2017.128681033:10(799-812)Online publication date: 27-Jan-2017
https://doi.org/10.1080/10447318.2017.1286810
Tomita HVasilache STanaka J(2016)Using the Office Desk as a Touch InterfaceHuman Interface and the Management of Information: Information, Design and Interaction10.1007/978-3-319-40349-6_57(585-595)Online publication date: 21-Jun-2016
https://doi.org/10.1007/978-3-319-40349-6_57

Index Terms

Augmenting Indirect Multi-Touch Interaction with 3D Hand Contours and Skeletons
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Combining Direct and Indirect Touch Input for Interactive Workspaces using Gaze Input
SUI '15: Proceedings of the 3rd ACM Symposium on Spatial User Interaction

Interactive workspaces combine horizontal and vertical touch surfaces into a single digital workspace. During an exploration of these systems, it was shown that direct interaction on the vertical surface is cumbersome and more inaccurate than on the ...
Investigating Gesture Typing for Indirect Touch

With the development of ubiquitous computing, entering text on HMDs and smart TVs using handheld touchscreen devices (e.g., smartphone and controller) is becoming more and more attractive. In these indirect touch scenarios, the touch input surface is ...
Bimanual Interaction with Interscopic Multi-Touch Surfaces
INTERACT '09: Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

Multi-touch interaction has received considerable attention in the last few years, in particular for natural two-dimensional (2D) interaction. However, many application areas deal with three-dimensional (3D) data and require intuitive 3D interaction ...

Comments

Information & Contributors

Information

Published In

CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems

April 2015

2546 pages

ISBN:9781450331463

DOI:10.1145/2702613

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Check for updates

Author Tags

Qualifiers

Work in progress

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI EA '15 Paper Acceptance Rate 379 of 1,520 submissions, 25%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
260
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Sun XWang Yde Melo GGai WShi YZhao LBian YLiu JYang CMeng XBarrett RCummings RAgichtein EGabrilovich E(2017)Enabling Participatory Design of 3D Virtual Scenes on Mobile DevicesProceedings of the 26th International Conference on World Wide Web Companion10.1145/3041021.3054173(473-482)Online publication date: 3-Apr-2017
https://dl.acm.org/doi/10.1145/3041021.3054173
Son JLee G(2017)Comparison of Two Target Selection Methods for Two-Thumb Touchpad TypingInternational Journal of Human–Computer Interaction10.1080/10447318.2017.128681033:10(799-812)Online publication date: 27-Jan-2017
https://doi.org/10.1080/10447318.2017.1286810
Tomita HVasilache STanaka J(2016)Using the Office Desk as a Touch InterfaceHuman Interface and the Management of Information: Information, Design and Interaction10.1007/978-3-319-40349-6_57(585-595)Online publication date: 21-Jun-2016
https://doi.org/10.1007/978-3-319-40349-6_57

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Combining Direct and Indirect Touch Input for Interactive Workspaces using Gaze Input

Investigating Gesture Typing for Indirect Touch

Bimanual Interaction with Interscopic Multi-Touch Surfaces