research-article

See me, see you: a lightweight method for discriminating user touches on tabletop displays

Authors:

Xing-Dong Yang,

Hai-Ning Liang,

Pierre Boulanger,

Pourang IraniAuthors Info & Claims

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2327 - 2336

https://doi.org/10.1145/2207676.2208392

Published: 05 May 2012 Publication History

Abstract

Tabletop systems provide a versatile space for collaboration, yet, in many cases, are limited by the inability to differentiate the interactions of simultaneous users. We present See Me, See You, a lightweight approach for discriminating user touches on a vision-based tabletop. We contribute a valuable characterization of finger orientation distributions of tabletop users. We exploit this biometric trait with a machine learning approach to allow the system to predict the correct position of users as they touch the surface. We achieve accuracies as high as 98% in simple situations and above 92% in more challenging conditions, such as two-handed tasks. We show high acceptance from users, who can self-correct prediction errors without significant costs. See Me, See You is a viable solution for providing simple yet effective support for multi-user application features on tabletops.

Supplementary Material

MP4 File (paperfile1788-3.mp4)

Supplemental video for “See me, see you: a lightweight method for discriminating user touches on tabletop displays”

Download
62.42 MB

References

[1]

Annett, M., Grossman, T. and Fitzmaurice, G. Medusa: A proximity-aware multi-touch tabletop. In Proc. UIST'11 337--346.

Digital Library

[2]

Chang, C.-C. and Lin, C.-J. LIBSVM - A Library for Support Vector Machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm.

Digital Library

[3]

Dang, C. T., Straub, M. and Andre, E. Hand distinction for multi-touch tabletop interaction. In Proc. ITS'09, 101--108.

Digital Library

[4]

Dang, C. T. and Andre, E. Usage and recognition of finger orientation for multi-touch tabletop interaction. In Proc. INTERACT'11, 409--426.

Digital Library

[5]

Dietz, P. H. and Leigh, D. 2001. DiamondTouch: A multi-user touch technology. In Proc. UIST'01, 245--252.

Digital Library

[6]

Dohse, K. C., Dohse, T., Still, J. D. and Parkhurst, D. J. 2008. Enhancing multi-user interaction with multi-touch tabletop displays using hand tracking. In Proc. ACHI'08, 297--302.

Digital Library

[7]

Han, J. Y. Low-cost multi-touch sensing through frustrated total internal reflection. In Proc. UIST'05, 115--118.

Digital Library

[8]

Holz, C. and Baudisch, P. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. In Proc. CHI'09, 581--590.

Digital Library

[9]

Kaltenbrunner, M., Bovermann, T., Bencina, R. and Costanza, E. TUIO. http://www.tuio.org.

[10]

Kin, K., Agrawala, M. and DeRose, T. Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation. In Proc. GI'09, 119--124.

Digital Library

[11]

Marquardt, N., Kiemer, J. and Greenberg, S. What caused that touch? Expressive interaction with a surface through fiduciary-tagged gloves. In Proc. ITS'10, 139--142.

Digital Library

[12]

Meyer, T. and Schmidt, D. IdWristbands: IR-based user identification on multi-touch surfaces. In Proc. ITS'10, 277--278.

Digital Library

[13]

Morris, M. R., Paepcke, A., Winograd, T. and Stamberger, J. TeamTag: Exploring centralized versus replicated controls for co-located tabletop groupware. In Proc. CHI'06, 1273--1282.

Digital Library

[14]

Müller-Tomfelde, C. (ed.) 2010. Tables - Horizontal Interactive Displays. Springer.

Digital Library

[15]

Partridge, G. and Irani, P. IdenTTop: A flexible platform for exploring identity-enabled surfaces. In Proc. CHI EA'09, 4411--4416.

Digital Library

[16]

Piper, A. M., O'Brien, E., Morris, M. R. and Winograd, T. SIDES: A cooperative tabletop computer game for social skills development. In Proc. CSCW'06, 1--10.

Digital Library

[17]

PixelSense. http://www.samsunglfd.com/product/feature.do?modelCd=SUR40. accessed on January 2012.

[18]

Roth, V., Schmidt, P. and Güldenring, B. The IR Ring: Authenticating users' touches on a multi-touch display. In Proc. UIST'10, 259--262.

Digital Library

[19]

Schmidt, D., Chong, M. K. and Gellersen, H. IdLenses: Dynamic personal areas on shared surfaces. In Proc. of ITS'10, 131--134.

Digital Library

[20]

Schoning, J., Hook, J., Motamedi, N., Oliver, P., Echtler, F., Brandl, P., Muller, L., Daiber, F., Hilliges, O., Loechtefeld, M., Roth, T., Schmidt, D. and von Zadow, U. Building interactive multi-touch surfaces. Journal of Graphics, GPU, and Game Tools, 14, 3 (2010), 35--55.

[21]

Scott, S. D. Territory-based interaction techniques for tabletop collaboration. In Proc. UIST'03, 13--20.

[22]

Wang, F., Cao, X., Ren, X. and Irani, P. 2009. Detecting and leveraging finger orientation for interaction with direct-touch surfaces. In Proc. UIST'09, 23--32.

Digital Library

Cited By

Vogelsang JKiss FMayer S(2021)A Design Space for User Interface Elements using Finger Orientation InputProceedings of Mensch und Computer 202110.1145/3473856.3473862(1-10)Online publication date: 5-Sep-2021
https://dl.acm.org/doi/10.1145/3473856.3473862
Suto SWatanabe TShibusawa SKamada M(2018)Multi-Touch Tabletop System Using Infrared Image Recognition for User Position IdentificationSensors10.3390/s1805155918:5(1559)Online publication date: 14-May-2018
https://doi.org/10.3390/s18051559
Goguey ACasiez GVogel DGutwin CMandryk RHancock MPerry MCox A(2018)Characterizing Finger Pitch and Roll Orientation During Atomic Touch ActionsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174163(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174163
Show More Cited By

Index Terms

See me, see you: a lightweight method for discriminating user touches on tabletop displays
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

PERCs: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

Tangible objects on capacitive multi-touch surfaces are usually only detected while the user is touching them. When the user lets go of such a tangible, the system cannot distinguish whether the user just released the tangible, or picked it up and ...
PERCs Demo: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays
ITS '15: Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces

Tangible objects on capacitive multi-touch surfaces are usually only detected while the user is touching them. When the user lets go of such a tangible, the system cannot distinguish whether the user just released the tangible, or picked it up and ...
SLAP widgets: bridging the gap between virtual and physical controls on tabletops
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present Silicone iLluminated Active Peripherals (SLAP), a system of tangible, translucent widgets for use on multitouch tabletops. SLAP Widgets are cast from silicone or made of acrylic, and include sliders, knobs, keyboards, and buttons. They add ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2012

3276 pages

ISBN:9781450310154

DOI:10.1145/2207676

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
598
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vogelsang JKiss FMayer S(2021)A Design Space for User Interface Elements using Finger Orientation InputProceedings of Mensch und Computer 202110.1145/3473856.3473862(1-10)Online publication date: 5-Sep-2021
https://dl.acm.org/doi/10.1145/3473856.3473862
Suto SWatanabe TShibusawa SKamada M(2018)Multi-Touch Tabletop System Using Infrared Image Recognition for User Position IdentificationSensors10.3390/s1805155918:5(1559)Online publication date: 14-May-2018
https://doi.org/10.3390/s18051559
Goguey ACasiez GVogel DGutwin CMandryk RHancock MPerry MCox A(2018)Characterizing Finger Pitch and Roll Orientation During Atomic Touch ActionsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174163(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174163
Kharrufa APloetz TOlivier P(2017)A Unified Model for User Identification on Multi-Touch Surfaces: A Survey and Meta-AnalysisACM Transactions on Computer-Human Interaction10.1145/314456924:6(1-39)Online publication date: 19-Dec-2017
https://dl.acm.org/doi/10.1145/3144569
Evans ADavis KFogarty JWobbrock JMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Group TouchProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025793(35-47)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025793
Sahdev SForlines CJota RDe Araujo BMoseley BDeber JSanders SLeigh DWigdor DMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)GhostIDProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025719(15-27)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025719
Döweling STahiri TRiemann JMühlhäuser M(2017)Collaborative Interaction with Geospatial Data—A Comparison of Paper Maps, Desktop GIS and Interactive TabletopsCollaboration Meets Interactive Spaces10.1007/978-3-319-45853-3_14(319-348)Online publication date: 10-Jan-2017
https://doi.org/10.1007/978-3-319-45853-3_14
Leftheriotis IChorianopoulos KJaccheri L(2016)Design and implement chords and personal windows for multi-user collaboration on a large multi-touch vertical displayHuman-centric Computing and Information Sciences10.1186/s13673-016-0070-56:1(1-19)Online publication date: 1-Dec-2016
https://dl.acm.org/doi/10.1186/s13673-016-0070-5
Webb APahud MHinckley KBuxton BRekimoto JIgarashi TWobbrock JAvrahami D(2016)Wearables as Context for Guiard-abiding Bimanual TouchProceedings of the 29th Annual Symposium on User Interface Software and Technology10.1145/2984511.2984564(287-300)Online publication date: 16-Oct-2016
https://dl.acm.org/doi/10.1145/2984511.2984564
Vazquez-Alvarez YAylett MBrewster SJungenfeld RVirolainen A(2015)Designing Interactions with Multilevel Auditory Displays in Mobile Audio-Augmented RealityACM Transactions on Computer-Human Interaction10.1145/282994423:1(1-30)Online publication date: 31-Dec-2015
https://dl.acm.org/doi/10.1145/2829944
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents