research-article

Designing for low-latency direct-touch input

Authors:

Julian Lepinski,

Steven Sanders,

Paul DietzAuthors Info & Claims

UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology

Pages 453 - 464

https://doi.org/10.1145/2380116.2380174

Published: 07 October 2012 Publication History

Abstract

Software designed for direct-touch interfaces often utilize a metaphor of direct physical manipulation of pseudo "real-world" objects. However, current touch systems typically take 50-200ms to update the display in response to a physi-cal touch action. Utilizing a high performance touch de-monstrator, subjects were able to experience touch latencies ranging from current levels down to about 1ms. Our tests show that users greatly prefer lower latencies, and noticea-ble improvement continued well below 10ms. This level of performance is difficult to achieve in commercial compu-ting systems using current technologies. As an alternative, we propose a hybrid system that provides low-fidelity visu-al feedback immediately, followed by high-fidelity visuals at standard levels of latency.

Supplementary Material

JPG File (paper_0329-file3.jpg)

Download
8.47 KB

suppl.mov (paper_0329-file3.m4v)

Supplemental video

Download
71.88 MB

References

[1]

Accot, J., and Zhai, S. 1997. Beyond Fitts law: models for trajectory based HCI tasks. Proceedings of ACM CHI'97, 295--302.

Digital Library

[2]

Anderson, G., Doherty, R., and Ganapathy, S. 2011. User Perception of Touch Screen Latency. Design, User Experience, and Usability. Theory, Methods, Tools, and Practice. 195--20

[3]

Boie, R.A. 1984. Capacitive Impedance Readout Tactile Image Sensor. Proceedings of the 1984 IEEE International Conference on Robotics and Automation, 370--378.

[4]

Card, S. K., Mackinlay, J. D., and Robertson, G. G. 1991. The Information Visualizer: An Information Workspace. Proceedings of (CHI '91), 181--188.

Digital Library

[5]

Card, S.K., Moran, T.P., and Newell, A. 1983. The Psy-chology of Human-Computer Interaction. Erlbaum, Hillsdale, NJ, USA.

Digital Library

[6]

Cornsweet, TN. 1962. The staircase-method in psycho-physics, American Journal of Psychology, 75, 485--491.

[7]

Dietz, P., and Leigh, D. 2001. DiamondTouch: multi-user touch technology. Proceedings of the UIST' 01, 219--226.

Digital Library

[8]

Ganz, L. 1975. Temporal factors in visual perception. In E. C. Carterette and M. P. Friedman, eds. Handbook of Perception, Vol. V, Seeing. New York: Academic Press

[9]

Han, J. 2005. Low-cost multi-touch sensing through frustrated total internal reflection. Proceedings of UIST '05, 115--118.

Digital Library

[10]

Harrison, B.L. and Ishii, H. and Vicente, K.J. and Bux-ton, W.A.S. 1995. Transparent layered user interfaces: An evaluation of a display design to enhance focused and divided attention. Proceedings of CHI '95, 317--324.

Digital Library

[11]

1Harter, M. R. 1967. Excitability and cortical scanning: A review of two hypotheses of central intermittency in perception. Psychological Bulletin 68, 47--58.

[12]

Jacob, R. J. K., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., and Zigelbaum. J. 2008. Reality-based interaction: a framework for post-WIMP interfaces. Proceedings of CHI '08, 201--210.

Digital Library

[13]

Kaernbach, C. 1991. Simple adaptive testing with the weighted up-down method, Perception & Psychophys-ics 49, 227--229.

[14]

Krasner, G., Pope, S. 1988. A cookbook for using the model-view controller user interface paradigm in Small-talk-80. J. Object Oriented Program. 1, 3, 26--49.

Digital Library

[15]

Levitt, H. 1971. Transformed up-down methods in psy-choacoustics. Journal of the Acoustical Society of America, 49(2): 467--477.

[16]

MacKenzie, I.S., and Ware, C. (1993). Lag as a determi-nant of human performance in interactive systems. In Proceedings of CHI '93, 488--493.

Digital Library

[17]

Microsoft Corporation. 2011. Windows Developer Pre-view: Win 8 Guide. http://windows.microsoft.com/en-US/windows-8/preview, January 2012.

[18]

Miller, R. B. 1968. Response time in man-computer conversational transactions. Fall Joint Comp. Conf. 1968, 267--277.

Digital Library

[19]

Pavlovych, A. C. Gutwin, (2012) Assessing Target Ac-quisition and Tracking Performance for Moving Targets in the Presence of Latency and Jitter, GI 2012, to appear.

Digital Library

[20]

Pavlovych, A., W. Stuerzlinger, (2009) The Tradeoff between Spatial Jitter and Latency in Pointing Tasks, ACM SEICS 2009, 187--196.

Digital Library

[21]

2Pavlovych, A., W. Stuerzlinger, (2011) Target Following Performance in the Presence of Latency, Jitter, and Sig-nal Dropouts, GI 2011, 33--40.

Digital Library

[22]

2Potter, R. Weldon, L. J., and Shneiderman, B. 1988. Improving the accuracy of touch screens: an experimental evaluation of strategies. In Proceedings of CHI '88.

Digital Library

[23]

Rosenberg, I. and Perlin, K. 2009. The UnMousePad: an interpolating multi-touch force-sensing input pad. In Proceedings of ACM SIGGRAPH 2009 (SIGGRAPH '09).

Digital Library

[24]

Rubine, D., McAvinney, P. 1988. The Videoharp. In Proceedings of International Computer Music 1988. Computer Music Association. September, 1988.

[25]

Savage, W. C. 1970. The Measurement of Sensation: A Critique of Perceptual Psychophysics. Berkeley: UC Press.

[26]

Sears, A., Jacko, J. 2012. HCI Handbook, 3rd Edition. Ch. 9.

[27]

Seow, S. 2008. Designing and Engineering Time: The Psychology of Time Perception in Software. Addison-Wesley, NY.

Digital Library

[28]

Texas Instruments. DLP Discovery 4100 Development Kit. http://www.ti.com/tool/dlpd4x00kit, January 2012.

[29]

Van Kessel, P. F., et al. 1998. A MEMS-Based Projec-tion Display. In Proceedings of the IEEE, 86 (8), pp. 1687--1704.

[30]

Wellner, P. 1993. Interacting with paper on the Digital Desk. Communications of the ACM 36 (7), 87--96.

Digital Library

[31]

3Wigdor, D., Williams, S., Cronin, M., Levy, R., White, K., Mazeev, M. and Benko, H. 2009. Ripples: utilizing per-contact visualizations to improve user interaction with touch displays. In Proceedings of UIST '09. ACM, New York, NY, USA, 3--12.

Digital Library

[32]

3Wigdor, D., Wixon, D. (2011). Brave NUI World: De-signing Natural User Interfaces for Touch and Gesture (1st ed.). Morgan Kaufmann Publishers Inc., San Fran-cisco, CA, USA.

Digital Library

[33]

3Xilinx. Microblaze Processor Reference Guide. http://www.xilinx.com/support/documentation/sw_manuals/xilinx13_3/mb_ref_guide.pdf, January 2012.

Cited By

Huang YLin WWu PWang YGuo ZHuang PYe Z(2024)Differential Signal-Amplitude-Modulated Multi-Beam Remote Optical Touch Based on Grating AntennaSensors10.3390/s2416531924:16(5319)Online publication date: 16-Aug-2024
https://doi.org/10.3390/s24165319
IWAI D(2024)Projection mapping technologies: A review of current trends and future directionsProceedings of the Japan Academy, Series B10.2183/pjab.100.012100:3(234-251)Online publication date: 11-Mar-2024
https://doi.org/10.2183/pjab.100.012
Erel YKozlovsky-Mordenfeld OIwai DSato KBermano A(2024)Casper DPM: Cascaded Perceptual Dynamic Projection Mapping onto HandsSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687624(1-10)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687624
Show More Cited By

Index Terms

Designing for low-latency direct-touch input
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Software-reduced touchscreen latency
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services

Devices with touchscreens have an inherent latency. When a user's finger drags an object across the screen the object follows with a latency of around 100ms for current devices. Previous work showed that latencies down to 25ms reduce users' performance ...
Crossing-based selection with direct touch input
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Fundamental performance results for crossing-based selec-tion tasks with direct touch input are presented. A close adaptation of Accot and Zhai's indirect stylus crossing ex-periment reveals similar trends for direct touch input: touch crossing task ...
Direct and indirect multi-touch interaction on a wall display
IHM '14: Proceedings of the 26th Conference on l'Interaction Homme-Machine

Multi-touch wall displays allow to take advantage of co-located interaction (direct interaction) on very large surfaces. However interacting with content beyond arms' reach requires body movements, introducing fatigue and impacting performance. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '12: Proceedings of the 25th annual ACM symposium on User interface software and technology

October 2012

608 pages

ISBN:9781450315807

DOI:10.1145/2380116

General Chair:
Rob Miller
MIT CSAIL, USA
,
Program Chairs:
Hrvoje Benko
Microsoft Research, USA
,
Celine Latulipe
University of North Carolina at Charlotte, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 October 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '12

Sponsor:

UIST '12: The 25th Annual ACM Symposium on User Interface Software and Technology

October 7 - 10, 2012

Massachusetts, Cambridge, USA

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

151
Total Citations
View Citations
2,313
Total Downloads

Downloads (Last 12 months)107
Downloads (Last 6 weeks)18

Reflects downloads up to 06 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Huang YLin WWu PWang YGuo ZHuang PYe Z(2024)Differential Signal-Amplitude-Modulated Multi-Beam Remote Optical Touch Based on Grating AntennaSensors10.3390/s2416531924:16(5319)Online publication date: 16-Aug-2024
https://doi.org/10.3390/s24165319
IWAI D(2024)Projection mapping technologies: A review of current trends and future directionsProceedings of the Japan Academy, Series B10.2183/pjab.100.012100:3(234-251)Online publication date: 11-Mar-2024
https://doi.org/10.2183/pjab.100.012
Erel YKozlovsky-Mordenfeld OIwai DSato KBermano A(2024)Casper DPM: Cascaded Perceptual Dynamic Projection Mapping onto HandsSIGGRAPH Asia 2024 Conference Papers10.1145/3680528.3687624(1-10)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680528.3687624
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Carayon AMartinie CPalanque PBarboni ESteere S(2024)A Systematic Process to Engineer Dependable Integration of Frame-based Input Devices in a Multimodal Input Chain: Application to Rehabilitation in HealthcareProceedings of the ACM on Human-Computer Interaction10.1145/36646338:EICS(1-31)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664633
Coutrix CProst C(2024)Impact of Fingernails Length on Mobile Tactile InteractionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642037(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642037
Grégoire ARoy NRoy SPotvin SDupuis MMartel ABouchard J(2024)A take on latency measurement for vision systemsInfrared Imaging Systems: Design, Analysis, Modeling, and Testing XXXV10.1117/12.3018001(25)Online publication date: 7-Jun-2024
https://doi.org/10.1117/12.3018001
Mikawa YFukiage T(2024)Low-Latency Ocular Parallax Rendering and Investigation of Its Effect on Depth Perception in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337207830:5(2228-2238)Online publication date: 5-Mar-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3372078
Kageyama YIwai DSato K(2024)Efficient Distortion-Free Neural Projector Deblurring in Dynamic Projection MappingIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.335495730:12(7544-7557)Online publication date: Dec-2024
https://doi.org/10.1109/TVCG.2024.3354957
Xie YLi FWang Y(2024)FingerSlid: Towards Finger-sliding Continuous Authentication on Smart Devices via VibrationIEEE Transactions on Mobile Computing10.1109/TMC.2023.3315291(1-15)Online publication date: 2024
https://doi.org/10.1109/TMC.2023.3315291
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten