research-article

Investigating Microinteractions for People with Visual Impairments and the Potential Role of On-Body Interaction

Authors:

Alisha Pradhan,

Jon E. Froehlich,

Leah FindlaterAuthors Info & Claims

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

Pages 22 - 31

https://doi.org/10.1145/3132525.3132536

Published: 19 October 2017 Publication History

Abstract

For screenreader users who are blind or visually impaired (VI), today's mobile devices, while reasonably accessible, are not necessarily efficient. This inefficiency may be especially problematic for microinteractions, which are brief but high-frequency interactions that take only a few seconds for sighted users to complete (e.g., checking the weather or for new messages). One potential solution to support efficient non-visual microinteractions is on-body input, which appropriates the user's own body as the interaction medium. In this paper, we address two related research questions: How well are microinteractions currently supported for VI users' How should on-body interaction be designed to best support microinteractions for this user group? We conducted two studies: (1) an online survey to compare current microinteraction use between VI and sighted users (N=117); and (2) an in-person study where 12 VI screenreader users qualitatively evaluated a real-time on-body interaction system that provided three contrasting input designs. Our findings suggest that efficient microinteractions are not currently well-supported for VI users, at least using manual input, which highlights the need for new interaction approaches. On-body input offers this potential and the qualitative evaluation revealed tradeoffs with different on-body interaction techniques in terms of perceived efficiency, learnability, social acceptability, and ability to use on the go.

Supplementary Material

ZIP File (fp032.zip)

Download
1.87 MB

suppl.mov (fp032.mp4)

Supplemental video

Download
42.31 MB

References

[1]

Abdolrahmani, A., Kuber, R., and Hurst, A. 2016. An Empirical Investigation of the Situationally-Induced Impairments Experienced by Blind Mobile Device Users. ACM W4A '16: 21.

Digital Library

[2]

Adams, D., Morales, L., and Kurniawan, S. 2013. A qualitative study to support a blind photography mobile application. ACM PETRA '13, 1-8.

Digital Library

[3]

Ashbrook, D. L. 2010. Enabling Mobile Microinteractions. PhD Thesis.

Digital Library

[4]

Ashbrook, D. L., Clawson, J. R., Lyons, K., Starner, T. E., and Patel, N. 2008. Quickdraw: The Impact of Mobility and On-Body Placement on Device Access Time. ACM CHI '08, 219-222.

Digital Library

[5]

Azenkot, S. and Lee, N. B. 2013. Exploring the use of speech input by blind people on mobile devices. ACM ASSETS '13: 11.

Digital Library

[6]

Azenkot, S. Rector, K., Ladner, R., and Wobbrock, J. O. 2012. PassChords: Secure Multi-Touch Authentication for Blind People. ACM ASSETS '12, 159-166.

Digital Library

[7]

Böhmer, M., Hecht, B., Schöning, J., Krüger, A., and Bauer, G. 2011. Falling Asleep with Angry Birds, Facebook and Kindle: A Large Scale Study on Mobile Application Usage. ACM MobileHCI '11, 47-56.

Digital Library

[8]

Bonner, M. N., Brudvik, J. T., Abowd, G. D., and Edwards, W. K. 2010. No-look Notes: Accessible Eyes-free Multi-touch Text Entry. Springer-Verlag Pervasive '10, 409-426.

Digital Library

[9]

Braun V. and Clarke, V. 2006. Using Thematic Analysis in Psychology. Qualitative research in psychology 3, 2: 77-101.

[10]

Chen, X. A., Marquardt, N., Tang, A., Boring, S., and Greenberg, S. 2012. Extending a mobile device's interaction space through body-centric interaction. ACM MobieHCI '12, 151-160.

Digital Library

[11]

Dakopoulos. D. and Bourbakis, N. G. 2010. Wearable obstacle avoidance electronic travel aids for blind: a survey. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on 40, 1: 25-35.

Digital Library

[12]

Guerreiro, T., Gamboa, R., and Jorge, J. 2007. Mnemonical body shortcuts for interacting with mobile devices. International Gesture Workshop, 261-271.

[13]

Guerreiro, T., Lagoá, P., Nicolau, H., Gonçalves, D., and Jorge. J. 2008. From Tapping to Touching: Making Touch Screens Accessible to Blind Users. IEEE MultiMedia '08.

Digital Library

[14]

Gustafson, S., Rabe, B., and Baudisch, P. 2013. Understanding Palm-based Imaginary Interfaces: The Role of Visual and Tactile Cues when Browsing. ACM CHI '13, 889-898.

Digital Library

[15]

Gustafson S., Holz, C., and Baudisch, P. 2011. Imaginary Phone: Learning Imaginary Interfaces by Transferring Spatial Memory from a Familiar Device. ACM UIST '11, 283-292.

Digital Library

[16]

Harrison, C., Ramamurthy, S., and Hudson, S. E. 2012. On-body Interaction: Armed and Dangerous. ACM TEI '12, 69-76.

Digital Library

[17]

Harrison, C., Tan, D., and Morris, D. 2010. Skinput: Appropriating the Body As an Input Surface. ACM CHI '10, 453-462.

Digital Library

[18]

Hoggan, E., Brewster S. A., and Johnston, J. 2008. Investigating the Effectiveness of Tactile Feedback for Mobile Touchscreens. ACM CHI '08, 1573-1582.

Digital Library

[19]

Hruschka, D. J., Schwartz, D., St.John D. C., Picone-Decaro, E., Jenkins, R. A., and Carey, J. W. 2004. Reliability in Coding Open-Ended Data: Lessons Learned from HIV Behavioral Research. Field Methods '04: 16(3), 307-331.

[20]

Kane, S. K., Bigham, J. P., and Wobbrock, J. O. 2008. Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-touch Interaction Techniques. ACM ASSETS '08, 73-80.

Digital Library

[21]

Kane, S. K., Jayant, C., Wobbrock, J. O., and Ladner, R. E. 2009. Freedom to Roam: A Study of Mobile Device Adoption and Accessibility for People with Visual and Motor Disabilities. ACM ASSETS '09, 115-122.

Digital Library

[22]

Loclair, C., Gustafson, S., and Baudisch, P. 2010. PinchWatch: A Wearable Device for One-Handed Microinteractions. ACM MobieHCI '10:10

[23]

McGookin, D., Brewster, S., and Jiang, W. 2008. Investigating Touchscreen Accessibility for People with Visual Impairments. ACM NordiCHI '08, 298-307.

Digital Library

[24]

Nanayakkara, S., Shilkrot, R., Yeo, K. P., and Maes, P. 2013. EyeRing: A Finger-worn Input Device for Seamless Interactions with Our Surroundings. ACM AH '13, 13-20.

Digital Library

[25]

Oh, U. and Findlater, L. 2014. Design of and Subjective Responses to on-Body Input for People With Visual Impairments. ACM ASSETS '14: 8.

Digital Library

[26]

Oh, U. and Findlater, L. 2015. A Performance Comparison of On-hand versus On-phone Non-Visual Input by Blind and Sighted Users. ACM TACCESS '15: 7(4), 14.

Digital Library

[27]

OrCam Technologies Ltd. http://www.orcam.com. .

[28]

Oulasvirta, A., Tamminen, S., Roto, V., and Kuorelahti, J. 2005. Interaction in 4-Second Bursts: The Fragmented Nature of Attentional Resources in Mobile HCI. ACM CHI '05, 919-928.

Digital Library

[29]

Pizza, S., Brown, B., McMillan, D., and Lampinen, A. 2016. Smartwatch in Vivo. ACM CHI '16, 5456-5469.

Digital Library

[30]

Profita, H., Albaghli, R., Findlater, L., Jaeger, P., and Kane, S. K. 2016. The AT Effect: How Disability Affects the Perceived Social Acceptability of Head-Mounted Display Use. ACM CHI '16, 4884-4895.

Digital Library

[31]

Profita, H. P., Clawson, J., Gilliland, S., Zeagler, C., Startner, T., Budd, J., and Do, E.Y. 2013. Don't Mind Me Touching My Wrist: A Case Study of Interacting with On-body Technology in Public. ACM ISWC '13, 89-96.

Digital Library

[32]

Shilkrot, R., Huber, J., Ee, W. M., Maes, P., and Nanayakkara, S. C. 2015. FingerReader: A Wearable Device to Explore Printed Text on the Go. ACM CHI '15 Extended Abstracts, 2363-2372.

Digital Library

[33]

Shinohara, K. and Wobbrock, J. O. 2011. In the Shadow of Misperception: Assistive Technology Use and Social Interactions. ACM CHI '11, 705-714.

Digital Library

[34]

Starner, T. E., Snoeck, C. M., Wong, B. A., and McGuire, R. M. 2004. Use of Mobile Appointment Scheduling Devices. ACM CHI '04 Extended Abstracts, 1501-1504.

Digital Library

[35]

Stearns, L., Du, R., Oh, U., Jou, C., Findlater, L., Ross, D. A., and Froehilich, J. E. 2016. Evaluating Haptic and Auditory Directional Guidance to Assist Blind Persons in Reading Printed Text Using Finger-Mounted Cameras. ACM TACCESS '16:9(1), 1-38.

Digital Library

[36]

Stearns, L., Oh, U., Cheng, B. J., Findlater, L., Ross, D., Chellappa, R., and Froehlich, J.E. 2016. Localization of Skin Features on the Hand and Wrist from Small Image Patches. IEEE ICPR '16, 1003-1010.

[37]

WebAIM. Screen Reader User Survey #4. http://webaim.org/projects/screenreadersurvey4/#demographics.

[38]

Weigel, M., Mehta, V., and Steimle, J. 2014. More Than Touch: Understanding How People Use Skin As an Input Surface for Mobile Computing. ACM CHI '14, 179-188.

Digital Library

[39]

Ye H., Malu, M., Oh, U., and Findlater, L. 2014. Current and Future Mobile and Wearable Device Use by People with Visual Impairments. ACM CHI '14, 3123-3132.

Digital Library

Cited By

Vatavu R(2023)iFAD Gestures: Understanding Users’ Gesture Input Performance with Index-Finger Augmentation DevicesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580928(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580928
Busaeed SKatib IAlbeshri ACorchado JYigitcanlar TMehmood R(2022)LidSonic V2.0: A LiDAR and Deep-Learning-Based Green Assistive Edge Device to Enhance Mobility for the Visually ImpairedSensors10.3390/s2219743522:19(7435)Online publication date: 30-Sep-2022
https://doi.org/10.3390/s22197435
Colley MKränzle TRukzio E(2022)Accessibility-Related Publication Distribution in HCI Based on a Meta-AnalysisExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519701(1-28)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519701
Show More Cited By

Index Terms

Investigating Microinteractions for People with Visual Impairments and the Potential Role of On-Body Interaction
1. Human-centered computing
  1. Accessibility
    1. Empirical studies in accessibility
  2. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies

Recommendations

Design of and subjective response to on-body input for people with visual impairments
ASSETS '14: Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility

For users with visual impairments, who do not necessarily need the visual display of a mobile device, non-visual on-body interaction (e.g., Imaginary Interfaces) could provide accessible input in a mobile context. Such interaction provides the potential ...
Investigating touchscreen accessibility for people with visual impairments
NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges

Touchscreen computing devices such as the iPhone are becoming more common. However this technology is largely inaccessible to people with visual impairments. We present the results of a requirements capture study that illustrates the problems with ...
Factors that Impact the Acceptability of On-Body Interaction by Users with Visual Impairments
Human-Computer Interaction – INTERACT 2019
Abstract
On-body interaction is a growing alternative way of controlling everyday interactive devices. Despite on-body gestures being natural for humans, there is still a lack of research on how this type of interaction can improve accessibility for people ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ASSETS '17: Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 2017

450 pages

ISBN:9781450349260

DOI:10.1145/3132525

General Chair:
Amy Hurst
University of Maryland, Baltimore County, USA
,
Program Chairs:
Leah Findlater
University of Washington, USA
,
Meredith Ringel Morris
Microsoft Research, USA

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGACCESS: ACM Special Interest Group on Accessible Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Office of the Assistant Secretary of Defense for Health Affairs

Conference

ASSETS '17

Sponsor:

SIGACCESS

ASSETS '17: The 19th International ACM SIGACCESS Conference on Computers and Accessibility

October 20 - November 1, 2017

Maryland, Baltimore, USA

Acceptance Rates

ASSETS '17 Paper Acceptance Rate 28 of 126 submissions, 22%;

Overall Acceptance Rate 436 of 1,556 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
453
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Vatavu R(2023)iFAD Gestures: Understanding Users’ Gesture Input Performance with Index-Finger Augmentation DevicesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580928(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580928
Busaeed SKatib IAlbeshri ACorchado JYigitcanlar TMehmood R(2022)LidSonic V2.0: A LiDAR and Deep-Learning-Based Green Assistive Edge Device to Enhance Mobility for the Visually ImpairedSensors10.3390/s2219743522:19(7435)Online publication date: 30-Sep-2022
https://doi.org/10.3390/s22197435
Colley MKränzle TRukzio E(2022)Accessibility-Related Publication Distribution in HCI Based on a Meta-AnalysisExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519701(1-28)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519701
Mack KMcDonnell EJain DLu Wang LE. Froehlich JFindlater LKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)What Do We Mean by “Accessibility Research”?Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445412(1-18)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445412
Liu GGu YYin YYu CWang YMi HShi Y(2020)Keep the Phone in Your PocketProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/33973084:2(1-23)Online publication date: 15-Jun-2020
https://dl.acm.org/doi/10.1145/3397308
Koelle MAnanthanarayan SBoll SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Social Acceptability in HCI: A Survey of Methods, Measures, and Design StrategiesProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376162(1-19)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376162
Costa DDuarte C(2020)Alternative modalities for visually impaired users to control smart TVsMultimedia Tools and Applications10.1007/s11042-020-09656-1Online publication date: 25-Aug-2020
https://doi.org/10.1007/s11042-020-09656-1
Patil SDennis DPabbaraju CShaheer NSimhadri HSeshadri VVarma MJain PGuimbretière FBernstein MReinecke K(2019)GesturePodProceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology10.1145/3332165.3347881(403-415)Online publication date: 17-Oct-2019
https://dl.acm.org/doi/10.1145/3332165.3347881
Costa DDuarte C(2019)Personalized and Accessible TV Interaction for People with Visual ImpairmentsProceedings of the 16th International Web for All Conference10.1145/3315002.3317566(1-4)Online publication date: 13-May-2019
https://dl.acm.org/doi/10.1145/3315002.3317566
Mathur RSheth AVyas PBolchini DBigham JAzenkot SKane S(2019)Typing Slowly but Screen-FreeProceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3308561.3353789(427-439)Online publication date: 24-Oct-2019
https://dl.acm.org/doi/10.1145/3308561.3353789
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten