research-article

Examining Augmented Virtuality Impairment Simulation for Mobile App Accessibility Design

Authors:

Kenny Tsu Wei Choo,

Rajesh Krishna Balan,

Youngki LeeAuthors Info & Claims

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: 375, Pages 1 - 11

https://doi.org/10.1145/3290605.3300605

Published: 02 May 2019 Publication History

Abstract

With mobile apps rapidly permeating all aspects of daily living with use by all segments of the population, it is crucial to support the evaluation of app usability for specific impaired users to improve app accessibility. In this work, we examine the effects of using our augmented virtuality impairment simulation system--Empath-D--to support experienced designer-developers to redesign a mockup of commonly used mobile application for cataract-impaired users, comparing this with existing tools that aid designing for accessibility. We show that the use of augmented virtuality for assessing usability supports enhanced usability challenge identification, finding more defects and doing so more accurately than with existing methods. Through our user interviews, we also show that augmented virtuality impairment simulation supports realistic interaction and evaluation to provide a concrete understanding over the usability challenges that impaired users face, and complements the existing guidelines-based approaches meant for general accessibility.

References

[1]

Tassha Hilda Adnan, Mokhlisoh Mohamed Apandi, Haireen Kamaruddin, Mohamad Aziz Salowi, Kian Boon Law, Jamaiyah Haniff, and Pik Pin Goh. 2018. Catquest-9SF questionnaire: validation of Malay and Chinese-language versions using Rasch analysis. Health and Quality of Life Outcomes 16 (Jan. 2018).

[2]

Apache Software Foundation. 2018. Apache Cordova. https: //cordova.apache.org/

[3]

Apple. 2015. Apple Accessibility Inspector. https: //developer.apple.com/library/archive/documentation/Accessibility/ Conceptual/AccessibilityMacOSX/OSXAXTestingApps.html

[4]

Apple. 2018. iOS - Human Interface Guidelines for Accessibility. https://developer.apple.com/design/human-interface-guidelines/ ios/app-architecture/accessibility/

[5]

Andrew Arch and Shadi Abou-Zara. 2010. Developing Websites for Older People: How Web Content Accessibility Guidelines (WCAG) 2.0 Applies | Web Accessibility Initiative (WAI) | W3C. https:// www.w3.org/WAI/older-users/developing.html

[6]

Halim Cagri Ates, Alexander Fiannaca, and Eelke Folmer. 2015. Immersive Simulation of Visual Impairments Using a Wearable See-through Display. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 225--228.

Digital Library

[7]

Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies 4, 3 (2009), 114--123.

Digital Library

[8]

John T. Cacioppo and Richard E. Petty. 1982. The need for cognition. Journal of Personality and Social Psychology; Journal of Personality and Social Psychology 42, 1 (1982), 116. http://psycnet.apa.org/journals/ psp/42/1/116/

[9]

Ben Caldwell, Michael Cooper, Loretta Guarino Reid, and Gregg Vanderheiden. 2008. Web Content Accessibility Guidelines (WCAG) 2.0. https://www.w3.org/TR/WCAG20/

[10]

Michael Crystian Nepomuceno Carvalho, Felipe Silva Dias, Aline Grazielle Silva Reis, and André Pimenta Freire. 2018. Accessibility and Usability Problems Encountered on Websites and Applications in Mobile Devices by Blind and Normal-vision Users. In Proceedings of the 33rd Annual ACM Symposium on Applied Computing (SAC '18). ACM, New York, NY, USA, 2022--2029.

Digital Library

[11]

Wendy Chisholm, Gregg Vanderheiden, and Ian Jacobs. 1999. Web Content Accessibility Guidelines 1.0. https://www.w3.org/TR/1999/ WAI-WEBCONTENT-19990505/

[12]

Raphael Clegg-Vinell, Christopher Bailey, and Voula Gkatzidou. 2014. Investigating the appropriateness and relevance of mobile web accessibility guidelines. In Proceedings of the 11th Web for All Conference. ACM, 38.

Digital Library

[13]

Amanda Davis. 2017. Most Developers Fail to Design Websites Accessible to People With Disabilities. http: //theinstitute.ieee.org/ieee-roundup/blogs/blog/most-developersfail-to-design-websites-accessible-to-people-with-disabilities

[14]

P. J. Foster, T. Y. Wong, D. Machin, G. J. Johnson, and S. K. L. Seah. 2003. Risk factors for nuclear, cortical and posterior subcapsular cataracts in the Chinese population of Singapore: the Tanjong Pagar Survey. British Journal of Ophthalmology 87, 9 (Sept. 2003), 1112--1120.

[15]

Greg Gay and Cindy Qi Li. 2010. AChecker: Open, Interactive, Customizable, Web Accessibility Checking. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) (W4A '10). ACM, New York, NY, USA, 23:1--23:2.

Digital Library

[16]

Google. 2018. Android Accessibility Guidelines. https:// developer.android.com/guide/topics/ui/accessibility/

[17]

Google. 2018. Google Accessibility Scanner. https://play.google.com/store/apps/details?id= com.google.android.apps.accessibility.auditor

[18]

Wan He, Daniel Goodkind, and Paul Kowal. 2016. An Aging World: 2015. International Population Reports. Technical Report. United States Census Bureau. 175 pages. https://www.census.gov/content/dam/ Census/library/publications/2016/demo/p95--16--1.pdf

[19]

K. Higuchi, Y. Sakaguchi, K. Sugiyama, and T. Nakano. 1999. Simulating the human vision of elderly for designing control panels. In 1999 IEEE International Conference on Systems, Man, and Cybernetics, 1999. IEEE SMC '99 Conference Proceedings, Vol. 5. 703--708 vol.5.

[20]

T. Ho, N. M. Law, L. G. Goh, and T. Yoong. 1997. Eye diseases in the elderly in Singapore. Singapore medical journal 38, 4 (1997), 149--155.

[21]

Wonjung Kim, Kenny Tsu Wei Choo, Youngki Lee, Archan Misra, and Rajesh Krishna Balan. 2018. Empath-D: VR-based Empathetic App Design for Accessibility. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '18). ACM, New York, NY, USA.

Digital Library

[22]

Jonathan Lazar, Alfreda Dudley-Sponaugle, and Kisha-Dawn Greenidge. 2004. Improving web accessibility: a study of webmaster perceptions. Computers in human behavior 20, 2 (2004), 269--288.

[23]

Rui Lopes, Daniel Gomes, and Luís Carriço. 2010. Web Not for All: A Large Scale Study of Web Accessibility. In Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A) (W4A '10). ACM, New York, NY, USA, 10:1--10:4.

Digital Library

[24]

Mats Lundstrom and Konrad Pesudovs. 2009. Catquest-9SF patient outcomes questionnaire: Nine-item short-form Rasch-scaled revision of the Catquest questionnaire. Journal of Cataract & Refractive Surgery 35, 3 (March 2009), 504--513.

[25]

J. Mankoff, H. Fait, and R. Juang. 2005. Evaluating accessibility by simulating the experiences of users with vision or motor impairments. IBM Systems Journal 44, 3 (2005), 505--517.

Digital Library

[26]

Jennifer Mankoff, Holly Fait, and Tu Tran. 2005. Is your web page accessible?: a comparative study of methods for assessing web page accessibility for the blind. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 41--50.

Digital Library

[27]

Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems 77, 12 (1994), 1321--1329.

[28]

Lauren R. Milne, Cynthia L. Bennett, and Richard E. Ladner. 2014. The Accessibility of Mobile Health Sensors for Blind Users. (Dec. 2014). http://scholarworks.calstate.edu/handle/10211.3/133384

[29]

Scott Milne, Anna Dickinson, Alex Carmichael, David Sloan, Roos Eisma, and Peter Gregor. 2005. Are guidelines enough? An introduction to designing Web sites accessible to older people. IBM systems journal 44, 3 (2005), 557--571.

Digital Library

[30]

A. F. Newell, P. Gregor, M. Morgan, G. Pullin, and C. Macaulay. 2011. User-Sensitive Inclusive Design. Universal Access in the Information Society 10, 3 (2011), 235--243.

Digital Library

[31]

Kim Patch, Jeanne Spellman, and Kathy Wahlbin. 2015. Mobile Accessibility: How WCAG 2.0 and Other W3C/WAI Guidelines Apply to Mobile. https://www.w3.org/TR/mobile-accessibility-mapping/

[32]

Christopher Power, Andre Freire, Helen Petrie, and David Swallow. 2012. Guidelines Are Only Half of the Story: Accessibility Problems Encountered by Blind Users on the Web. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 433--442.

Digital Library

[33]

Anne Spencer Ross, Xiaoyi Zhang, James Fogarty, and Jacob O. Wobbrock. 2017. Epidemiology as a Framework for Large-Scale Mobile Application Accessibility Assessment. ACM Press, 2--11.

Digital Library

[34]

Andrew Sears and Vicki Hanson. 2011. Representing Users in Accessibility Research. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2235--2238.

Digital Library

[35]

Arielle M. Silverman, Jason D. Gwinn, and Leaf Van Boven. 2015. Stumbling in Their Shoes: Disability Simulations Reduce Judged Capabilities of Disabled People. Social Psychological and Personality Science 6, 4 (May 2015), 464--471.

[36]

Singapore National Eye Centre, General Cataract & Comprehensive Ophthalmology Department. 2018. Cataract. https:// www.snec.com.sg/patient-care/conditions-treatments/cataract

[37]

Eirini Skiadaresi, Giuseppe Ravalico, Silvio Polizzi, Mats Lundstrom, Miguel Gonzalez-Andrades, and Colm McAlinden. 2016. The Italian Catquest-9SF cataract questionnaire: translation, validation and application. Eye and Vision 3, 1 (April 2016), 12.

[38]

Sublime Text. {n. d.}. Sublime Text 3. https://www.sublimetext.com/

[39]

Jani Vayrynen, Ashley Colley, and Jonna Hakkila. 2016. Head Mounted Display Design Tool for Simulating Visual Disabilities. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (MUM '16). ACM, New York, NY, USA, 69--73.

Digital Library

Cited By

Jo TYeo DKim GHwang SKim S(2024)WatchCap: Improving Scanning Efficiency in People with Low Vision through Compensatory Head Movement StimulationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595928:2(1-32)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659592
Liu ZChen CWang JChen MWu BHuang YHu JWang Q(2024)Unblind Text Inputs: Predicting Hint-text of Text Input in Mobile Apps via LLMProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642939(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642939
Maurice YGiroux FLasbareilles CBoasen JSénécal SLéger P(2024)Can We Replicate Impaired Vision with Simulation Glasses in Computer-Based Task? An Eye Tracking Validation StudyInformation Systems and Neuroscience10.1007/978-3-031-58396-4_20(231-242)Online publication date: 26-Jul-2024
https://doi.org/10.1007/978-3-031-58396-4_20
Show More Cited By

Index Terms

Examining Augmented Virtuality Impairment Simulation for Mobile App Accessibility Design
1. Human-centered computing

Recommendations

Empath-D: VR-based Empathetic App Design for Accessibility
MobiSys '18: Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services

With app-based interaction increasingly permeating all aspects of daily living, it is essential to ensure that apps are designed to be inclusive and are usable by a wider audience such as the elderly, with various impairments (e.g., visual, audio and ...
Towards Sound Accessibility in Virtual Reality
ICMI '21: Proceedings of the 2021 International Conference on Multimodal Interaction

Virtual reality (VR) leverages sight, hearing, and touch senses to convey virtual experiences. For d/Deaf and hard of hearing (DHH) people, however, information conveyed through sound may not be accessible. While prior work has explored making every day ...
Empath-D: Empathetic Design for Accessibility
HotMobile '17: Proceedings of the 18th International Workshop on Mobile Computing Systems and Applications

We describe our vision for Empath-D, our system to enable Empathetic User Interface Design. Our key idea is to leverage Virtual and Augmented Reality (VR / AR) displays to provide an Immersive Reality environment, where developers/designers can emulate ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

9077 pages

ISBN:9781450359702

DOI:10.1145/3290605

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Research Foundation Singapore

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

CHI '19 Paper Acceptance Rate 703 of 2,958 submissions, 24%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
829
Total Downloads

Downloads (Last 12 months)98
Downloads (Last 6 weeks)10

Reflects downloads up to 07 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jo TYeo DKim GHwang SKim S(2024)WatchCap: Improving Scanning Efficiency in People with Low Vision through Compensatory Head Movement StimulationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595928:2(1-32)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659592
Liu ZChen CWang JChen MWu BHuang YHu JWang Q(2024)Unblind Text Inputs: Predicting Hint-text of Text Input in Mobile Apps via LLMProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642939(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642939
Maurice YGiroux FLasbareilles CBoasen JSénécal SLéger P(2024)Can We Replicate Impaired Vision with Simulation Glasses in Computer-Based Task? An Eye Tracking Validation StudyInformation Systems and Neuroscience10.1007/978-3-031-58396-4_20(231-242)Online publication date: 26-Jul-2024
https://doi.org/10.1007/978-3-031-58396-4_20
Krösl KMedeiros MHuber MFeiner SElvezio C(2023)Exploring the Educational Value and Impact of Vision-Impairment Simulations on Sympathy and Empathy with XREyeMultimodal Technologies and Interaction10.3390/mti70700707:7(70)Online publication date: 6-Jul-2023
https://doi.org/10.3390/mti7070070
Jo TYeo DKim S(2023)Enhancing Wayfinding Experience in Low-Vision Individuals through a Tailored Mobile Guidance InterfaceElectronics10.3390/electronics1222456112:22(4561)Online publication date: 7-Nov-2023
https://doi.org/10.3390/electronics12224561
Pinheiro MViana Wde Gois Ribeiro Darin T(2023)Why Should Red and Green Never Be Seen? Exploring Color Blindness Simulations as Tools to Create Chromatically Accessible GamesProceedings of the ACM on Human-Computer Interaction10.1145/36110267:CHI PLAY(165-196)Online publication date: 4-Oct-2023
https://dl.acm.org/doi/10.1145/3611026
Zhang QBarbareschi GHuang YLi JPai YWard JKunze K(2022)Seeing our Blind Spots: Smart Glasses-based Simulation to Increase Design Students’ Awareness of Visual ImpairmentProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545687(1-14)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545687
Harrington CMartin-Hammond ABray K(2022)Examining Identity as a Variable of Health Technology Research for Older Adults: A Systematic ReviewProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517621(1-24)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517621
Reyes Arias JKurtzhall KPham DMkaouer MElglaly Y(2022)Accessibility Feedback in Mobile Application Reviews: A Dataset of Reviews and Accessibility GuidelinesExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519625(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519625
Pinheiro MViana WAndrade RDarin TMonteiro Ida Hora Rodrigues Kde Gois Ribeiro Darin TFreire AMota M(2021)Flying colorsProceedings of the XX Brazilian Symposium on Human Factors in Computing Systems10.1145/3472301.3484353(1-11)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3472301.3484353
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents