research-article

Designing Conversation Cues on a Head-Worn Display to Support Persons with Aphasia

Authors:

Kristin Williams,

Leah FindlaterAuthors Info & Claims

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Pages 231 - 240

https://doi.org/10.1145/2702123.2702484

Published: 18 April 2015 Publication History

Abstract

Symbol-based dictionaries of text, images and sound can help individuals with aphasia find the words they need, but are often seen as a last resort because they tend to replace rather than augment the user's natural speech. Through two design investigations, we explore head-worn displays as a means of providing unobtrusive, always-available, and glanceable vocabulary support. The first study used narrative storyboards as a design probe to explore the potential benefits and challenges of a head-worn approach over traditional augmented alternative communication (AAC) tools. The second study then evaluated a proof-of-concept prototype in both a lab setting with the researcher and in situ with unfamiliar conversation partners at a local market. Findings suggest that a head-worn approach could better allow wearers to maintain focus on the conversation, reduce reliance on the availability of external tools (e.g., paper and pen) or people, and minimize visibility of the support by others. These studies should motivate further investigation of head-worn conversational support.

References

[1]

Allen, M., McGrenere, J., and Purves, B. The design and field evaluation of PhotoTalk: A digital image communication application for people. Proc. ASSETS'07, ACM (2007), 187--194.

Digital Library

[2]

Al Mahmud, A., Gerits, R., and Martens, J. XTag: designing an experience capturing and sharing tool for persons with aphasia. Proc. NordiCHI'10, ACM (2010), 325--334.

Digital Library

[3]

Ball, M.J., Muller, N., and Nelson, R.L., eds. Handbook of Qualitative Research in Communication Disorders. Psychology Press, 2014.

[4]

Boyd-graber, J., Nikolova, S., Moffatt, K., et al. Participatory Design with Proxies: Developing a DesktopPDA System to Support People with Aphasia. Proc. CHI'06, ACM (2006), 151--160.

Digital Library

[5]

Brandenburg, C., Worrall, L., Rodriguez, A.D., and Copland, D. Mobile computing technology and aphasia: An integrated review of accessibility and potential uses. Aphasiology 27, 4 (2013), 444--461.

[6]

Braun, V. and Clarke, V. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77--101.

[7]

Chapey, R. Language intervention strategies in aphasia and related neurogenic communication disorders. Lippincott Williams & Wilkins, Philadelphia, 2001.

[8]

Demmans Epp, C., Djordjevic, J., Wu, S., Moffatt, K., and Baecker, R.M. Towards providing just-in-time vocabulary support for assistive and augmentative communication. Proc. IUI'12, ACM (2012), 333--36.

Digital Library

[9]

Galliers, J., Wilson, S., Roper, A., et al. Words Are Not Enough: Empowering People With Aphasia In The Design Process. Proc. PDC'12, ACM (2012), 51--60.

Digital Library

[10]

Galliers, O., Galliers, J., Wilson, S., et al. City Research Online Accessibility of 3D Game Environments for People with Aphasia: An Exploratory Study. Proc. ASSETS'11, ACM (2011), 24--26.

Digital Library

[11]

Ha, K., Chen, Z., Hu, W., Richter, W., Pillai, P., and Satyanarayanan, M. Towards wearable cognitive assistance. Proc. MobiSys'14, ACM (2014), 68--81.

Digital Library

[12]

Holland, A., Frattali, C., and Fromm, D. Communication Activities of Daily Living: CADL-2. (1999).

[13]

Kagan, A. Supported conversation for adults with aphasia: Methods and resources for training conversation partners. Aphasiology 12, 9 (1998), 816--830.

[14]

Kane, S.K., Linam-Church, B., Althoff, K., and McCall, D. What We Talk About: Designing a Context-aware Communication Tool for People with Aphasia. Proc. ASSETS'12, ACM (2012), 49--56.

Digital Library

[15]

Kertesz, A. and Poole, E. The Aphasia Quotient: The Taxonomic Approach to Measurement of Aphasic Disability. Can. J. Neurol. Sci. 1, 1 (1974), 7--16.

[16]

Kunze, K. Wearable Computing for Older Adults -- Initial Insights into Head-Mounted Display Usage. Adj. Proc. UbiComp'14, ACM (2014), 83--86.

Digital Library

[17]

Lasker, J. and Bedrosian, J. Promoting acceptance of augmentative and alternative communication by adults with acquired communication disorders. Augmentative and Alternative Communication 17, 3 (2001), 141--153.

[18]

Mcatamney, G., Street, S.V., and Uk, G. An Examination of the Effects of a Wearable Display on Informal Face-ToFace Communication. Proc. CHI'06, ACM (2006), 45--54.

Digital Library

[19]

McNaney, R., Vines, J., Roggen, D., et al. Exploring the acceptability of google glass as an everyday assistive device for people with parkinson's. Proc. CHI'14, ACM (2014), 2551--2554.

Digital Library

[20]

Moffatt, K., Mcgrenere, J., Purves, B., and Klawe, M. The Participatory Design of a Sound and Image Enhanced Daily Planner for People with Aphasia. Proc. CHI'04, ACM (2004), 407--414.

Digital Library

[21]

Nikolova, S., Tremaine, M., and Cook, P. Click on Bake to Get Cookies: Guiding Word-Finding with Semantic Associations. Proc. ASSETS'10, ACM (2010), 155--162.

Digital Library

[22]

Ofek, E., Iqbal, S.T., Strauss, K., and Way, O.M. Reducing Disruption from Subtle Information Delivery during a Conversation: Mode and Bandwidth Investigation. Proc. CHI'13, ACM (2013), 3111--3120.

Digital Library

[23]

Patokallio, J. and Ward, N. A wearable cross-language communication aid. Proc. ISWC'01, IEEE Comput. Soc (2001), 176--177.

Digital Library

[24]

Rhodes, B.J. Just-In-Time Information Retrieval. PhD Dissertation, MIT, 2000.

Digital Library

[25]

Van de Sandt-Koenderman, M. High-tech AAC and aphasia: Widening horizons' Aphasiology 18, 3 (2004), 245--263.

[26]

Tee, K., Moffatt, K., Findlater, L., et al. A Visual Recipe Book for Persons with Language Impairments. Proc. CHI'05, ACM (2005), 501--510.

Digital Library

[27]

Waller, A., Denis, F., Brodie, J., and Cairns, A.Y. Evaluating the use of TalksBac, a predictive communciation device for nonfluent adults with aphasia. Int. J. Lang. Commun. Disord. 33, 1 (1998), 45--70.

Cited By

Pohl H(2024)Body-Based Augmented Reality Feedback During ConversationsProceedings of the ACM on Human-Computer Interaction10.1145/36764918:MHCI(1-22)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676491
Curtis HJenkins AIbrahim SNeate T(2024)Looking Past Screens: Exploring Mixed Reality and Discreet AAC DevicesProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675655(1-22)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675655
Lee JTjahjadi AKim JYu JPark MZhang JFroehlich JTian YZhao Y(2024)CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676449(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676449
Show More Cited By

Index Terms

Designing Conversation Cues on a Head-Worn Display to Support Persons with Aphasia
1. Human-centered computing

Recommendations

The Cost of Turning Heads: A Comparison of a Head-Worn Display to a Smartphone for Supporting Persons with Aphasia in Conversation
ASSETS '16: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility

Current symbol-based dictionaries providing vocabulary support for persons with the language disorder, aphasia, are housed on smartphones or other portable devices. To employ the support on these external devices requires the user to divert their ...
Exploring the use of hand-to-face input for interacting with head-worn displays
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We propose the use of Hand-to-Face input, a method to interact with head-worn displays (HWDs) that involves contact with the face. We explore Hand-to-Face interaction to find suitable techniques for common mobile tasks. We evaluate this form of ...
Towards Improving Real-Time Head-Worn Display Caption Mediated Conversations with Speaker Feedback for Hearing Conversation Partners
CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

Many products attempt to provide captioning for Deaf and Hard-of-Hearing individuals through smart glasses using automatic speech recognition. Yet there still remain challenges due to system delays and dropouts, heavy accents, and general ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

4290 pages

ISBN:9781450331456

DOI:10.1145/2702123

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
824
Total Downloads

Downloads (Last 12 months)65
Downloads (Last 6 weeks)7

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pohl H(2024)Body-Based Augmented Reality Feedback During ConversationsProceedings of the ACM on Human-Computer Interaction10.1145/36764918:MHCI(1-22)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676491
Curtis HJenkins AIbrahim SNeate T(2024)Looking Past Screens: Exploring Mixed Reality and Discreet AAC DevicesProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675655(1-22)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675655
Lee JTjahjadi AKim JYu JPark MZhang JFroehlich JTian YZhao Y(2024)CookAR: Affordance Augmentations in Wearable AR to Support Kitchen Tool Interactions for People with Low VisionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676449(1-16)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676449
Cai RJanaka NZhao SSun M(2023)ParaGlassMenu: Towards Social-Friendly Subtle Interactions in ConversationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581065(1-21)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581065
Kwok TKiefer PRaubal M(2023)Unobtrusive interaction: a systematic literature review and expert surveyHuman–Computer Interaction10.1080/07370024.2022.216240439:5-6(380-416)Online publication date: Feb-2023
https://doi.org/10.1080/07370024.2022.2162404
Dudley JYin LGaraj VKristensson P(2023)Inclusive Immersion: a review of efforts to improve accessibility in virtual reality, augmented reality and the metaverseVirtual Reality10.1007/s10055-023-00850-827:4(2989-3020)Online publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1007/s10055-023-00850-8
Kulkarni PDuffy OSynnott JKernohan WMcNaney R(2022)Speech and Language Practitioners’ Experiences of Commercially Available Voice-Assisted Technology: Web-Based Survey StudyJMIR Rehabilitation and Assistive Technologies10.2196/292499:1(e29249)Online publication date: 5-Jan-2022
https://doi.org/10.2196/29249
Curtis HNeate TVazquez Gonzalez C(2022)State of the Art in AAC: A Systematic Review and TaxonomyProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544810(1-22)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3544810
Janaka NHaigh CKim HZhang SZhao S(2022)Paracentral and near-peripheral visualizations: Towards attention-maintaining secondary information presentation on OHMDs during in-person social interactionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502127(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502127
Tönsing KBartram JMorwane RWaller A(2022)Designing electronic graphic symbol-based AAC systems: a scoping review. Part 2: application of human-centred designDisability and Rehabilitation: Assistive Technology10.1080/17483107.2022.214818819:3(1092-1102)Online publication date: 22-Nov-2022
https://doi.org/10.1080/17483107.2022.2148188
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents