research-article

ACES: a cross-discipline platform and method for communication and language research

Authors:

Joshua Hailpern,

Marina Danilevsky,

Karrie KarahaliosAuthors Info & Claims

CSCW '13: Proceedings of the 2013 conference on Computer supported cooperative work

Pages 515 - 526

https://doi.org/10.1145/2441776.2441835

Published: 23 February 2013 Publication History

Abstract

While conducting research focused on individuals with impairments is vitally important, such experiments often have high costs (time and money), and researchers may be limited in the instructions they can give, or participant feedback they can gather (due to the impairment). We present how an impairment emulation system (ACES) can be used by researchers in the behavioral sciences. By repurposing this new technology within the context of a "traditional" psychology experiment, we were able to analyze impaired linguistic and communication in a manner that was not possible without a system such as ACES. Our experiment on 96 participants provided strong support for a theory in the aphasia psychology community, and uncovered new understandings of how people communicate when one interlocutor's speech is distorted with aphasia. These findings illustrate a new direction of HCI research that directly helps researchers in Psychology, Communication, and Speech and Hearing Science.

References

[1]

Al Mahmud, A., Gerits, R., and Martens, J. Xtag: designing an experience capturing and sharing tool for persons with aphasia. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, ACM (2010), 325--334.

Digital Library

[2]

Al Mahmud, A., and Martens, J. Understanding email communication of persons with aphasia. In Extended abstracts on Human factors in computing systems, ACM (2011), 1195--1200.

Digital Library

[3]

Allen, M., McGrenere, J., and Purves, B. The design and field evaluation of phototalk: a digital image communication application for people. In Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility, ACM (2007), 187--194.

Digital Library

[4]

Bard, E., Anderson, A., Chen, Y., Nicholson, H., Havard, C., and Dalzel-Job, S. Let's you do that: Sharing the cognitive burdens of dialogue. Journal of Memory and Language 57, 4 (2007), 616--641.

[5]

Benson, D. Aphasia, Alexia and Agraphia: Clinical Neurology and Neurosurgery Monographs. Churchill Livingstone, New York, 1979.

[6]

Benson, D. The neurology of thinking. Oxford University Press, USA, 1994.

[7]

Beun, R., and Cremers, A. Object reference in a shared domain of conversation. Pragmatics & Cognition, 6 1, 2 (1998), 121--152.

[8]

Bos, N., Olson, J., Gergle, D., Olson, G., and Wright, Z. Effects of four computer-mediated communications channels on trust development. In Proceedings of the SIGCHI conference on Human factors in computing systems: Changing our world, changing ourselves, ACM (2002), 135--140.

Digital Library

[9]

Boyd-Graber, J., Nikolova, S., Moffatt, K., Kin, K., Lee, J., Mackey, L., Tremaine, M., and Klawe, M. Participatory design with proxies: developing a desktop-pda system to support people with aphasia. In Proceedings of the SIGCHI conference on Human Factors in computing systems, ACM (2006), 151--160.

Digital Library

[10]

Brown-Schmidt, S., and Tanenhaus, M. Real-time investigation of referential domains in unscripted conversation: A targeted language game approach. Cognitive science 32, 4 (2008), 643--684.

[11]

Colby, K., Weber, S., and Hilf, F. Artificial paranoia. Artificial Intelligence 2, 1 (1971), 1--25.

Digital Library

[12]

Cushman, W., and Rosenberg, D. Human factors in product design. Advances in human factors/ergonomics 14 (1991).

[13]

Duck, S., Rutt, D., HOY, M., and STREJC, H. Some evident truths about conversations in everyday relationships all communications are not created equal. Human communication research 18, 2 (1991), 228--267.

[14]

Giles, H. A study of speech patterns in social interaction: Accent evaluation and accent change. PhD thesis, University of Bristol, Bristol, UK, 1971.

[15]

Goodglass, H., Goodglass, and Kaplan. Boston Diagnostic Aphasia Examination: Stimulus Cards - Short Form. Lippincott Williams & Wilkins, 2001.

[16]

Hailpern, J., Danilevsky, M., Harris, A., Karahalios, K., Dell, G., and Hengst, J. Aces: Promoting empathy towards aphasia through language distortion emulation software. In Proceedings of the ACM's SIG CHI Conference 2011 Conference., CHI 2011, ACM (Vancouver, BC Canada, 2011).

Digital Library

[17]

Hailpern, J., Danilevsky, M., and Karahalios, K. Aces: Aphasia emulation, realism, and the turing test. In Proceedings of the ACM SIGACCESS - ASSETS 2011 Conference., ASSETS 2011, ACM (Dundee, Scotland, 2011).

Digital Library

[18]

Hardin, J., and Hilbe, J. Generalized estimating equations. Chapman and Hall/CRC, New York, 2003.

[19]

Hartsuiker, R., and Kolk, H. Syntactic facilitation in agrammatic sentence production. Brain and Language 62, 2 (1998), 221--254.

[20]

Hecht, M. The conceptualization and measurement of interpersonal communication satisfaction. Human Communication Research 4, 3 (1978), 253--264.

[21]

Henry, S. Just ask: integrating accessibility throughout design. Lulu. com, 2007.

[22]

Jurafsky, D., Martin, J., Kehler, A., Vander Linden, K., and Ward, N. Speech and language processing: An introduction to natural language processing, computational linguistics, and speech recognition, vol. 163. MIT Press, 2000.

Digital Library

[23]

Kirvesoja, H. Experimental ergonomic evaluation with user trials: EEE product development procedures. Oulun yliopisto, 2001.

[24]

Kolk, H. A time-based approach to agrammatic production. Brain and Language 50, 3 (1995), 282--303.

[25]

Kolk, H., and Heeschen, C. Adaptation symptoms and impairment symptoms in broca's aphasia. Aphasiology 4, 3 (1990), 221--231.

[26]

Kolk, H., and Heeschen, G. The malleability of agrammatic symptoms: A reply to hesketh and bishop. Aphasiology 10, 1 (1996), 81--96.

[27]

Kolk, H., and Van Grunsven, M. Agrammatism as a variable phenomenon. Cognitive Neuropsychology (1985).

[28]

Leshed, G. Automated language-based feedback for teamwork behaviors. PhD thesis, Cornell University, 2009.

Digital Library

[29]

Menn, L., Kamio, A., Hayashi, M., Fujita, I., Sasanuma, S., and Boles, L. The role of empathy in sentence production: A functional analysis of aphasic and normal elicited narratives in Japanese and English. Function and Structure (1998), 317--356.

[30]

Menn, L., Reilly, K., Hayashi, M., Kamio, A., Fujita, I., and Sasanuma, S. The interaction of preserved pragmatics and impaired syntax in Japanese and English aphasic speech. Brain and language 61, 2 (1998), 183--225.

[31]

Moffatt, K., McGrenere, J., Purves, B., and Klawe, M. The participatory design of a sound and image enhanced daily planner for people with aphasia. In Proceedings of the SIGCHI conference on Human factors in computing systems, ACM (2004), 407--414.

Digital Library

[32]

Nguyen, D., and Rosé, C. Language use as a reflection of socialization in online communities. ACL HLT 2011 (2011), 76.

Digital Library

[33]

Niederhoffer, K. G., and Pennebaker, J. W. Linguistic style matching in social interaction. Journal of Language and Social Psychology 21, 4 (2002), 337--360.

[34]

Piper, A., Weibel, N., and Hollan, J. Introducing multimodal paper-digital interfaces for speech-language therapy. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility, ACM (2010), 203--210.

Digital Library

[35]

Ruiter, M., Kolk, H., and Rietveld, T. Speaking in ellipses: The effect of a compensatory style of speech on functional communication in chronic agrammatism. Neuropsychological rehabilitation 20, 3 (2010), 423--458.

[36]

Ruiter, M. B. Speaking in ellipses: The effect of a compensatory style of speech on functional communication in chronic agrammatism. PhD thesis, Radboud University Nijmegen, Nijmegen, Netherlands, 2008.

[37]

Saffran, E., Berndt, R., and Schwartz, M. The quantitative analysis of agrammatic production: Procedure and data. Brain and Language 37, 3 (1989), 440--479.

[38]

Salis, C., and Edwards, S. Treatment of written verb and written sentence production in an individual with aphasia: A clinical study. Aphasiology 24, 9 (2010), 1051--1063.

[39]

Scissors, L., Gill, A., Geraghty, K., and Gergle, D. In cmc we trust: the role of similarity. In Proceedings of the 27th international conference on Human factors in computing systems, ACM (2009), 527--536.

Digital Library

[40]

Scissors, L., Gill, A., and Gergle, D. Linguistic mimicry and trust in text-based cmc. In Proceedings of the 2008 ACM conference on Computer supported cooperative work, ACM (2008), 277--280.

Digital Library

[41]

Shannon, C., and Weaver, W. The mathematical theory of communication, vol. 19. University of Illinois Press Urbana, 1962.

Digital Library

[42]

Shewan, C., and Kertesz, A. Reliability and validity characteristics of the western aphasia battery (wab). Journal of Speech and Hearing Disorders 45, 3 (1980), 308.

[43]

Takagi, H., Asakawa, C., Fukuda, K., and Maeda, J. Accessibility designer: visualizing usability for the blind. In ACM SIGACCESS Accessibility and Computing, no. 77-78, ACM (2004), 177--184.

Digital Library

[44]

Thompson, C., Ballard, K., Tait, M., Weintraub, S., and Mesulam, M. Patterns of language decline in non-fluent primary progressive aphasia. Aphasiology 11, 4-5 (1997), 297--321.

[45]

Toma, C. Perceptions of trustworthiness online: The role of visual and textual information. In Proceedings of the 2010 ACM conference on Computer supported cooperative work, ACM (2010), 13--22.

Digital Library

[46]

Wang, H., and Fussell, S. Groups in groups: Conversational similarity in online multicultural multiparty brainstorming. In Proceedings of the 2010 ACM conference on Computer supported cooperative work, ACM (2010), 351--360.

Digital Library

[47]

Weizenbaum, J. Contextual understanding by computers. Communications of the ACM 10, 8 (1967), 480.

Digital Library

[48]

Wilkes-Gibbs, D., and Clark, H. Coordinating beliefs in conversation. Journal of Memory and Language 31, 2 (1992), 183--194.

[49]

Wilson, J., Straus, S., and McEvily, B. All in due time: The development of trust in computer-mediated and face-to-face teams. Organizational Behavior and Human Decision Processes 99, 1 (2006), 16--33.

Cited By

Williams KMoffatt KHong JFaroqi-Shah YFindlater LFeng JHuenerfauth M(2016)The Cost of Turning HeadsProceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/2982142.2982165(111-120)Online publication date: 23-Oct-2016
https://dl.acm.org/doi/10.1145/2982142.2982165

Index Terms

ACES: a cross-discipline platform and method for communication and language research
1. Social and professional topics

Recommendations

ACES: promoting empathy towards aphasia through language distortion emulation software
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Individuals with aphasia, an acquired communication disorder, constantly struggle against a world that does not understand them. This lack of empathy and understanding negatively impacts their quality of life. While aphasic individuals may appear to ...
ACES: aphasia emulation, realism, and the turing test
ASSETS '11: The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility

To an outsider it may appear as though an individual with aphasia has poor cognitive function. However, the problem resides in the individual's receptive and expressive language, and not in their ability to think. This misperception, paired with a lack ...
Interdependent components of web accessibility
W4A '05: Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A)

Increasingly, the Web is providing unprecedented access to information and interaction for people with disabilities. However, the Web will not be equally accessible, allowing people with disabilities to access and contribute to the Web, until:• ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '13: Proceedings of the 2013 conference on Computer supported cooperative work

February 2013

1594 pages

ISBN:9781450313315

DOI:10.1145/2441776

General Chairs:
Amy Bruckman
Georgia Institute of Technology, USA
,
Scott Counts
Microsoft Research, USA
,
Program Chairs:
Cliff Lampe
University of Michigan, USA
,
Loren Terveen
University of Minnesota, USA

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 February 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CSCW '13

Sponsor:

SIGCHI

CSCW '13: Computer Supported Cooperative Work

February 23 - 27, 2013

Texas, San Antonio, USA

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
210
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)2

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Williams KMoffatt KHong JFaroqi-Shah YFindlater LFeng JHuenerfauth M(2016)The Cost of Turning HeadsProceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/2982142.2982165(111-120)Online publication date: 23-Oct-2016
https://dl.acm.org/doi/10.1145/2982142.2982165

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents