research-article

Empowering Dyads of Older Adults With Mild Cognitive Impairment And Their Care Partners Using Conversational Agents

Authors:

Tamara Zubatiy,

Kayci L Vickers,

Niharika Mathur,

Elizabeth D MynattAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 657, Pages 1 - 15

https://doi.org/10.1145/3411764.3445124

Published: 07 May 2021 Publication History

Abstract

Conversational agents (CAs) such as Google Home or Alexa offer empowering opportunities for dyads composed of older adults with mild cognitive impairment (MCI) and their care partners. CAs support coordination and planning between the two, and can amplify the support that the care partner needs to provide. In this study, we observed how ten such dyads interacted with a Google Home over 10 weeks. We logged and analyzed 3,878 total interactions, interviewed the dyads to better understand their experiences, and also surveyed their individual preferences and priorities for automated assistance in the home. We found that CAs empowered both the people who had MCI, and their care partners. We observed that the utility of the CA in the day-to-day lives of users largely depended on how much the care partner scaffolded promising functionality, setting it up and contextualizing it for specific needs and desires.

References

[1]

[n.d.]. Amazon Echo vs. Google Home. https://www.pcmag.com/news/amazon-echo-vs-google-home-which-smart-speaker-is-best

[2]

[n.d.]. Mild Cognitive Impairment (MCI). https://www.alz.org/alzheimers-dementia/what-is-dementia/related_conditions/mild-cognitive-impairment?utm_source=google

[3]

Noura Abdi, Kopo M Ramokapane, and Jose M Such. 2019. More than smart speakers: security and privacy perceptions of smart home personal assistants. In Fifteenth Symposium on Usable Privacy and Security ({SOUPS} 2019).

[4]

Ali Abdolrahmani, Ravi Kuber, and Stacy M Branham. 2018. ” Siri Talks at You” An Empirical Investigation of Voice-Activated Personal Assistant (VAPA) Usage by Individuals Who Are Blind. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. 249–258.

Digital Library

[5]

Matthias Baldauf, Raffael Bösch, Christian Frei, Fabian Hautle, and Marc Jenny. 2018. Exploring requirements and opportunities of conversational user interfaces for the cognitively impaired. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct - MobileHCI ’18. ACM Press, Barcelona, Spain, 119–126. https://doi.org/10.1145/3236112.3236128

Digital Library

[6]

Erin Beneteau, Ashley Boone, Yuxing Wu, Julie A Kientz, Jason Yip, and Alexis Hiniker. 2020. Parenting with Alexa: Exploring the Introduction of Smart Speakers on Family Dynamics. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[7]

Erin Beneteau, Olivia K Richards, Mingrui Zhang, Julie A Kientz, Jason Yip, and Alexis Hiniker. 2019. Communication breakdowns between families and Alexa. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[8]

Frank Bentley, Chris Luvogt, Max Silverman, Rushani Wirasinghe, Brooke White, and Danielle Lottridge. 2018. Understanding the Long-Term Use of Smart Speaker Assistants. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (Sept. 2018), 1–24. https://doi.org/10.1145/3264901

Digital Library

[9]

Jared M Bruce, Michael McQuiggan, Vanessa Williams, Holly Westervelt, and Geoffrey Tremont. 2008. Burden among spousal and child caregivers of patients with mild cognitive impairment. Dementia and geriatric cognitive disorders 25, 4 (2008), 385–390.

[10]

Clare Carroll, Catherine Chiodo, Adena Xin Lin, Meg Nidever, and Jayanth Prathipati. 2017. Robin: Enabling Independence For Individuals With Cognitive Disabilities Using Voice Assistive Technology. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA ’17. ACM Press, Denver, Colorado, USA, 46–53. https://doi.org/10.1145/3027063.3049266

Digital Library

[11]

John Carroll and Sooyeon Lee. 2020. Talk the Talk: How Human Conversational Agents Build Trust. http://casforhealth.org/wp-content/uploads/2020/04/Talk-the-Talk-How-Human-Conversational-Agents-Build-Trust.pdf

[12]

Nicole Carson, Larry Leach, and Kelly J Murphy. 2018. A re-examination of Montreal Cognitive Assessment (MoCA) cutoff scores. International Journal of Geriatric Psychiatry 33, 2(2018), 379–388.

[13]

Roger Clarke. 2009. Privacy impact assessment: Its origins and development. Computer law & security review 25, 2 (2009), 123–135.

[14]

Andrea Cuadra and Emily Tseng. 2020. Using Intelligent Voice Assistants to Enhance the Provision of Home Care for Older Adults.

[15]

Sara J Czaja and Joseph Sharit. 2016. Designing Training and Instructional Programs for Older Adults. CRC Press, London. OCLC: 957230652.

[16]

Luis Carlos Rubino de Oliveira, Andrew May, Val Mitchell, Mike Coleman, Tom Kane, and Steven Firth. 2015. Pre-installation challenges: classifying barriers to the introduction of smart home technology. In EnviroInfo and ICT for Sustainability 2015. Atlantis Press.

[17]

Andy P Dickens, Suzanne H Richards, Colin J Greaves, and John L Campbell. 2011. Interventions targeting social isolation in older people: a systematic review. BMC public health 11, 1 (2011), 647.

[18]

Arthur D. Fisk, Sara J. Czaja, Wendy A. Rogers, Neil Charness, Sara J. Czaja, and Joseph Sharit. 2018. Designing for Older Adults: Principles and Creative Human Factors Approaches, Second Edition (0 ed.). CRC Press. https://doi.org/10.1201/9781420080681

[19]

Marcia Ford and William Palmer. 2019. Alexa, are you listening to me? An analysis of Alexa voice service network traffic. Personal and Ubiquitous Computing 23, 1 (Feb. 2019), 67–79. https://doi.org/10.1007/s00779-018-1174-x

Digital Library

[20]

Serge Gauthier, Barry Reisberg, Michael Zaudig, Ronald C Petersen, Karen Ritchie, Karl Broich, Sylvie Belleville, Henry Brodaty, David Bennett, Howard Chertkow, 2006. Mild cognitive impairment. The lancet 367, 9518 (2006), 1262–1270.

[21]

Felicia C Goldstein, Angela V Ashley, Eric Miller, Olga Alexeeva, Lavezza Zanders, and Veronique King. 2014. Validity of the montreal cognitive assessment as a screen for mild cognitive impairment and dementia in African Americans. Journal of geriatric psychiatry and neurology 27, 3 (2014), 199–203.

[22]

Hilary Hutchinson, Wendy Mackay, Bo Westerlund, Benjamin B Bederson, Allison Druin, Catherine Plaisant, Michel Beaudouin-Lafon, Stéphane Conversy, Helen Evans, Heiko Hansen, 2003. Technology probes: inspiring design for and with families. In Proceedings of the SIGCHI conference on Human factors in computing systems. 17–24.

Digital Library

[23]

Janet Johnson, Khalil Mrini, Allison Moore, Emilia Farkas, Ndapa Nkashole, Michael Hogarth, and Nadir Weibel. 2020. Voice-Based Conversational Agents for Older Adults. http://casforhealth.org/wp-content/uploads/2020/04/Voice-Based-Conversational-Agents-for-Older-Adults.pdf

[24]

Rebecca A Johnson and Jason Karlawish. 2015. A review of ethical issues in dementia. International psychogeriatrics 27, 10 (2015), 1635–1647.

[25]

Julie A. Kientz, Shwetak N. Patel, Brian Jones, Ed Price, Elizabeth D. Mynatt, and Gregory D. Abowd. 2008. The Georgia Tech Aware Home. In CHI ’08 Extended Abstracts on Human Factors in Computing Systems (Florence, Italy) (CHI EA ’08). Association for Computing Machinery, New York, NY, USA, 3675–3680. https://doi.org/10.1145/1358628.1358911

Digital Library

[26]

Scott YH Kim. 2011. The ethics of informed consent in Alzheimer disease research. Nature Reviews Neurology 7, 7 (2011), 410–414.

[27]

Bret Kinsella. 2019. Voice Assistant Demographic Data - Young Consumers More Likely to Own Smart Speakers While Over 60 Bias Toward Alexa and Siri. https://voicebot.ai/2019/06/21/voice-assistant-demographic-data-young-consumers-more-likely-to-own-smart-speakers-while-over-60-bias-toward-alexa-and-siri/

[28]

Josephine Lau, Benjamin Zimmerman, and Florian Schaub. 2018. Alexa, are you listening? privacy perceptions, concerns and privacy-seeking behaviors with smart speakers. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 1–31.

Digital Library

[29]

Haley MacLeod, Maia Jacobs, Katie Siek, Kay Connelly, and Elizabeth Mynatt. 2016. Ethical Considerations in Pervasive Health Research. In Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare. ACM, Cancun, Mexico. https://doi.org/10.4108/eai.16-5-2016.2263813

[30]

Michael Malek-Ahmadi, Jessica J Powell, Christine M Belden, Kathy O’Connor, Linda Evans, David W Coon, and Walter Nieri. 2015. Age-and education-adjusted normative data for the Montreal Cognitive Assessment (MoCA) in older adults age 70–99. Aging, Neuropsychology, and Cognition 22, 6 (2015), 755–761.

[31]

Sadaf Arefi Milani, Michael Marsiske, Linda B Cottler, Xinguang Chen, and Catherine W Striley. 2018. Optimal cutoffs for the Montreal Cognitive Assessment vary by race and ethnicity. Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring 10(2018), 773–781.

[32]

Ziad S Nasreddine, Natalie A Phillips, Valérie Bédirian, Simon Charbonneau, Victor Whitehead, Isabelle Collin, Jeffrey L Cummings, and Howard Chertkow. 2005. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society 53, 4 (2005), 695–699.

[33]

Jennifer M Ortman, Victoria A Velkoff, Howard Hogan, 2014. An aging nation: the older population in the United States. United States Census Bureau, Economics and Statistics Administration, US ….

[34]

Ronald C Petersen. 2004. Mild cognitive impairment as a diagnostic entity. Journal of internal medicine 256, 3 (2004), 183–194.

[35]

Martin Porcheron, Joel E. Fischer, Stuart Reeves, and Sarah Sharples. 2018. Voice Interfaces in Everyday Life. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–12. https://doi.org/10.1145/3173574.3174214

Digital Library

[36]

Alisha Pradhan, Leah Findlater, and Amanda Lazar. 2019. ” Phantom Friend” or” Just a Box with Information” Personification and Ontological Categorization of Smart Speaker-based Voice Assistants by Older Adults. Proceedings of the ACM on Human-Computer Interaction 3, CSCW(2019), 1–21.

[37]

Alisha Pradhan, Kanika Mehta, and Leah Findlater. 2018. ” Accessibility Came by Accident” Use of Voice-Controlled Intelligent Personal Assistants by People with Disabilities. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[38]

Sergio Sayago, Barbara Barbosa Neves, and Benjamin R Cowan. 2019. Voice assistants and older people: some open issues. In Proceedings of the 1st International Conference on Conversational User Interfaces - CUI ’19. ACM Press, Dublin, Ireland, 1–3. https://doi.org/10.1145/3342775.3342803

Digital Library

[39]

Hanna Schneider, Malin Eiband, Daniel Ullrich, and Andreas Butz. 2018. Empowerment in HCI - A Survey and Framework. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI ’18. ACM Press, Montreal QC, Canada, 1–14. https://doi.org/10.1145/3173574.3173818

Digital Library

[40]

James Simpson, Franziska Gaiser, Miroslav Macík, and Timna Breßgott. 2020. Daisy: A Friendly Conversational Agent for Older Adults. In Proceedings of the 2nd Conference on Conversational User Interfaces. 1–3.

Digital Library

[41]

Cory-Ann Smarr, Tracy L. Mitzner, Jenay M. Beer, Akanksha Prakash, Tiffany L. Chen, Charles C. Kemp, and Wendy A. Rogers. 2014. Domestic Robots for Older Adults: Attitudes, Preferences, and Potential. International Journal of Social Robotics 6, 2 (April 2014), 229–247. https://doi.org/10.1007/s12369-013-0220-0

[42]

Tamara Zubatiy and Elizabeth Mynatt. 2020. Empowering Older Adults With Mild Cognitive Impairment And Their Caregivers Using Conversational Agents. http://casforhealth.org/wp-content/uploads/2020/04/Empowering-Older-Adults-With-Mild-Cognitive-Impairment-And-Their-Caregivers-Using-Conversational-Agents.pdf

Cited By

Mathur NZubatiy TMynatt E(2025)A Research Through Design Study on AI Explanations for Collaborative Everyday Tasks for Older Adults Aging in PlaceCompanion Proceedings of the 2025 ACM International Conference on Supporting Group Work10.1145/3688828.3699640(48-53)Online publication date: 12-Jan-2025
https://dl.acm.org/doi/10.1145/3688828.3699640
Gleaton ECatrambone R(2024)Usability Assessment of a Conversational Agent Among Older Adults Ages 65+: Gender and Marital Status DifferencesProceedings of the International Symposium on Human Factors and Ergonomics in Health Care10.1177/232785792413100113:1(230-235)Online publication date: 3-Sep-2024
https://doi.org/10.1177/2327857924131001
Esquivel PGill KGoldberg MSundaram SMorris LDing D(2024)Voice Assistant Utilization among the Disability Community for Independent Living: A Rapid Review of Recent EvidenceHuman Behavior and Emerging Technologies10.1155/2024/64949442024(1-39)Online publication date: 12-Apr-2024
https://doi.org/10.1155/2024/6494944
Show More Cited By

Index Terms

Empowering Dyads of Older Adults With Mild Cognitive Impairment And Their Care Partners Using Conversational Agents

Index terms have been assigned to the content through auto-classification.

Recommendations

A Collaborative Approach to Support Medication Management in Older Adults with Mild Cognitive Impairment Using Conversational Assistants (CAs)
ASSETS '22: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility

Improving medication management for older adults with Mild Cognitive Impairment (MCI) requires designing systems that support functional independence and provide compensatory strategies as their abilities change. Traditional medication management ...
A Field Study of Older Adults with Cognitive Impairment using Tablets for Communication at Home: Closing Technology Adoption Gaps using InTouch

This article describes how a tablet-based communication technology designed for older adults was explored for its adoption and impact on family relationships. A case study methodology was employed to collect and analyze interviews, field notes, ...
Recruiting Older Adults in the Wild: Reflections on Challenges and Lessons Learned from Research Experience
PervasiveHealth '18: Proceedings of the 12th EAI International Conference on Pervasive Computing Technologies for Healthcare

It is important to understand the older adults prior to the design process. The understanding can better facilitate design conversations between the researchers and the older adults. In this paper, we discussed our experiences of building a relationship ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

47
Total Citations
View Citations
1,170
Total Downloads

Downloads (Last 12 months)294
Downloads (Last 6 weeks)35

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mathur NZubatiy TMynatt E(2025)A Research Through Design Study on AI Explanations for Collaborative Everyday Tasks for Older Adults Aging in PlaceCompanion Proceedings of the 2025 ACM International Conference on Supporting Group Work10.1145/3688828.3699640(48-53)Online publication date: 12-Jan-2025
https://dl.acm.org/doi/10.1145/3688828.3699640
Gleaton ECatrambone R(2024)Usability Assessment of a Conversational Agent Among Older Adults Ages 65+: Gender and Marital Status DifferencesProceedings of the International Symposium on Human Factors and Ergonomics in Health Care10.1177/232785792413100113:1(230-235)Online publication date: 3-Sep-2024
https://doi.org/10.1177/2327857924131001
Esquivel PGill KGoldberg MSundaram SMorris LDing D(2024)Voice Assistant Utilization among the Disability Community for Independent Living: A Rapid Review of Recent EvidenceHuman Behavior and Emerging Technologies10.1155/2024/64949442024(1-39)Online publication date: 12-Apr-2024
https://doi.org/10.1155/2024/6494944
Altwala NBull CKirk D(2024)Exploring the Potential of AI Chatbots for Supporting Individuals with Dementia: Thematic Insights from User-Centered WorkshopsProceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3690907(432-434)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3690907
Qian ZFu JZhou Y(2024)Gaining Technological Autonomy and Soci-emotional Support: A Case Study of How and Why Chinese Older Adults Engage with a Semi-acquaintance Online CommunityProceedings of the ACM on Human-Computer Interaction10.1145/36869808:CSCW2(1-35)Online publication date: 8-Nov-2024
https://dl.acm.org/doi/10.1145/3686980
Yang ZXu XYao BRogers EZhang SIntille SShara NGao GWang D(2024)Talk2Care: An LLM-based Voice Assistant for Communication between Healthcare Providers and Older AdultsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596258:2(1-35)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659625
Cuadra ABreuch JEstrada SIhim DHung IAskaryar DHassanien MFessele KLanday J(2024)Digital Forms for All: A Holistic Multimodal Large Language Model Agent for Health Data EntryProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596248:2(1-39)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659624
Liu DGao SChen ZShen YShi CShi BMa X(2024)Exploring Scaffolding Techniques for Agent-Administered Brief Cognitive Screening in Hospital SettingsCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3663697(185-189)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3663697
Chang MLee AHan NHuang ASimão HReig SMohammad Ali AMartinez RKhanuja NZimmerman JForlizzi JSteinfeld A(2024)Dynamic Agent Affiliation: Who Should the AI Agent Work for in the Older Adult's Care Network?Proceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661500(1774-1788)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661500
Ruitenburg YLee MIJsselsteijn WMarkopoulos P(2024)Seeking Truth, Comfort, and Connection: How Conversational User Interfaces can help Couples with Dementia Manage Reality DisjunctionProceedings of the 6th ACM Conference on Conversational User Interfaces10.1145/3640794.3665547(1-15)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3640794.3665547
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten