demonstration

Robot Companions and Smartpens for Improved Social Communication of Dementia Patients

Authors:

Alexander Prange,

Indra Praveen Sandrala,

Markus Weber,

Daniel SonntagAuthors Info & Claims

IUI '15 Companion: Companion Proceedings of the 20th International Conference on Intelligent User Interfaces

Pages 65 - 68

https://doi.org/10.1145/2732158.2732174

Published: 29 March 2015 Publication History

Get Access

Abstract

In this demo paper we describe how a digital pen and a humanoid robot companion can improve the social communication of a dementia patient. We propose the use of NAO, a humanoid robot, as a companion to the dementia patient in order to continuously monitor his or her activities and provide cognitive assistance in daily life situations. For example, patients can communicate with NAO through natural language by the speech dialogue functionality we integrated. Most importantly, to improve communication, i.e., sending digital messages (texting, emails), we propose the usage of a smartpen, where the patients write messages on normal paper with an invisible dot pattern to initiate hand-writing and sketch recognition in real-time. The smartpen application is embedded into the human-robot speech dialogue.

References

[1]

Anthony, L., and Wobbrock, J. O. A lightweight multistroke recognizer for user interface prototypes. In Proceedings of Graphics Interface 2010, Canadian Information Processing Society (2010), 245--252.

Digital Library

Google Scholar

[2]

Broekens, J., Heerink, M., and Rosendal, H. Assistive social robots in elderly care: a review. Gerontechnology 8, 2 (2009).

Crossref

Google Scholar

[3]

Charness, N., Bosman, E., and Elliott, R. Senior-friendly input devices: Is the pen mightier than the mouse. In 103rd Annual Convention of the American Psychological Association Meeting, New York (1995).

Google Scholar

[4]

Husodo-Schulz, C., Sonntag, D., Weber, M., and Toyama, T. Multimodal interaction strategies in a multi-device environment around natural speech. In 18th International Conference on Intelligent User Interfaces, IUI '13, Santa Monica, CA, USA, March 19-22, 2013, Companion Volume (2013), 97--98.

Digital Library

Google Scholar

[5]

Luzzatti, C., Laiacona, M., and Agazzi, D. Multiple patterns of writing disorders in dementia of the alzheimer type and their evolution. Neuropsychologia 41, 7 (2003), 759--772.

Crossref

Google Scholar

[6]

Martn, F., Agero, C., Caas, J., Abella, G., Bentez, R., Rivero, S., Valenti, M., and Martnez-Martn, P. Robots in therapy for dementia patients. Journal of Physical Agents 7, 1 (2013).

Google Scholar

[7]

Oviatt, S. The Design of Future Educational Interfaces. Routledge, 2013.

Crossref

Google Scholar

[8]

Pollack, M. Intelligent technology for an aging population: The use of ai to assist elders with cognitive impairment. AI Magazine 26, 2 (2005).

Google Scholar

[9]

Smith, M. W., Sharit, J., and Czaja, S. J. Aging, motor control, and the performance of computer mouse tasks. Human Factors: The Journal of the Human Factors and Ergonomics Society 41, 3 (1999), 389--396.

Crossref

Google Scholar

[10]

Sonntag, D., Weber, M., Cavallaro, A., and Hammon, M. Integrating digital pens in breast imaging for instant knowledge acquisition. AI Magazine 35, 1 (2014), 26--37.

Digital Library

Google Scholar

[11]

Wahlster, W. Towards Symmetric Multimodality: Fusion and Fission of Speech, Gesture, and Facial Expression, vol. 2821 of Lecture Notes in Computer Science. Springer, Berlin, Heidelberg, 2003, 1--18.

Google Scholar

[12]

Weber, M., Liwicki, M., Schelske, Y. T. H., Schoelzel, C., Strauss, F., and Dengel, A. MCS for Online Mode Detection: Evaluation on Pen-Enabled Multi-Touch Interfaces. In 11th International Conference on Document Analysis and Recognition (2011), 957--961.

Digital Library

Google Scholar

Cited By

View all

Rogge A(2023)Defining, Designing and Distinguishing Artificial Companions: A Systematic Literature ReviewInternational Journal of Social Robotics10.1007/s12369-023-01031-y15:9-10(1557-1579)Online publication date: 7-Aug-2023
https://doi.org/10.1007/s12369-023-01031-y
Zhou DBarakova EAn PRauterberg M(2022)Assistant Robot Enhances the Perceived Communication Quality of People With Dementia: A Proof of ConceptIEEE Transactions on Human-Machine Systems10.1109/THMS.2021.311295752:3(332-342)Online publication date: Jun-2022
https://doi.org/10.1109/THMS.2021.3112957
Heimann-Steinert ALatendorf APrange ASonntag DMüller-Werdan U(2020)Digital pen technology for conducting cognitive assessments: a cross-over study with older adultsPsychological Research10.1007/s00426-020-01452-885:8(3075-3083)Online publication date: 17-Dec-2020
https://doi.org/10.1007/s00426-020-01452-8
Show More Cited By

Index Terms

Robot Companions and Smartpens for Improved Social Communication of Dementia Patients
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Do Robot Pets Decrease Agitation in Dementia Patients?: An Ethnographic Approach
Social Robotics
Abstract
Companion robots, and especially robotic pets, have been argued to have the potential for improving the well-being of elderly people with dementia. Previous research has mainly focused on short-term studies, conducted with relatively expensive ...
Interactive paper for radiology findings
IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

This paper presents a pen-based interface for clinical radiologists. It is of utmost importance in future radiology practices that the radiology reports be uniform, comprehensive, and easily managed. This means that reports must be "readable" to humans ...
Toward cognitive robot companions
HRI '08: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction

If robots have to be, one day, part of our environment and assist humans in their daily life, they will have to be endowed not only with the necessary functions for sensing, moving and acting, but also and inevitably, with more advanced cognitive ...

Comments

Information & Contributors

Information

Published In

IUI '15 Companion: Companion Proceedings of the 20th International Conference on Intelligent User Interfaces

March 2015

164 pages

ISBN:9781450333085

DOI:10.1145/2732158

General Chairs:
Oliver Brdiczka
Vectra Networks, Inc.
,
Polo Chau
Georgia Tech
,
Program Chairs:
Giuseppe Carenini
University of British Columbia
,
Shimei Pan
University of Maryland
,
Per Ola Kristensson
University of Cambridge

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 March 2015

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

IUI'15

Sponsor:

IUI'15: IUI'15 20th International Conference on Intelligent User Interfaces

March 29 - April 1, 2015

Georgia, Atlanta, USA

Acceptance Rates

IUI '15 Companion Paper Acceptance Rate 47 of 205 submissions, 23%;

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
402
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)4

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rogge A(2023)Defining, Designing and Distinguishing Artificial Companions: A Systematic Literature ReviewInternational Journal of Social Robotics10.1007/s12369-023-01031-y15:9-10(1557-1579)Online publication date: 7-Aug-2023
https://doi.org/10.1007/s12369-023-01031-y
Zhou DBarakova EAn PRauterberg M(2022)Assistant Robot Enhances the Perceived Communication Quality of People With Dementia: A Proof of ConceptIEEE Transactions on Human-Machine Systems10.1109/THMS.2021.311295752:3(332-342)Online publication date: Jun-2022
https://doi.org/10.1109/THMS.2021.3112957
Heimann-Steinert ALatendorf APrange ASonntag DMüller-Werdan U(2020)Digital pen technology for conducting cognitive assessments: a cross-over study with older adultsPsychological Research10.1007/s00426-020-01452-885:8(3075-3083)Online publication date: 17-Dec-2020
https://doi.org/10.1007/s00426-020-01452-8
Sonntag D(2019)Medical and health systemsThe Handbook of Multimodal-Multisensor Interfaces10.1145/3233795.3233808(423-476)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1145/3233795.3233808
Rifai HKelly PBerry D(2018)Dealing with uncertainty in a context aware pre-embarkation prompter system to support independent livingProceedings of the 32nd International BCS Human Computer Interaction Conference10.14236/ewic/HCI2018.204(1-7)Online publication date: 4-Jul-2018
https://dl.acm.org/doi/10.14236/ewic/HCI2018.204
Niemann MPrange ASonntag D(2018)Towards a Multimodal Multisensory Cognitive Assessment Framework2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS)10.1109/CBMS.2018.00012(24-29)Online publication date: Jun-2018
https://doi.org/10.1109/CBMS.2018.00012
Munteanu CSalah A(2017)Multimodal technologies for seniorsThe Handbook of Multimodal-Multisensor Interfaces10.1145/3015783.3015793(319-362)Online publication date: 24-Apr-2017
https://dl.acm.org/doi/10.1145/3015783.3015793
Ali FKwak DKhan PEi-Sappagh SIslam SPark DKwak K(2017)Merged Ontology and SVM-Based Information Extraction and Recommendation System for Social RobotsIEEE Access10.1109/ACCESS.2017.27180385(12364-12379)Online publication date: 2017
https://doi.org/10.1109/ACCESS.2017.2718038
Prange ASonntag D(2016)Easy Deployment of Spoken Dialogue Technology on Smartwatches for Mental HealthcarePervasive Computing Paradigms for Mental Health10.1007/978-3-319-32270-4_15(150-156)Online publication date: 9-Apr-2016
https://doi.org/10.1007/978-3-319-32270-4_15

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Do Robot Pets Decrease Agitation in Dementia Patients?: An Ethnographic Approach

Interactive paper for radiology findings

Toward cognitive robot companions