research-article

Remote assistance using visual prompts for demented elderly in cooking

Authors:

Zeeshan Asghar,

Antti Pitkanen,

Hirokazu KatoAuthors Info & Claims

ISABEL '11: Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies

Article No.: 46, Pages 1 - 5

https://doi.org/10.1145/2093698.2093744

Published: 26 October 2011 Publication History

Abstract

This paper presents a smart kitchen system for supporting demented elderly cooking in a kitchen. In this system, a remote supporter provides a user with verbal and visual prompts manually. As a prompting method for this system projection should be chosen as a priority because it enables direct pointing of targets in a real scene. Even if projection is used as a priority, this system should be designed to solve three practical problems: 1) there are many areas where sharp images cannot be projected in a kitchen, 2) kitchen is a too complex environment to display visual prompts using only a single method, 3) remote supporters do not know the kitchen environment well enough. In this paper we propose a novel system overcoming the above problems as follows, respectively.¹⁾ The system first tries indirect projection of circular markers as visual prompts around target objects.²⁾ Proper method is automatically selected from using projector, embedded monitor and illumination devices based on environmental information.³⁾ The system automatically acquires flat surfaces to project on and their reflectance properties as the environmental information. Based on an observation of two elderly suffering from dementia, we discuss the feasibility and concrete problems in displaying visual prompt and how to solve them technically.

References

[1]

L. Bonanni and C.-H. Lee. The kitchen as a graphical user interface. In ACM SIGGRAPH 2004 Art gallery, SIGGRAPH '04, pages 109--111, New York, NY, USA, 2004. ACM.

Digital Library

[2]

J. Chen, K. Chang, P. Chi, and H. Chu. A smart kitchen to promote healthy cooking. In Proceedings of the 8th International Conference on Ubiquitous Computing (ACM UBICOMP 2006), 2006.

[3]

P. Chi, J. Chen, H. Chu, and J. Lo. Enabling calorie-aware cooking in a smart kitchen. In Proceedings of the 3rd International Conference on Persuasive Technology, PERSUASIVE '08, pages 116--127, Berlin, Heidelberg, 2008. Springer-Verlag.

Digital Library

[4]

M. A. Fischler and R. C. Bolles. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM, 24:381--395, June 1981.

Digital Library

[5]

S. R. Fussell, L. D. Setlock, and R. E. Kraut. Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '03, pages 513--520, New York, NY, USA, 2003. ACM.

Digital Library

[6]

B. Hestnes, S. Heiestad, P. Brooks, and L. Drageset. Real situations of wearable computers used for video conferencing - and implications for terminal and network design. In Proceedings of the 5th IEEE International Symposium on Wearable Computers, ISWC '01, pages 85--93, Washington, DC, USA, 2001. IEEE Computer Society.

Digital Library

[7]

W. Ju, R. Hurwitz, T. Judd, and B. Lee. CounterActive: An interactive cookbook for the kitchen counter. In in Extended Abstracts CHI 2001, pages 269--270. ACM Press, 2001.

Digital Library

[8]

N. Kasuya, I. Kitahara, Y. Kameda, and Y. Ohta. Robust trajectory estimation of soccer players by using two cameras. In 19th International Conference on Pattern Recognition, ICPR2008, pages 1--4, Dec. 2008.

[9]

M. Kimura, M. Mochimaru, and T. Kanade. Projector calibration using arbitrary planes and calibrated camera. In IEEE International Workshop on Projector-Camera System (Procams2007), pages 1--2, 2007.

[10]

R. E. Kraut, M. D. Miller, and J. Siegel. Collaboration in performance of physical tasks: effects on outcomes and communication. In Proceedings of the 1996 ACM conference on Computer supported cooperative work, CSCW '96, pages 57--66, New York, NY, USA, 1996. ACM.

Digital Library

[11]

T. Kurata, N. Sakata, M. Kourogi, H. Kuzuoka, and M. Billinghurst. Remote collaboration using a shoulder-worn active camera/laser. In Proceedings of the Eighth International Symposium on Wearable Computers, ISWC '04, pages 62--69, Washington, DC, USA, 2004. IEEE Computer Society.

Digital Library

[12]

H. Kuzuoka. Spatial workspace collaboration: a sharedview video support system for remote collaboration capability. In Proceedings of the SIGCHI conference on Human factors in computing systems, CHI '92, pages 533--540, New York, NY, USA, 1992. ACM.

Digital Library

[13]

H. Kuzuoka, T. Kosuge, and M. Tanaka. GestureCam: a video communication system for sympathetic remote collaboration. In Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work, CSCW '94, pages 35--43, New York, NY, USA, 1994. ACM.

Digital Library

[14]

C. J. Lee, L. Bonanni, J. H. Espinosa, H. Lieberman, and T. Selker. Augmenting kitchen appliances with a shared context using knowledge about daily events. In Proceedings of the 11th International Conference on Intelligent User Interfaces, IUI '06, pages 348--350, New York, NY, USA, 2006. ACM.

Digital Library

[15]

S. Mann. Telepointer: Hands-free completely self contained wearable visual augmented reality without headwear and without any infrastructural reliance. In Proceedings of the 4th IEEE International Symposium on Wearable Computers, ISWC '00, pages 177--178, Washington, DC, USA, 2000. IEEE Computer Society.

Digital Library

[16]

A. Mihailidis, J. Boger, M. Canido, and J. Hoey. The use of an intelligent prompting system for people with dementia. Interactions, 14:34--37, July 2007.

Digital Library

[17]

P. Olivier, G. Xu, A. Monk, and J. Hoey. Ambient kitchen: designing situated services using a high fidelity prototyping environment. In Proceedings of the 2nd International Conference on Pervasive Technologies Related to Assistive Environments, PETRA '09, pages 47:1--47:7, New York, NY, USA, 2009. ACM.

Digital Library

[18]

L. Terrenghi, O. Hilliges, and A. Butz. Kitchen stories: sharing recipes with the living cookbook. Personal Ubiquitous Comput., 11:409--414, June 2007.

Digital Library

[19]

J. P. Wherton and A. F. Monk. Problems people with dementia have with kitchen tasks: The challenge for pervasive computing. Interacting with Computers, 22:253--266, July 2010.

Digital Library

Cited By

Weber PCosta LLudwig T(2025)Bridging Distances through Virtual Cook-Along Sessions: Exploring the Design Space of Collaborative Remote Cooking ExperiencesProceedings of the ACM on Human-Computer Interaction10.1145/37011859:1(1-29)Online publication date: 10-Jan-2025
https://dl.acm.org/doi/10.1145/3701185
Mikhailova VConde MDöring N(2024)“Like a Virtual Family Reunion”: Older Adults Defining Requirements for an Augmented Reality Communication SystemInformation10.3390/info1501005215:1(52)Online publication date: 17-Jan-2024
https://doi.org/10.3390/info15010052
Ahmad IAsghar ZKumar TLi GManzoor AMikhaylov KShah SHoyhtya MReponen JHuusko JHarjula E(2022)Emerging Technologies for Next Generation Remote Health Care and Assisted LivingIEEE Access10.1109/ACCESS.2022.317727810(56094-56132)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3177278
Show More Cited By

Index Terms

Remote assistance using visual prompts for demented elderly in cooking
1. Information systems
  1. World Wide Web
    1. Web applications
      1. Internet communications tools
        Web conferencing

Recommendations

Cooking risk analysis to enhance safety of elderly people in smart kitchen
PETRA '15: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments

Risk analysis during cooking activities enables to build a cooking-safe system in order to enhance safety of elderly people in smart kitchen. The Kitchen is the second place where majority of domestic accidents occur, and in particular the oven presents ...
FoodManager: a cooking, eating and appliance controlling support system for the elderly
PETRA '10: Proceedings of the 3rd International Conference on PErvasive Technologies Related to Assistive Environments

These days, many support systems are being developed to improve independence and quality of life of elderly and impaired people at home. Most of them have been hitherto focused on providing home healthcare-related services, and little attention has been ...
Remote assistance for people with dementia at home using reminiscence systems and a schedule prompter

We developed a system that remotely supports the daily lives of people with dementia at home using reminiscence video and a reminiscence conversation system with a schedule prompter to produce relaxation and prevent behavioural disturbances. Quality ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ISABEL '11: Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies

October 2011

949 pages

ISBN:9781450309134

DOI:10.1145/2093698

Conference Chair:
Simone Frattasi,
Program Chair:
Nicola Marchetti

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Universitat Pompeu Fabra
IEEE
Technical University of Catalonia Spain: Technical University of Catalonia (UPC), Spain
River Publishers: River Publishers
CTTC: Technological Center for Telecommunications of Catalonia
CTIF: Kyranova Ltd, Center for TeleInFrastruktur

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ISABEL '11

Sponsor:

Technical University of Catalonia Spain
River Publishers
CTTC
CTIF

ISABEL '11: International Symposium on Applied Sciences in Biomedical and Communication Technologies

October 26 - 29, 2011

Barcelona, Spain

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
451
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)1

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Weber PCosta LLudwig T(2025)Bridging Distances through Virtual Cook-Along Sessions: Exploring the Design Space of Collaborative Remote Cooking ExperiencesProceedings of the ACM on Human-Computer Interaction10.1145/37011859:1(1-29)Online publication date: 10-Jan-2025
https://dl.acm.org/doi/10.1145/3701185
Mikhailova VConde MDöring N(2024)“Like a Virtual Family Reunion”: Older Adults Defining Requirements for an Augmented Reality Communication SystemInformation10.3390/info1501005215:1(52)Online publication date: 17-Jan-2024
https://doi.org/10.3390/info15010052
Ahmad IAsghar ZKumar TLi GManzoor AMikhaylov KShah SHoyhtya MReponen JHuusko JHarjula E(2022)Emerging Technologies for Next Generation Remote Health Care and Assisted LivingIEEE Access10.1109/ACCESS.2022.317727810(56094-56132)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3177278
Williams TJones SLutteroth CDekoninck EBoyd HKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Augmented Reality and Older Adults: A Comparison of Prompting TypesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445476(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445476
Van Hove SAll AConradie PDe Marez L(2020)Holistic Assessment of Situated Cooking Interactions: Preliminary Results of an Observational StudyDesign, User Experience, and Usability. Design for Contemporary Interactive Environments10.1007/978-3-030-49760-6_11(158-174)Online publication date: 19-Jul-2020
https://dl.acm.org/doi/10.1007/978-3-030-49760-6_11
Rice MMa KTay HKaliappan JKoh WTan WNg J(2018)Evaluating an augmented remote assistance platform to support industrial applications2018 IEEE 4th World Forum on Internet of Things (WF-IoT)10.1109/WF-IoT.2018.8355133(592-597)Online publication date: Feb-2018
https://doi.org/10.1109/WF-IoT.2018.8355133
Pizzagalli SSpoladore DArlati SSacco MGreci L(2018)HIC: An interactive and ubiquitous home controller system for the smart home2018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH)10.1109/SeGAH.2018.8401374(1-6)Online publication date: May-2018
https://doi.org/10.1109/SeGAH.2018.8401374
Hyry JKrichenbauer MYamamoto GTaketomi TSandor CKato HPulli P(2017)[Paper] Design of Assistive Tabletop Projector-Camera System for the Elderly with Cognitive and Motor Skill ImpairmentsITE Transactions on Media Technology and Applications10.3169/mta.5.575:2(57-66)Online publication date: 2017
https://doi.org/10.3169/mta.5.57
Escalante MTsekleves EBingley AGradinar A(2017)‘Ageing Playfully’: a story of forgetting and rememberingDesign for Health10.1080/24735132.2017.12955291:1(134-145)Online publication date: 10-Mar-2017
https://doi.org/10.1080/24735132.2017.1295529
Asghar ZYamamoto GTaketomi TSandor CKato HPulli P(2016)Remote Assistance for Elderly to Find Hidden Objects in a KitcheneHealth 360°10.1007/978-3-319-49655-9_1(3-8)Online publication date: 1-Dec-2016
https://doi.org/10.1007/978-3-319-49655-9_1
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents