research-article

Rethinking the Mobile Food Journal: Exploring Opportunities for Lightweight Photo-Based Capture

Authors:

Felicia Cordeiro,

Elizabeth Bales,

James FogartyAuthors Info & Claims

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Pages 3207 - 3216

https://doi.org/10.1145/2702123.2702154

Published: 18 April 2015 Publication History

Abstract

Food choices are among the most frequent and important health decisions in everyday life, but remain notoriously difficult to capture. This work examines opportunities for lightweight photo-based capture in mobile food journals. We first report on a survey of 257 people, examining how they define healthy eating, their experiences and challenges with existing food journaling methods, and their ability to interpret nutritional information that can be captured in a food journal. We then report on interviews and a field study with 27 participants using a lightweight, photo-based food journal for between 4 to 8 weeks. We discuss mismatches between motivations and current designs, challenges of current approaches to food journaling, and opportunities for photos as an alternative to the pervasive but often inappropriate emphasis on quantitative tracking in mobile food journals.

References

[1]

Amft, O., Stäger, M., Lukowicz, P., and Tröster, G. Analysis of Chewing Sounds for Dietary Monitoring. UbiComp 2005, 56--72.

Digital Library

[2]

Andrew, A.H., Borriello, G., and Fogarty, J. Simplifying Mobile Phone Food Diaries: Design and Evaluation of a Food Index-Based Nutrition Diary. PervasiveHealth 2013, 260--263.

Digital Library

[3]

Arab, L., Estrin, D., Kim, D.H., Burke, J., and Goldman, J. (2011). Feasibility Testing of an Automated Image-Capture Method to Aid Dietary Recall. Eur J Clin Nutr, 65(10), 1156--1162.

[4]

Barrett-Connor, E. (1991). Nutrition Epidemiology: How Do We Know What They Ate? Am J Clin Nutr, 54(1 Suppl), 182S--187S.

[5]

Baumer, E.P.S., Katz, S.J., Freeman, J.E., Adams, P., Gonzales, A.L., Pollak, J., Retelny, D., Niederdeppe, J., Olson, C.M., and Gay, G.K. Prescriptive Persuasion and Open-Ended Social Awareness. CSCW 2012, 475--484.

Digital Library

[6]

Bird, G. and Elwood, P.C. (1983). The Dietary Intakes of Subjects Estimated from Photographs Compared with a Weighed Record. Hum Nutr Appl Nutr, 37(6), 470--473.

[7]

Burke, B.S. (1947). The Dietary History as a Tool in Research. J Am Diet Assoc, 23(12), 1041--1046.

[8]

Burke, L.E., Wang, J., and Sevick, M.A. (2011). Self-Monitoring in Weight Loss: A Systematic Review of the Literature. J Am Diet Assoc, 111(1), 92--102.

[9]

Chahoud, G., Aude, Y.W., and Mehta, J.L. (2004). Dietary Recommendations in the Prevention and Treatment of Coronary Heart Disease: Do We Have the Ideal Diet Yet? Am J Cardiol, 94(10), 1260--1267.

[10]

Choe, E.K., Lee, N.B., Lee, B., Pratt, W., and Kientz, J.A. Understanding Quantified-Selfers? Practices in Collecting and Exploring Personal Data. CHI 2014, 1143--1152.

Digital Library

[11]

Cordeiro, F., Epstein, D.,Thomaz, E., Bales, E., Jagannathan, A.K., Abowd, G., and Fogarty, J. Barriers and Negative Nudges: Exploring Challenges in Food Journaling. CHI 2015, To Appear.

Digital Library

[12]

Craig, M.R., Kristal, A.R., Cheney, C.L., and Shattuck, A.L. (2000). The Prevalence and Impact of 'Atypical' Days in 4-Day Food Records. J Am Diet Assoc, 100(4), 421--427.

[13]

Frost, J. and Smith, B.K. Visualizing Health: Imagery in Diabetes Education. DUX 2003, 1--14.

Digital Library

[14]

Grimes, A. and Harper, R. Celebratory Technology: New Directions for Food Research in HCI. CHI 2008, 467--476.

Digital Library

[15]

Heizer, W.D., Southern, S., and McGovern, S. (2009). The Role of Diet in Symptoms of Irritable Bowel Syndrome in Adults: A Narrative Review. J Am Diet Assoc, 109(7), 1204--1214.

[16]

Hollis, J.F., Gullion, C.M., Stevens, V.J., Brantley, P.J., Appel, L.J., Ard, J.D., Champagne, C.M., Dalcin, A., Erlinger, T.P., Funk, K., Laferriere, D., Lin, P.-H., Loria, C.M., Samuel-Hodge, C., Vollmer, W.M., and Svetkey, L.P. (2008). Weight Loss During the Intensive Intervention Phase of the Weight-Loss Maintenance Trial. Am J Prev Med, 35(2), 118--126.

[17]

Kanfer, F.H. (1970). Self-Monitoring: Methodological Limitations and Clinical Applications. J Consult Clin Psych, 35(2), 148--152.

[18]

Kong, F. and Tan, J. DietCam: Regular Shape Food Recognition with a Camera Phone. BSN 2011, 127--132.

Digital Library

[19]

Lansky, D. and Brownell, K.D. (1982). Estimates of Food Quantity and Calories: Errors in Self-Report among Obese Patients. Am J Clin Nutr, 35(4), 727--732.

[20]

Livingstone, M.B., Prentice, A.M., Strain, J.J., Coward, W.A., Black, A.E., Barker, M.E., McKenna, P.G., and Whitehead, R.G. (1990). Accuracy of Weighed Dietary Records in Studies of Diet and Health. BMJ, 300(6726), 708--712.

[21]

Mamykina, L., Mynatt, E., Davidson, P., and Greenblatt, D. MAHI: Investigation of Social Scaffolding for Reflective Thinking in Diabetes Management. CHI 2008, 477--486.

Digital Library

[22]

Mamykina, L., Mynatt, E.D., and Kaufman, D.R. Investigating Health Management Practices of Individuals with Diabetes. CHI 2006, 927--936.

Digital Library

[23]

Mankoff, J., Hsieh, G., Hung, H.C., Lee, S., and Nitao, E. Using Low-Cost Sensing to Support Nutritional Awareness. UbiComp 2002, 371--376.

Digital Library

[24]

Marr, J.W. (1971). Individual Dietary Surveys: Purposes and Methods. World Rev Nutr Diet, 13, 105--164.

[25]

Mattila, E., Pärkkä, J., Hermersdorf, M., Kaasinen, J., Vainio, J., Samposalo, K., Merilahti, J., Kolari, J., Kulju, M., Lappalainen, R., and Korhonen, I. (2008). Mobile Diary for Wellness Management - Results on Usage and Usability in Two User Studies. IEEE Trans Inf Technol Biomed, 12(4), 501--512.

Digital Library

[26]

Nelson, M., Atkinson, M., and Darbyshire, S. (1996). Food Photography II: Use of Food Photographs for Estimating Portion Size and the Nutrient Content of Meals. Br J Nutr, 76(1), 31--49.

[27]

Noronha, J., Hysen, E., Zhang, H., and Gajos, K.Z. Platemate: Crowdsourcing Nutritional Analysis from Food Photographs. UIST 2011, 1--12.

Digital Library

[28]

Purpura, S., Schwanda, V., Williams, K., Stubler, W., and Sengers, P. Fit4Life: The Design of a Persuasive Technology Promoting Healthy Behavior and Ideal. CHI 2011, 423--432.

Digital Library

[29]

Rahman, T., Adams, A.T., Zhang, M., Cherry, E., Zhou, B., Peng, H., and Choudhury, T. BodyBeat: A Mobile System for Sensing Non-Speech Body Sounds. MobiSys 2014, 2--13.

Digital Library

[30]

Sicherer, S.H. and Sampson, H.A. (2010). Food Allergy. J Allergy Clin Immunol, 125(2 Suppl 2), S116--S125.

[31]

Stone, A.A., Shiffman, S., Schwartz, J.E., Broderick, J.E., and Hufford, M.R. (2003). Patient Compliance with Paper and Electronic Diaries. Control Clin Trials, 24(2), 182--199.

[32]

Thomaz, E., Parnami, A., Essa, I., and Abowd, G.D. Feasibility of Identifying Eating Moments from First-Person Images Leveraging Human Computation. SenseCam 2013, 26--33.

Digital Library

[33]

Tsai, C.C., Lee, G., Raab, F., Norman, G.J., Sohn, T., Griswold, W.G., and Patrick, K. (2007). Usability and Feasibility of PmEB: A Mobile Phone Application for Monitoring Real Time Caloric Balance. Mobile Netw Appl, 12(2-3), 173--184.

Digital Library

[34]

Urist, J. My Fitness Band Is Making Me Fat: Users Complain of Weight Gain with Trackers. Today.com, July 16, 2014.

[35]

Wansink, B. and van Ittersum, K. (2007). Portion Size Me: Downsizing Our Consumption Norms. J Am Diet Assoc, 107(7), 1103--1106.

[36]

Wilde, M.H. and Garvin, S. (2007). A Concept Analysis of Self-Monitoring. J Adv Nurs, 57(3), 339--350.

[37]

Zepeda, L. andDeal, D.(2008). Think BeforeYouEat: PhotographicFood DiariesasInterventionToolstoChange Dietary DecisionMakingand Attitudes.IntJ ConsumStud, 32(6), 692--698.

[38]

Zhu, F., Bosch, M., Boushey, C.J., and Delp, E.J. (2010). An Image Analysis System for Dietary Assessment and Evaluation. ICIP 2010, 1853--1856.

Cited By

Nogueira-Rio NVarela Vazquez LLopez-Santamarina AMondragon-Portocarrero AKarav SMiranda J(2024)Mobile Applications and Artificial Intelligence for Nutrition Education: A Narrative ReviewDietetics10.3390/dietetics30400353:4(483-503)Online publication date: 4-Nov-2024
https://doi.org/10.3390/dietetics3040035
Lee LHall RStanley JKrebs J(2024)Tailored Prompting to Improve Adherence to Image-Based Dietary Assessment: Mixed Methods StudyJMIR mHealth and uHealth10.2196/5207412(e52074-e52074)Online publication date: 15-Apr-2024
https://doi.org/10.2196/52074
Jung GPark SLee U(2024)DeepStress: Supporting Stressful Context Sensemaking in Personal Informatics Systems Using a Quasi-experimental ApproachProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642766(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642766
Show More Cited By

Index Terms

Rethinking the Mobile Food Journal: Exploring Opportunities for Lightweight Photo-Based Capture
1. Human-centered computing

Recommendations

When Personal Tracking Becomes Social: Examining the Use of Instagram for Healthy Eating
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Many people appropriate social media and online communities in their pursuit of personal health goals, such as healthy eating or increased physical activity. However, people struggle with impression management, and with reaching the right audiences when ...
Does Journaling Encourage Healthier Choices?: Analyzing Healthy Eating Behaviors of Food Journalers
DH '18: Proceedings of the 2018 International Conference on Digital Health

Past research has shown the benefits of food journaling in promoting mindful eating and healthier food choices. However, the links between journaling and healthy eating have not been thoroughly examined. Beyond caloric restriction, do journalers ...
Barriers and Negative Nudges: Exploring Challenges in Food Journaling
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Although food journaling is understood to be both important and difficult, little work has empirically documented the specific challenges people experience with food journals. We identify key challenges in a qualitative study combining a survey of 141 ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

4290 pages

ISBN:9781450331456

DOI:10.1145/2702123

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

134
Total Citations
View Citations
1,270
Total Downloads

Downloads (Last 12 months)98
Downloads (Last 6 weeks)12

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nogueira-Rio NVarela Vazquez LLopez-Santamarina AMondragon-Portocarrero AKarav SMiranda J(2024)Mobile Applications and Artificial Intelligence for Nutrition Education: A Narrative ReviewDietetics10.3390/dietetics30400353:4(483-503)Online publication date: 4-Nov-2024
https://doi.org/10.3390/dietetics3040035
Lee LHall RStanley JKrebs J(2024)Tailored Prompting to Improve Adherence to Image-Based Dietary Assessment: Mixed Methods StudyJMIR mHealth and uHealth10.2196/5207412(e52074-e52074)Online publication date: 15-Apr-2024
https://doi.org/10.2196/52074
Jung GPark SLee U(2024)DeepStress: Supporting Stressful Context Sensemaking in Personal Informatics Systems Using a Quasi-experimental ApproachProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642766(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642766
Kabir KWiese J(2023)A Meta-Synthesis of the Barriers and Facilitators for Personal Informatics SystemsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108937:3(1-35)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610893
Kuo PHorn M(2023)EcoSanté Lifestyle Intervention: Encourage Reflections on the Connections between Health and EnvironmentACM Transactions on Computer-Human Interaction10.1145/360932530:6(1-37)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3609325
Silva LAnkrah EHuai YEpstein D(2023)Exploring Opportunities for Multimodality and Multiple Devices in Food JournalingProceedings of the ACM on Human-Computer Interaction10.1145/36042567:MHCI(1-27)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604256
Rapp ABoldi A(2023)Exploring the Lived Experience of Behavior Change Technologies: Towards an Existential Model of Behavior Change for HCIACM Transactions on Computer-Human Interaction10.1145/360349730:6(1-50)Online publication date: 25-Sep-2023
https://dl.acm.org/doi/10.1145/3603497
Zhang MPapachristos EMerritt T(2023)Facilitating Mindful Eating with a Voice AssistantProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3604311(1-6)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3604311
Hoefer MVoida S(2023)Being, Having, Doing, and Interacting: A Personal Informatics Approach to Understanding Human Need Satisfaction in Everyday LifeProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596120(2593-2610)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596120
Hoefer MVoida S(2023)Tracking the Experience of Self in Everyday LifeExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585785(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585785
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents