poster

Watch Your Flavors: Augmenting People’s Flavor Perceptions and Associated Emotions based on Videos Watched while Eating

Authors:

Meetha Nesam James,

Nimesha Ranasinghe,

Lora OehlbergAuthors Info & Claims

CHI EA '22: CHI Conference on Human Factors in Computing Systems Extended Abstracts

Article No.: 429, Pages 1 - 8

https://doi.org/10.1145/3491101.3519846

Published: 28 April 2022 Publication History

Abstract

People engage in different activities while eating alone, such as watching television or scrolling through social media on their phones. However, the impacts of these visual contents on human cognitive processes, particularly related to flavor perception and its attributes, are still not thoroughly explored. This paper presents a user study to evaluate the influence of six different types of video content (including nature, cooking, and a new food video genre known as mukbang) on people’s flavor perceptions in terms of taste sensations, liking, and emotions while eating plain white rice. Our findings revealed that the participants’ flavor perceptions are augmented based on different video content, indicating significant differences in their perceived taste sensations (e.g., increased perception of salty and spicy sensations). Furthermore, potential future implications are revealed to promote digital commensality and healthier eating habits.

References

[1]

Mahmoud A Alamir and Kristy Hansen. 2021. The effect of type and level of background noise on food liking: A laboratory non-focused listening test. Applied Acoustics 172(2021), 107600.

[2]

John Anderer. 2019. ‘Zombie Eating’: 88% Of Adults Dine While Staring At A Screen, Survey Finds. https://www.studyfinds.org/zombie-eating-88-percent-adults-dine-while-staring-at-screen-survey-finds/

[3]

Laurensia Anjani, Terrance Mok, Anthony Tang, Lora Oehlberg, and Wooi Boon Goh. 2020. Why Do People Watch Others Eat Food? An Empirical Study on the Motivations and Practices of Mukbang Viewers. Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376567

Digital Library

[4]

Julia Aucoin. 2019. Virtual Commensality: Mukbang and Food Television. Ph.D. Dissertation. McGill University,Canada. https://library.umaine.edu/auth/EZproxy/test/authej.asp?url=https://search.proquest.com/dissertations-theses/virtual-commensality-mukbang-food-television/docview/2507072518/se-2?accountid=14583 Copyright - Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works; Last updated - 2021-10-20.

[5]

Malika Auvray and Charles Spence. 2008. The multisensory perception of flavor. Consciousness and cognition 17, 3 (2008), 1016–1031.

[6]

Shoshana Blum-Kulka. 1993. “You gotta know how to tell a story”: Telling, tales, and tellers in American and Israeli narrative events at dinner. Language in Society 22, 3 (1993), 361–402.

[7]

Isabelle Boutrolle, Julien Delarue, Delphine Arranz, Michel Rogeaux, and Egon Peter Köster. 2007. Central location test vs. home use test: Contrasting results depending on product type. Food Quality and Preference 18, 3 (2007), 490–499.

[8]

Eleonora Ceccaldi, Gijs Huisman, Gualtiero Volpe, and Maurizio Mancini. 2020. Guess Who’s Coming to Dinner? Surveying Digital Commensality During Covid-19 Outbreak. In Companion Publication of the 2020 International Conference on Multimodal Interaction (Virtual Event, Netherlands) (ICMI ’20 Companion). Association for Computing Machinery, New York, NY, USA, 317–321. https://doi.org/10.1145/3395035.3425649

Digital Library

[9]

Hanwool Choe. 2019. Eating together multimodally: Collaborative eating in mukbang, a Korean livestream of eating. Language in Society 48, 2 (2019), 171–208.

[10]

Ashley Thuthao Keng Dam. 2009. Mukbang and the Progression Toward Digital Commensality.

[11]

Frederick Erickson. 1982. Money tree, lasagna bush, salt and pepper: Social construction of topical cohesion in a conversation among Italian-Americans. Analyzing discourse: Text and talk, Washington. 43–70 pages.

[12]

Claude Fischler. 2011. Commensality, society and culture. Social science information 50, 3-4 (2011), 528–548.

[13]

Mendel Friedman. 2003. Nutritional consequences of food processing. Forum of nutrition 56(2003), 350—352.

[14]

Maximo Gacula Jr and Sheri Rutenbeck. 2006. Sample size in consumer test and descriptive analysis. Journal of sensory studies 21, 2 (2006), 129–145.

[15]

Walter R Gove and Michael R Geerken. 1977. Response bias in surveys of mental health: An empirical investigation. American journal of Sociology 82, 6 (1977), 1289–1317.

[16]

Marion M Hetherington, Annie S Anderson, Geraldine NM Norton, and Lisa Newson. 2006. Situational effects on meal intake: A comparison of eating alone and eating with others. Physiology & behavior 88, 4-5 (2006), 498–505.

[17]

Sara R Jaeger and Christelle Porcherot. 2017. Consumption context in consumer research: Methodological perspectives. Current Opinion in Food Science 15 (2017), 30–37.

[18]

Sunjoo Jang, Haeyoung Lee, and Seunghye Choi. 2021. Associations among solo dining, self-determined solitude, and depression in South Korean university students: a cross-sectional study. International journal of environmental research and public health 18, 14(2021), 7392.

[19]

EunKyo Kang, Jihye Lee, Kyae Hyung Kim, and Young Ho Yun. 2020. The popularity of eating broadcast: Content analysis of “mukbang” YouTube videos, media coverage, and the health impact of “mukbang” on public. Health informatics journal 26, 3 (2020), 2237–2248.

[20]

Nobuyuki Kawai, Zhuogen Guo, and Ryuzaburo Nakata. 2021. A human voice, but not human visual image makes people perceive food to taste better and to eat more:“Social” facilitation of eating in a digital media. Appetite 167(2021), 105644.

[21]

Silvia C King, Herbert L Meiselman, and B Thomas Carr. 2010. Measuring emotions associated with foods in consumer testing. Food Quality and Preference 21, 8 (2010), 1114–1116.

[22]

Kagan Kircaburun, Andrew Harris, Filipa Calado, and Mark D Griffiths. 2021. The psychology of mukbang watching: A scoping review of the academic and non-academic literature. International Journal of Mental Health and Addiction 19, 4 (2021), 1190–1213.

[23]

Harry T Lawless, Hildegarde Heymann, 2010. Sensory evaluation of food: principles and practices. Vol. 2. Springer, New York.

[24]

Deborah Lupton. 2020. Understanding digital food cultures. Routledge, London.

[25]

Neil Malhotra. 2008. Completion time and response order effects in web surveys. Public opinion quarterly 72, 5 (2008), 914–934.

[26]

Herbert L. Meiselman. 2008. Experiencing food products within a physical and social context. Elsevier, San Diego, 559–580. https://doi.org/10.1016/B978-008045089-6.50027-7

[27]

Takuji Narumi, Munehiko Sato, Tomohiro Tanikawa, and Michitaka Hirose. 2010. Evaluating Cross-Sensory Perception of Superimposing Virtual Color onto Real Drink: Toward Realization of Pseudo-Gustatory Displays. In Proceedings of the 1st Augmented Human International Conference (Megève, France) (AH ’10). Association for Computing Machinery, New York, NY, USA, Article 18, 6 pages. https://doi.org/10.1145/1785455.1785473

Digital Library

[28]

M Ng, C Chaya, and J Hort. 2013. Beyond liking: Comparing the measurement of emotional response using EsSense Profile and consumer defined check-all-that-apply methodologies. Food Quality and Preference 28, 1 (2013), 193–205.

[29]

Marianna Obrist, Carlos Velasco, Chi Vi, Nimesha Ranasinghe, Ali Israr, Adrian Cheok, Charles Spence, and Ponnampalam Gopalakrishnakone. 2016. Sensing the future of HCI: touch, taste, and smell user interfaces. interactions 23, 5 (2016), 40–49.

Digital Library

[30]

Marianna Obrist, Carlos Velasco, Chi Thanh Vi, Nimesha Ranasinghe, Ali Israr, Adrian D. Cheok, Charles Spence, and Ponnampalam Gopalakrishnakone. 2016. Touch, Taste, & Smell User Interfaces: The Future of Multisensory HCI. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems(San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 3285–3292. https://doi.org/10.1145/2851581.2856462

Digital Library

[31]

Ethan Pancer, Matthew Philp, Maxwell Poole, and Theodore J Noseworthy. 2021. Content Hungry: How the Nutrition of Food Media Influences Social Media Engagement.

[32]

Beulah Pereira, Billy Sung, and Sean Lee. 2019. I like watching other people eat: A cross-cultural analysis of the antecedents of attitudes towards Mukbang. Australasian marketing journal 27, 2 (2019), 78–90.

[33]

P. Pliner and R. Bell. 2009. A table for one: the pain and pleasure of eating alone. Woodhead Publishing, Cambridge, 169–189. https://doi.org/10.1533/9781845695712.4.169

[34]

Nimesha Ranasinghe, Meetha Nesam James, Michael Gecawicz, Jonathan Bland, and David Smith. 2020. Influence of Electric Taste, Smell, Color, and Thermal Sensory Modalities on the Liking and Mediated Emotions of Virtual Flavor Perception. Association for Computing Machinery, New York, NY, USA, 296–304. https://doi-org.wv-o-ursus-proxy02.ursus.maine.edu/10.1145/3382507.3418862

[35]

Nimesha Ranasinghe, Kasun Karunanayaka, Adrian David Cheok, Owen Noel Newton Fernando, Hideaki Nii, and Ponnampalam Gopalakrishnakone. 2011. Digital Taste and Smell Communication. In Proceedings of the 6th International Conference on Body Area Networks (Beijing, China) (BodyNets ’11). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Brussels, BEL, 78–84.

[36]

Nimesha Ranasinghe, Kuan-Yi Lee, Gajan Suthokumar, and Ellen Yi-Luen Do. 2014. Taste+: Digitally Enhancing Taste Sensations of Food and Beverages. In Proceedings of the 22nd ACM International Conference on Multimedia (Orlando, Florida, USA) (MM ’14). Association for Computing Machinery, New York, NY, USA, 737–738. https://doi.org/10.1145/2647868.2654878

Digital Library

[37]

Nimesha Ranasinghe, Thi Ngoc Tram Nguyen, Yan Liangkun, Lien-Ya Lin, David Tolley, and Ellen Yi-Luen Do. 2017. Vocktail: A Virtual Cocktail for Pairing Digital Taste, Smell, and Color Sensations. In Proceedings of the 25th ACM International Conference on Multimedia (Mountain View, California, USA) (MM ’17). Association for Computing Machinery, New York, NY, USA, 1139–1147. https://doi.org/10.1145/3123266.3123440

Digital Library

[38]

Jeffery Sobal and Mary K Nelson. 2003. Commensal eating patterns: a community study. Appetite 41, 2 (2003), 181–190.

[39]

Charles Spence, Carmel A Levitan, Maya U Shankar, and Massimiliano Zampini. 2010. Does food color influence taste and flavor perception in humans?Chemosensory Perception 3, 1 (2010), 68–84.

[40]

Charles Spence, Maurizio Mancini, and Gijs Huisman. 2019. Digital commensality: Eating and drinking in the company of technology. Frontiers in psychology 10 (2019), 2252.

[41]

Charles Spence, Xiaoang Wan, Andy Woods, Carlos Velasco, Jialin Deng, Jozef Youssef, and Ophelia Deroy. 2015. On tasty colours and colourful tastes? Assessing, explaining, and utilizing crossmodal correspondences between colours and basic tastes. Flavour 4, 1 (2015), 1–17.

[42]

Wakako Takeda, Melissa K Melby, and Yuta Ishikawa. 2018. Who eats with family and how often? Household members and work styles influence frequency of family meals in urban Japan. Appetite 125(2018), 160–171.

[43]

Aner Tal, Scott Zuckerman, and Brian Wansink. 2014. Watch what you eat: action-related television content increases food intake. JAMA Internal Medicine 174, 11 (2014), 1842–1843.

[44]

Deborah Tannen 2005. Conversational style: Analyzing talk among friends. Oxford University Press, United Kingdom.

[45]

Qian Janice Wang, Steve Keller, and Charles Spence. 2017. Sounds spicy: Enhancing the evaluation of piquancy by means of a customised crossmodally congruent soundtrack. Food quality and preference 58 (2017), 1–9.

[46]

Alan Warde. 2016. The practice of eating. John Wiley & Sons, United Kingdom.

[47]

Luke Yates and Alan Warde. 2017. Eating together and eating alone: meal arrangements in British households. The British journal of sociology 68, 1 (2017), 97–118.

Cited By

Cooney SDang MJackson RPerdoncin S(2024)#Haul: An analysis of YouTube Discourse Surrounding Over-Consumption and Sustainability in Haul VideosProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685373(1-32)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685373
Chen WYang YLiu KPai YYamaoka JMinamizawa K(2024)Cymatics Cup: Shape-Changing Drinks by Leveraging CymaticsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642920(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642920
Karhu NRantala JFarooq ASand APennanen KLappi JNayak MSozer NRaisamo R(2024)The effects of haptic, visual and olfactory augmentations on food consumed while wearing an extended reality headsetJournal on Multimodal User Interfaces10.1007/s12193-024-00447-8Online publication date: 11-Dec-2024
https://doi.org/10.1007/s12193-024-00447-8

Index Terms

Watch Your Flavors: Augmenting People’s Flavor Perceptions and Associated Emotions based on Videos Watched while Eating
1. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Why do people watch others eat food? An Empirical Study on the Motivations and Practices of Mukbang Viewers
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

We present a mixed-methods study of viewers on their practices and motivations around watching mukbang — video streams of people eating large quantities of food. Viewers' experiences provide insight on future technologies for multisensorial video streams ...
Understanding Screen-based Dining Practices through the Lens of Mindful Eating
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

Our eating practices are increasingly overshadowed by the presence of screen-based media technologies that conflict with the ideologies of mindful eating. However, little is known about whether and how screens influence our eating behaviors. To ...
Flavor-Videos: Enhancing the Flavor Perception of Food while Eating with Videos
IMX '22: Proceedings of the 2022 ACM International Conference on Interactive Media Experiences

People are typically involved in different activities while eating, particularly when eating alone, such as watching television or playing games on their phones. Previous research in Human-Food Interaction (HFI) has primarily focused on studying people’...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems

April 2022

3066 pages

ISBN:9781450391566

DOI:10.1145/3491101

Editors:
Simone Barbosa
PUC-Rio, Brazil
,
Cliff Lampe
University of Michigan, USA
,
Caroline Appert
Université Paris-Saclay, France
,
David A. Shamma
Toyota Research Institute, USA

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

CHI '22

Sponsor:

SIGCHI

CHI '22: CHI Conference on Human Factors in Computing Systems

April 29 - May 5, 2022

LA, New Orleans, USA

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
278
Total Downloads

Downloads (Last 12 months)67
Downloads (Last 6 weeks)10

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cooney SDang MJackson RPerdoncin S(2024)#Haul: An analysis of YouTube Discourse Surrounding Over-Consumption and Sustainability in Haul VideosProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685373(1-32)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685373
Chen WYang YLiu KPai YYamaoka JMinamizawa K(2024)Cymatics Cup: Shape-Changing Drinks by Leveraging CymaticsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642920(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642920
Karhu NRantala JFarooq ASand APennanen KLappi JNayak MSozer NRaisamo R(2024)The effects of haptic, visual and olfactory augmentations on food consumed while wearing an extended reality headsetJournal on Multimodal User Interfaces10.1007/s12193-024-00447-8Online publication date: 11-Dec-2024
https://doi.org/10.1007/s12193-024-00447-8

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents