research-article

Hot Under the Collar: Mapping Thermal Feedback to Dimensional Models of Emotion

Authors:

Dobromir Dobrev,

Stephen A. BrewsterAuthors Info & Claims

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Pages 4838 - 4849

https://doi.org/10.1145/2858036.2858205

Published: 07 May 2016 Publication History

Abstract

There are inherent associations between temperature and emotion in language, cognition and subjective experience [22,42]. However, there exists no systematic mapping of thermal feedback to models of emotion that could be used by designers and users to convey a range of emotions in HCI. A common way of classifying emotions and quantifying emotional experience is through ratings along valence and arousal dimensions, originating from Russell's circumplex model [32]. Therefore, the research in this paper mapped subjective ratings of a range of thermal stimuli to the circumplex model to understand the range of emotions that might be conveyed through thermal feedback. However, as the suitability of the model varies depending on the type of emotional stimuli [31], we also compared the goodness of fit of ratings between the circumplex and vector [8,31] models of emotion. The results showed that thermal feedback was interpreted as representing a limited range of emotions concentrated in just two quadrants or categories of the circumplex: high valence, low arousal and low valence, high arousal. Warm stimuli were perceived as more pleasant/positive than cool stimuli and altering either the rate or extent of temperature change affected both valence and arousal axes simultaneously. The results showed a significantly better fit to a vector model than to the circumplex.

References

[1]

Akshita, Harini Sampath, Bipin Indurkhya, Eunhwa Lee, and Yudong Bae. 2015. Towards Multimodal Affective Feedback?: Interaction between Visual and Haptic Modalities. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '15), 2043--2052. http://doi.acm.org/10.1145/2702123.2702288

Digital Library

[2]

Betsy App, Daniel N McIntosh, Catherine L Reed, and Matthew J Hertenstein. 2011. Nonverbal channel use in communication of emotion: how may depend on why. Emotion 11, 3: 603--617. http://doi.org/10.1037/a0023164

[3]

Solomon E Asch. 1946. Forming impressions of personality. Journal of abnormal psychology 41: 258--290. http://doi.org/10.1037/h0060423

[4]

Pascal Belin, Sarah Fillion-Bilodeau, and Frédéric Gosselin. 2008. The Montreal Affective Voices: a validated set of nonverbal affect bursts for research on auditory affective processing. Behavior research methods 40, 2: 531--539. http://doi.org/10.3758/BRM.40.2.531

[5]

John Bowlby. 1969. Attachment and Loss. Hogarth Press, London.

[6]

Margaret Bradley and Peter J Lang. 2007. The International Affective Picture System (IAPS) in the Study of Emotion and Attention. In Handbook of Emotion Elicitation and Assessment, Richard J. Davidson, Paul Ekman and Klaus R. Scherer (eds.). Oxford Press, Oxford.

[7]

Margaret Bradley and Peter Lang. 1999. International Affective Digitized Sounds (IADS): Stimuli, Instruction Manual and Affective Ratings. Gainesville, FL.

[8]

Margaret M Bradley, Mark K Greenwald, Margaret C Petry, and Peter J Lang. 1992. Remembering Pictures?: Pleasure and Arousal in Memory. Journal of Experimental Psychology: Learning, Memory and Cognition 18, 2: 379--390. http://dx.doi.org/10.1037/0278--7393.18.2.379

[9]

Erik Cambria, Andrew Livingstone, and Amir Hussain. 2012. The hourglass of emotions. Cognitive Behavioural Systems 7403 LNCS: 144--157. http://doi.org/10.1007/978--3--642--34584--5_11

Digital Library

[10]

Olivier Collignon, Simon Girard, Frederic Gosselin, Dave Saint-amour, Franco Lepore, and Maryse Lassonde. 2010. Women process multisensory emotion expressions more efficiently than men. Neuropsychologia 48: 220--225. http://doi.org/10.1016/j.neuropsychologia.2009.09.007

[11]

Paul Ekman. 1993. Facial Expression and Emotion. American Psychologist 48, 4: 376--379.

[12]

Susan T. Fiske, Amy J.C. Cuddy, and Peter Glick. 2007. Universal dimensions of social cognition: warmth and competence. Trends in Cognitive Sciences 11, 2: 77--83. http://doi.org/10.1016/j.tics.2006.11.005

[13]

Johnny R J Fontaine, Klaus R. Scherer, Etienne B. Roesch, and Phoebe C. Ellsworth. 2007. The world of emotions is not two-dimensional. Psychological Science 18, 12: 1050--1057. http://doi.org/10.1111/j.1467--9280.2007.02024.x

[14]

Alf Gabrielsson. 2002. Emotion perceived and emotion felt?: same or different? Musicae Scientiae, 2001: 123--147.

[15]

Daniel Gooch and Leon Watts. 2010. Communicating social presence through thermal hugs. Proceedings of Workshop on Social Interaction in Spatially Separated Environments (SISSI '10), 11--19.

[16]

Lincoln Gray, Joseph C Stevens, and Lawrence E Marks. 1982. Thermal Stimulus Thresholds: Sources of variability. Physiology & Behavior 29, 2: 355--360. http://dx.doi.org/10.1016/0031--9384(82)90026--9

[17]

Martin Halvey, Michael Henderson, Stephen A. Brewster, Graham Wilson, and Stephen A. Hughes. 2012. Augmenting Media with Thermal Stimulation. Proceedings of International Workshop on Haptic and Audio Interaction Design (HAID '12), 91--100. http://dx.doi.org/10.1007/978--3--642--32796--4_10

Digital Library

[18]

Martin Halvey, Graham Wilson, Stephen A. Brewster, and Stephen Hughes. 2012. "Baby It's Cold Outside": The Influence of Ambient Temperature and Humidity on Thermal Feedback. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 715--724. http://dx.doi.org/10.1145/2207676.2207779.

Digital Library

[19]

Harry F. Harlow. 1958. The Nature of Love. American Psychologist 13: 673--685.

[20]

Matthew J Hertenstein, Rachel Holmes, Margaret McCullough, and Dacher Keltner. 2009. The communication of emotion via touch. Emotion 9, 4: 566--573. http://dx.doi.org/10.1037/a0016108

[21]

Matthew J Hertenstein, Dacher Keltner, Betsy App, Brittany a Bulleit, and Ariane R Jaskolka. 2006. Touch communicates distinct emotions. Emotion 6, 3: 528--533. http://doi.org/10.1037/1528--3542.6.3.528

[22]

Hans Ijzerman and Gun R Semin. 2009. The Thermometer of Social Relations. Psychological Science 20, 10: 1214--1220. http://doi.org/10.1111/j.1467--9280.2009.02434.x

[23]

George Lakoff and Mark Johnson. 1999. Philosophy in the Flesh: The embodied mind and its challenge to Western thought. Harper-Collins, NY.

[24]

Peter J Lang, Margaret M Bradley, and BN Cuthbert. 2008. International Affective Picture System (IAPS): Technical Manual and Affective Ratings. Gainesville, FL.

[25]

Wonjun Lee and Youn-kyung Lim. 2012. Explorative research on the heat as an expression medium: focused on interpersonal communication. Personal and Ubiquitous Computing 16: 1039--1049. http://dx.doi.org/10.1007/s00779-011-0424-y

Digital Library

[26]

Mutsuhiro Nakashige, Minoru Kobayashi, Yuriko Suzuki, Hidekazu Tamaki, and Suguru Higashino. 2009. "Hiya-Atsu" media: augmenting digital media with temperature. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09) Extended Asbtracts, 3181--3186. http://dx.doi.org/10.1145/1520340.1520453

Digital Library

[27]

Lauri Nummenmaa, Enrico Glerean, Riitta Hari, and Jari K Hietanen. 2013. Bodily maps of emotions. Proceedings of the National Academy of Sciences 111, 2: 646--651. http://doi.org/10.1073/pnas.1321664111/

[28]

Marianna Obrist, Sriram Subramanian, Elia Gatti, Benjamin Long, and Thomas Carter. 2015. Emotions Mediated Through Mid-Air Haptics. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '15), 2053--2062. http://doi.acm.org/10.1145/2702123.2702361

Digital Library

[29]

Ranier Reisenzein. 1994. Pleasure-arousal theory and the intensity of emotions. Journal of Personality and Social Psychology 67, 3: 525--539. http://doi.org/10.1037/0022--3514.67.3.525

[30]

Michael D Robinson and Gerald L Clore. 2002. Belief and feeling: evidence for an accessibility model of emotional self-report. Psychological bulletin 128, 6: 934--960. http://doi.org/10.1037/0033--2909.128.6.934

[31]

David C Rubin and Jennifer M Talarico. 2009. A comparison of dimensional models of emotion: evidence from emotions, prototypical events, autobiographical memories, and words. Memory 17, 8: 802--808. http://doi.org/10.1080/09658210903130764

[32]

James A Russell. 1980. A Circumplex Model of Affect. Journal of Personality and Social Psychology 39, 6: 1161--1178. http://dx.doi.org/10.1037/h0077714

[33]

Katri Salminen, Veikko Surakka, Jukka Raisamo, Jani Lylykangas, Johannes Pystynen, Roope Raisamo, Kalle Makela and Teemu Ahnaniemi. 2011. Emotional Responses to Thermal Stimuli. Proceedings of ICMI 2011, 193--196. http://doi.acm.org/10.1145/2070481.2070513

Digital Library

[34]

Katri Salminen, Veikko Surakka, Jukka Raisamo, Jani Lylykangas, Roope Raisamo, Kalle Makela and Teemu Ahnaniemi. 2013. Cold or hot? How thermal stimuli are related to human emotional system? Proceedings of International Workshop on Haptic and Audio Interaction Design (HAID '13) 7989: 20--29. http://doi.org/10.1007/978--3--642--41068-0_3

[35]

Katri Salminen, Veikko Surakka, Jani Lylykangas, Jukka Raisamo, Rami Saarinen, Roope Raisamo, Jussi Rantala and Grigori Evreinov. 2008. Emotional and behavioral responses to haptic stimulation. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08), 1555--1562. http://dx.doi.org/10.1145/1357054.1357298

Digital Library

[36]

Marc Schröder. 2003. Experimental study of affect bursts. Speech Communication 40, 1--2: 99--116. http://doi.org/10.1016/S0167--6393(02)00078-X

[37]

Hasti Seifi and Karon E. Maclean. 2013. A first look at individuals' affective ratings of vibrations. Proceedings of World Haptics 2013, 605--610. http://doi.org/10.1109/WHC.2013.6548477

[38]

Joseph C Stevens. 1991. Thermal Sensibility. In The Psychology of Touch, MA Heller and W Schiff (eds.). Lawrence Erlbaum, NJ.

[39]

Katja Suhonen, Sebastian Muller, Jussi Rantala, Kaisa Vaananen-Vainio-Mattila, Roope Raisamo, and Vuokko Lantz. 2012. Haptically Augmented Remote Speech Communication: A Study of User Practices and Experiences. Proceedings of the Nordic Conference on Human-Computer Interaction (NordiCHI '12), 361--369. http://doi.acm.org/10.1145/2399016.2399073

Digital Library

[40]

Katja Suhonen, Kaisa Väänänen-Vainio-Mattila, and Kalle Mäkelä. 2012. User experiences and expectations of vibrotactile, thermal and squeeze feedback in interpersonal communication. Proceedings of the Annual BCS Interaction Specialist Group Conference on People and Computers (BCS-HCI '12), 205--214. http://dl.acm.org/citation.cfm?id=2377916.2377939

Digital Library

[41]

David Watson and Auke Tellegen. 1985. Toward a consensual structure of mood. Psychological bulletin 98, 2: 219--235. http://doi.org/10.1037/00332909.98.2.219

[42]

Lawrence Williams and John A. Bargh. 2008. Experiencing physical warmth promotes interpersonal warmth. Science 322, 1: 606--607. http://dx.doi.org/10.1126/science.1162548

[43]

Graham Wilson, Gavin Davidson, and Stephen Brewster. 2015. In the Heat of the Moment?: Subjective Interpretations of Thermal Feedback During Interaction. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '15), 2063--2072. http://doi.acm.org/10.1145/2702123.2702219

Digital Library

[44]

Graham Wilson, Martin Halvey, Stephen A Brewster, and Stephen A Hughes. 2011. Some Like it Hot? Thermal Feedback for Mobile Devices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 2555--2564. http://doi.acm.org/10.1145/1978942.1979316

Digital Library

[45]

Taekbeom Yoo, Yongjae Yoo, and Seungmoon Choi. 2014. An Explorative Study on Crossmodal Congruence Between Visual and Tactile Icons Based on Emotional Responses. Proceedings of ICMI 2014, 96--103. http://doi.org/10.1145/2663204.2663231

Digital Library

[46]

Yongjae Yoo, Taekbeom Yoo, Jihyun Kong, and Seungmoon Choi. 2015. Emotional Responses of Tactile Icons?: Effects of Amplitude, Frequency, Duration, and Envelope. Proceedings of World Haptics 2015, 235--240. http://dx.doi.org/10.1109/WHC.2015.7177719

Cited By

Mwaita KBhaumik RAhmed ASharma ADe Angeli AHaller M(2024)Emotion-Aware In-Car Feedback: A Comparative StudyMultimodal Technologies and Interaction10.3390/mti80700548:7(54)Online publication date: 25-Jun-2024
https://doi.org/10.3390/mti8070054
He SZeng HXue MHuang GYao CYing F(2024)Affective Stroking: Design Thermal Mid-Air Tactile for Assisting People in Stress RegulationApplied Sciences10.3390/app1420949414:20(9494)Online publication date: 17-Oct-2024
https://doi.org/10.3390/app14209494
Park WKorres GJamil MEid M(2024)Neural correlates of thermal stimulation during active touchFrontiers in Neuroscience10.3389/fnins.2023.132041717Online publication date: 8-Jan-2024
https://doi.org/10.3389/fnins.2023.1320417
Show More Cited By

Index Terms

Hot Under the Collar: Mapping Thermal Feedback to Dimensional Models of Emotion
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

HaptiColor: Interpolating Color Information as Haptic Feedback to Assist the Colorblind
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Most existing colorblind aids help their users to distinguish and recognize colors but not compare them. We present HaptiColor, an assistive wristband that encodes discrete color information into spatiotemporal vibrations to support colorblind users to ...
COGCAM: Contact-free Measurement of Cognitive Stress During Computer Tasks with a Digital Camera
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Contact-free camera-based measurement of cognitive stress opens up new possibilities for human-computer interaction with applications in remote learning, stress monitoring, and optimization of workload for user experience. The autonomic nervous system ...
Legacy Contact: Designing and Implementing Post-mortem Stewardship at Facebook
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Post-mortem profiles on social network sites serve as both an archive of the deceased person's life and a gathering place for friends and loved ones. Many existing systems utilize inheritance as a model for post-mortem data management. However, the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

May 2016

6108 pages

ISBN:9781450333627

DOI:10.1145/2858036

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI '16 Paper Acceptance Rate 565 of 2,435 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

69
Total Citations
View Citations
991
Total Downloads

Downloads (Last 12 months)139
Downloads (Last 6 weeks)9

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mwaita KBhaumik RAhmed ASharma ADe Angeli AHaller M(2024)Emotion-Aware In-Car Feedback: A Comparative StudyMultimodal Technologies and Interaction10.3390/mti80700548:7(54)Online publication date: 25-Jun-2024
https://doi.org/10.3390/mti8070054
He SZeng HXue MHuang GYao CYing F(2024)Affective Stroking: Design Thermal Mid-Air Tactile for Assisting People in Stress RegulationApplied Sciences10.3390/app1420949414:20(9494)Online publication date: 17-Oct-2024
https://doi.org/10.3390/app14209494
Park WKorres GJamil MEid M(2024)Neural correlates of thermal stimulation during active touchFrontiers in Neuroscience10.3389/fnins.2023.132041717Online publication date: 8-Jan-2024
https://doi.org/10.3389/fnins.2023.1320417
Kang SKim GHwang SPark JElsharkawy AKim S(2024)Flip-Pelt: Motor-Driven Peltier Elements for Rapid Thermal Stimulation and Congruent Pressure Feedback in Virtual RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676363(1-15)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676363
MacDonald SFreeman EPollick FBrewster S(2024)Prototyping and Evaluation of Emotionally Resonant Vibrotactile Comfort Objects as a Calming Social Anxiety InterventionACM Transactions on Computer-Human Interaction10.1145/364861531:4(1-48)Online publication date: 19-Sep-2024
https://dl.acm.org/doi/10.1145/3648615
Feng FBennett DMekler E(2024)Smiles Summon the Warmth of Spring: A Design Framework for Thermal-Affective Interaction based in Chinese Cí PoetryProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661620(2802-2819)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661620
Moesgen TCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Understanding and Designing Thermal ExperiencesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3634893(1-4)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3634893
Moesgen TGowrishankar RXiao YCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Designing Beyond Hot and Cold – Exploring Full-Body Heat Experiences in SaunaProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633364(1-14)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633364
Knierim MBraun LPerusquia-Hernandez M(2024)Warmth on Demand: Designing Headphones for Enhanced Thermal Comfort in Work EnvironmentsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650884(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650884
Guo YWang RFeng YLu YWang XTanaka FMi H(2024)ROMEO: Towards the Design of Robot with Haptic Mediation for Remote ConflictExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650781(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650781
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents