research-article

Projective testing of diurnal collective emotion

Authors:

Jorge Goncalves,

Pratyush Pandab,

Denzil Ferreira,

Mohammad Ghahramani,

Vassilis KostakosAuthors Info & Claims

UbiComp '14: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Pages 487 - 497

https://doi.org/10.1145/2632048.2636067

Published: 13 September 2014 Publication History

Abstract

Projective tests are personality tests that reveal individuals' emotions (e.g., Rorschach inkblot test). Unlike direct question-based tests, projective tests rely on ambiguous stimuli to evoke responses from individuals. In this paper we develop one such test, designed to be delivered automatically, anonymously and to a large community through public displays. Our work makes a number of contributions. First, we develop and validate in controlled conditions a quantitative projective test that can reveal emotions. Second, we demonstrate that this test can be deployed on a large scale longitudinally: we present a four-week deployment in our university's public spaces where 1431 tests were completed anonymously by passers-by. Third, our results reveal strong diurnal rhythms of emotion consistent with results we obtained independently using the Day Reconstruction Method (DRM), literature on affect, well-being, and our understanding of our university's daily routine.

Supplementary Material

MOV File (p487-goncalves.mov)

Download
89.45 MB

References

[1]

Ashby, F. G., Isen, A. M. and Turken, A. U. A neuropsychological theory of positive affect and its influence on cognition. Psychological Review 106, 3 (1999), 529.

[2]

Atkinson, A. P., Tunstall, M. L. and Dittrich, W. H. Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures. Cognition 104, 1 (2007), 59--72.

[3]

Aula, A. and Surakka, V. Auditory Emotional Feedback Facilitates Human-Computer Interaction. In People and Computers XVI - Memorable Yet Invisible, Springer (2002), 337--349.

[4]

Bollen, J., Mao, H. and Zeng, X. Twitter mood predicts the stock market. Journal of Computational Science 2, 1 (2011), 1--8.

[5]

Bradley, M. M. and Lang, P. J. Measuring emotion: the self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry 25, 1 (1994), 49--59.

[6]

Brown, B., Reeves, S. and Sherwood, S. Into the wild: challenges and opportunities for field trial methods. Proc. CHI'11, ACM (2011), 1657--1666.

Digital Library

[7]

Church, K., Cherubini, M. and Oliver, N. A Large-scale Study of Daily Information Needs Captured in Situ. ACM Transactions on Computer-Human Interaction 21, 2 (2014), 10:1--10:46.

Digital Library

[8]

Cordón, L. A. Popular psychology: an encyclopedia. Greenwood Press, Westport, Conn., 2005.

[9]

Ekman, P. and Friesen, W. V. Constants across cultures in the face and emotion. Journal of Personality and Social Psychology 17, 2 (1971), 124.

[10]

Elfenbein, H. A., Foo, M. D., White, J., Tan, H. H. and Aik, V. C. Reading your Counterpart: The Benefit of Emotion Recognition Accuracy for Effectiveness in Negotiation. Journal of Nonverbal Behavior 31, 4 (2007), 205--223.

[11]

Exner Jr, J. E., Erdberg, P., Weiner, I. B., Lichtenberger, E. O., et al. The Rorschach, A Comprehensive System, Volume 1, Basic Foundations and Principles of Interpretation (2003).

[12]

Fortson, K. N. Diurnal Pattern of On-the-Job Injuries, The. Monthly Lab. Rev 127 (2004), 18.

[13]

de Gelder, B. Towards the neurobiology of emotional body language. Nature Reviews Neuroscience 7, 3 (2006), 242--249.

[14]

Golder, S. A. and Macy, M. W. Diurnal and Seasonal Mood Vary with Work, Sleep, and Daylength Across Diverse Cultures. Science 333, 6051 (2011), 1878--1881.

[15]

Goncalves, J., Ferreira, D., Hosio, S., Liu, Y., Rogstadius, J., Kukka, H., Kostakos, V. Crowdsourcing on the spot: altruistic use of public displays, feasibility, performance, and behaviours. Proc. Ubicomp'13, ACM (2013), 753--762.

Digital Library

[16]

Goncalves, J., Hosio, S., Ferreira, D. and Kostakos, V. Game of Words: Tagging Places through Crowdsourcing on Public Displays. Proc. DIS'14, ACM (2014), 705--714.

Digital Library

[17]

Goncalves, J., Hosio, S., Liu, Y. and Kostakos, V. Eliciting Situated Feedback: A Comparison of Paper, Web Forms and Public Displays. Displays 35, 1 (2014), 27--37.

[18]

Gross, R. and Shi, J. The CMU Motion of Body (MoBo) Database. (2001).

[19]

Hernandez, J., Hoque, M., Drevo, W. and Picard, R. W. Mood Meter: Counting Smiles in the Wild. Proc. Ubicomp'12, ACM (2012), 301--310.

Digital Library

[20]

Hosio, S., Goncalves, J., Kostakos, V. and Riekki, J. Exploring Civic Engagement on Public Displays. In S. Saeed (Ed.), User-Centric Technology Design for Nonprofit and Civic Engagements. Springer International Publishing (2014), 91--111.

[21]

Hosio, S., Goncalves, J., Lehdonvirta, V., Ferreira, D. and Kostakos, V. Situated Crowdsourcing Using a Market Model. Proc. UIST'14, ACM (2014).

Digital Library

[22]

Izard, C. E. Human emotions. New York: Plenum Press, 1977.

[23]

Kahneman, D., Krueger, A. B., Schkade, D. A., Schwarz, N. and Stone, A. A. A survey method for characterizing daily life experience: the day reconstruction method. Science 306, 5702 (2004), 1776--1780.

[24]

Kirschbaum, C. and Hellhammer, D. H. Salivary cortisol in psychobiological research: an overview. Neuropsychobiology 22, 3 (1989), 150--169.

[25]

Kukka, H., Oja, H., Kostakos, V., Goncalves, J. and Ojala, T. What makes you click: exploring visual signals to entice interaction on public displays. Proc. CHI'13, ACM (2013), 1699--1708.

Digital Library

[26]

Lang, P. J., Bradley, M. M. and Cuthbert, B. N. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-8. 2008.

[27]

Lewalter, D. Cognitive strategies for learning from static and dynamic visuals. Learning and Instruction 13, 2 (2003), 177--189.

[28]

Mandryk, R. L. and Atkins, M. S. A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. International Journal of Human-Computer Studies 65, 4 (2007), 329--347.

Digital Library

[29]

McNeil, J. K., Stones, M. J., Kozma, A., Andres, D. Age Differences in Mood: Structure, Mean Level, and Diurnal Variation. Canadian Journal on Aging/La Revue Canadienne du Vieillissement 13, 02 (1994), 201--220.

[30]

Montepare, J. M., Goldstein, S. B. and Clausen, A. The identification of emotions from gait information. Journal of Nonverbal Behavior 11, 1 (1987), 33--42.

[31]

Partonen, T., Haukka, J., Pirkola, S., Isometsä, E. and Lönnqvist, J. Time patterns and seasonal mismatch in suicide. Acta Psychiatrica Scandinavica 109, 2 (2004), 110--115.

[32]

Pepe, A. and Bollen, J. Between conjecture and memento: shaping a collective emotional perception of the future. eprint arXiv:0801.3864, 2008.

[33]

Roether, C. L., Omlor, L., Christensen, A. and Giese, M. A. Critical features for the perception of emotion from gait. Journal of Vision 9, 6 (2009), 15.

[34]

Rui, H., Liu, Y. and Whinston, A. Whose and what chatter matters? The effect of tweets on movie sales. Decision Support Systems 55, 4 (2013), 863--870.

Digital Library

[35]

Scherer, K. R., Wranik, T., Sangsue, J., Tran, V. and Scherer, U. Emotions in everyday life: Probability of occurrence, risk factors, appraisal and reaction patterns. Social Science Information 43, 4 (2004), 499--570.

[36]

Schmidt, K. L. and Cohn, J. F. Human facial expressions as adaptations: Evolutionary questions in facial expression research. American Journal of Physical Anthropology 116, S33 (2001), 3--24.

[37]

Smolensky, M. H. and D'alonzo, G. E. Medical chronobiology: concepts and applications. American Review of Respiratory Disease 147, (1993), S2--S2.

[38]

Stone, A. A., Schwartz, J. E., Schkade, D., Schwarz, N., Krueger, A., Kahneman, D. A population approach to the study of emotion: diurnal rhythms of a working day examined with the Day Reconstruction Method. Emotion 6, 1 (2006), 139--49.

[39]

Stone, A. A., Smyth, J. M., Pickering, T. and Schwartz, J. Daily Mood Variability: Form of Diurnal Patterns and Determinants of Diurnal Patterns. Journal of Applied Social Psychology 26, 14 (1996), 1286--1305.

[40]

Theorell, T., Ahlberg-Hulten, G., Jodko, M., Sigala, F. and De La Torre, B. Influence of job strain and emotion on blood pressure in female hospital personnel during workhours. Scandinavian Journal of Work, Environment & Health 19, 5 (1993), 313--318.

[41]

Visidon • Home. http://visidon.fi/en/Home, retrieved 14/05/2014.

[42]

Wallbott, H. G. Bodily expression of emotion. European journal of Social Psychology 28, 6 (1998), 879--896.

[43]

Wang, L., Tan, T., Ning, H. and Hu, W. Silhouette analysis-based gait recognition for human identification. Pattern Analysis and Machine Intelligence, IEEE Transactions on 25, 12 (2003), 1505--1518.

Digital Library

[44]

Wood, C. and Magnello, M. E. Diurnal Changes in Perceptions of Energy and Mood. Journal of the Royal Society of Medicine 85, 4 (1992), 191--194.

Cited By

Cauchard JEpps JGoncalves JHäkkilä JHerdel VPerusquia-Hernandez M(2024)Affective Computing for Mobile TechnologiesAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680459(1-5)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680459
Somandepalli KSiy OJou B(2024)Relational Affect in Dyadic InteractionsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3637206(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3637206
Sasaki WHamanaka SMiyahara STsubouchi KNakazawa JOkoshi T(2024)Large-Scale Estimation and Analysis of Web Users' Mood from Web Search Query and Mobile Sensor DataBig Data10.1089/big.2022.021112:3(191-209)Online publication date: 1-Jun-2024
https://doi.org/10.1089/big.2022.0211
Show More Cited By

Index Terms

Projective testing of diurnal collective emotion
1. Human-centered computing

Recommendations

Personas and redundancies in crowdsourced testing
ICGSE '17: Proceedings of the 12th International Conference on Global Software Engineering

Crowdsourced testing is gaining a lot of attention these days. Crowdsourced testing utilizes testers which subscribe to an external or internal crowdsourcing platform. Usually these testers are distributed across geographies. Thus, such testing can be ...
Automatic User Testing and Emotion Detection in Interactive Urban Devices
Computational Science and Its Applications – ICCSA 2023
Abstract
Automated testing and evaluation of interfaces is a well-established reality supported by many tools that shorten the time to deploy new software versions to the user. However, exploring users’ emotions while interacting with interfaces as a tool ...
Emotion modeling from speech signal based on wavelet packet transform

The recognition of emotion in human speech has gained increasing attention in recent years due to the wide variety of applications that benefit from such technology. Detecting emotion from speech can be viewed as a classification task. It consists of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp '14: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 2014

973 pages

ISBN:9781450329682

DOI:10.1145/2632048

General Chairs:
AJ Brush
Microsoft Research
,
Adrian Friday
Lancaster University, UK
,
Program Chairs:
Julie Kientz
University of Washington
,
James Scott
Microsoft Research, UK
,
Junehwa Song
Korea Advanced Institute of Science and Technology (KAIST), KR

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

In-Cooperation

SIGSPATIAL: ACM Special Interest Group on Spatial Information

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Tekes
Suomen Akatemia
Infotech Oulu

Conference

UbiComp '14

Sponsor:

UbiComp '14: The 2014 ACM Conference on Ubiquitous Computing

September 13 - 17, 2014

Washington, Seattle

Acceptance Rates

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
389
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Cauchard JEpps JGoncalves JHäkkilä JHerdel VPerusquia-Hernandez M(2024)Affective Computing for Mobile TechnologiesAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680459(1-5)Online publication date: 21-Sep-2024
https://dl.acm.org/doi/10.1145/3640471.3680459
Somandepalli KSiy OJou B(2024)Relational Affect in Dyadic InteractionsExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3637206(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3637206
Sasaki WHamanaka SMiyahara STsubouchi KNakazawa JOkoshi T(2024)Large-Scale Estimation and Analysis of Web Users' Mood from Web Search Query and Mobile Sensor DataBig Data10.1089/big.2022.021112:3(191-209)Online publication date: 1-Jun-2024
https://doi.org/10.1089/big.2022.0211
Yang KTag BWang CGu YSarsenbayeva ZDingler TWadley GGoncalves J(2023)Survey on Emotion Sensing Using Mobile DevicesIEEE Transactions on Affective Computing10.1109/TAFFC.2022.322048414:4(2678-2696)Online publication date: 1-Oct-2023
https://doi.org/10.1109/TAFFC.2022.3220484
Yang KWang CGu YSarsenbayeva ZTag BDingler TWadley GGoncalves J(2023)Behavioral and Physiological Signals-Based Deep Multimodal Approach for Mobile Emotion RecognitionIEEE Transactions on Affective Computing10.1109/TAFFC.2021.310086814:2(1082-1097)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TAFFC.2021.3100868
Yang KTag BGu YWang CDingler TWadley GGoncalves JOria VSapino MSatoh SKerhervé BCheng WIde ISingh V(2022)Mobile Emotion Recognition via Multiple Physiological Signals using Convolution-augmented TransformerProceedings of the 2022 International Conference on Multimedia Retrieval10.1145/3512527.3531385(562-570)Online publication date: 27-Jun-2022
https://dl.acm.org/doi/10.1145/3512527.3531385
Hettiachchi DKostakos VGoncalves J(2022)A Survey on Task Assignment in CrowdsourcingACM Computing Surveys10.1145/349452255:3(1-35)Online publication date: 3-Feb-2022
https://dl.acm.org/doi/10.1145/3494522
Tag BGoncalves JWebber SKoval PKostakos V(2022)A Retrospective and a Look Forward: Lessons Learned From Researching Emotions In-the-WildIEEE Pervasive Computing10.1109/MPRV.2021.310627221:1(28-36)Online publication date: 1-Jan-2022
https://doi.org/10.1109/MPRV.2021.3106272
Tag BWebber SWadley GBartlett VGoncalves JKoval PSlovak PSmith WHollenstein TCox AKostakos V(2021)Making Sense of Emotion-Sensing: Workshop on Quantifying Human EmotionsAdjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460418.3479272(226-229)Online publication date: 21-Sep-2021
https://dl.acm.org/doi/10.1145/3460418.3479272
Ruensuk MCheon EHong HOakley I(2020)How Do You Feel OnlineProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34322234:4(1-32)Online publication date: 18-Dec-2020
https://dl.acm.org/doi/10.1145/3432223
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents