skip to main content
10.1145/3290607.3299041acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
extended-abstract
Public Access

The Tesserae Project: Large-Scale, Longitudinal, In Situ, Multimodal Sensing of Information Workers

Published: 02 May 2019 Publication History

Abstract

The Tesserae project investigates how a suite of sensors can measure workplace performance (e.g., organizational citizenship behavior), psychological traits (e.g., personality, affect), and physical characteristics (e.g., sleep, activity) over one year. We enrolled 757 information workers across the U.S. and measure heart rate, physical activity, sleep, social context, and other aspects through smartwatches, a phone agent, beacons, and social media. We report challenges that we faced with enrollment, privacy, and incentive structures while setting up such a long-term multimodal large-scale sensor study. We discuss the tradeoffs of remote versus in-person enrollment, and showed that directly paid, in-person enrolled participants are more compliant overall compared to remotely-enrolled participants. We find that providing detailed information regarding privacy concerns up-front is highly beneficial. We believe that our experiences can benefit other large sensor projects as this field grows.

Supplementary Material

MP4 File (cs11.mp4)

References

[1]
Daniel J Buysse, Charles. F Reynolds, Timothy H Monk, Susan R Berman, and David J Kupfer. 1989. The Pittsburgh Sleep Quality Index: A New Instrument for Psychiatric Practice and Research. Psychiatry Research 28, 2 (1989), 193--213.
[2]
Gloria Mark, Shamsi Iqbal, Mary Czerwinski, and Paul Johns. 2014. Capturing the Mood: Facebook and Face-to-Face Encounters in the Workplace. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing - CSCW '14. ACM Press, Baltimore, Maryland, USA, 1082--1094.
[3]
Philip M. Podsakoff, Scott B. MacKenzie, Jeong-Yeon Lee, and Nathan P. Podsakoff. 2003. Common Method Biases in Behavioral Research: A Critical Review of the Literature and Recommended Remedies. Journal of Applied Psychology 88, 5 (2003), 879--903.
[4]
Rachael Purta, Stephen Mattingly, Lixing Song, Omar Lizardo, David Hachen, Christian Poellabauer, and Aaron Striegel. 2016. Experiences Measuring Sleep and Physical Activity Patterns Across a Large College Cohort with Fitbits. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16). ACM, New York, NY, USA, 28--35.
[5]
Koustuv Saha, Ayse Elvan Bayraktaraglu, Andrew Campbell, Nitesh V Chawla, Munmun De Choudhury, Sidney K D'Mello, Anind K Dey, Ge Gao, Julie M Gregg, Krithika Jagannath, Gloria Mark, Gonzalo J Martinez, Stephen M Mattingly, Edward Moskal, Anusha Sirigiri, Aaron Striegel, Koustuv Yoo, Dong Whind Saha, Anusha Sirigiri, and Aaron Striegel. 2019. Social Media as a Passive Sensor in Longitudinal Studies of Human Behavior and Wellbeing. In CHI Ext. Abstracts. ACM.
[6]
Koustuv Saha, Larry Chan, Kaya De Barbaro, Gregory D. Abowd, and Munmun De Choudhury. 2017. Inferring Mood Instability on Social Media by Leveraging Ecological Momentary Assessments. Proc. IMWUT 1, 3 (Sept. 2017).
[7]
Rui Wang, Fanglin Chen, Zhenyu Chen, Tianxing Li, Gabriella Harari, Stefanie Tignor, Xia Zhou, Dror Ben-Zeev, and Andrew T. Campbell. 2014. StudentLife: Assessing Mental Health, Academic Performance and Behavioral Trends of College Students Using Smartphones. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '14 Adjunct. ACM Press, Seattle, Washington, 3--14.

Cited By

View all

Index Terms

  1. The Tesserae Project: Large-Scale, Longitudinal, In Situ, Multimodal Sensing of Information Workers

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems
    May 2019
    3673 pages
    ISBN:9781450359719
    DOI:10.1145/3290607
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2019

    Check for updates

    Author Tags

    1. phone agent
    2. privacy
    3. sensors
    4. smartwatches
    5. social media
    6. stress

    Qualifiers

    • Extended-abstract

    Funding Sources

    Conference

    CHI '19
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)475
    • Downloads (Last 6 weeks)72
    Reflects downloads up to 05 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Machine Learning for Multimodal Mental Health Detection: A Systematic Review of Passive Sensing ApproachesSensors10.3390/s2402034824:2(348)Online publication date: 6-Jan-2024
    • (2024)Identifying Links Between Productivity and Biobehavioral Rhythms Modeled From Multimodal Sensor Streams: Exploratory Quantitative StudyJMIR AI10.2196/471943(e47194)Online publication date: 18-Apr-2024
    • (2024)Digital Phenotyping for Stress, Anxiety, and Mild Depression: Systematic Literature ReviewJMIR mHealth and uHealth10.2196/4068912(e40689)Online publication date: 23-May-2024
    • (2024)Systematic Evaluation of Personalized Deep Learning Models for Affect RecognitionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997248:4(1-35)Online publication date: 21-Nov-2024
    • (2024)How Design Researchers Make Sense of Data Visualizations in Data-Driven Design: An Uncertainty-Aware Sensemaking ModelACM Transactions on Computer-Human Interaction10.1145/368526831:6(1-53)Online publication date: 31-Jul-2024
    • (2024)A Reproducible Stress Prediction Pipeline with Mobile Sensor DataProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785788:3(1-35)Online publication date: 9-Sep-2024
    • (2024)Exploring User Willingness towards Mobile Sensing and Intervention: A Case Study on Mental Health of Undergraduate College StudentsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678422(721-728)Online publication date: 5-Oct-2024
    • (2024)From Classification to Clinical InsightsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596048:2(1-25)Online publication date: 15-May-2024
    • (2024)Examining Algorithmic Metrics and their Effects through the Lens of ReactivityProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660676(3179-3192)Online publication date: 1-Jul-2024
    • (2024)Capturing the College ExperienceProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435018:1(1-37)Online publication date: 6-Mar-2024
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media