skip to main content
10.1145/2818346.2820760acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

I Would Hire You in a Minute: Thin Slices of Nonverbal Behavior in Job Interviews

Published: 09 November 2015 Publication History

Abstract

In everyday life, judgments people make about others are based on brief excerpts of interactions, known as thin slices. Inferences stemming from such minimal information can be quite accurate, and nonverbal behavior plays an important role in the impression formation. Because protagonists are strangers, employment interviews are a case where both nonverbal behavior and thin slices can be predictive of outcomes. In this work, we analyze the predictive validity of thin slices of real job interviews, where slices are defined by the sequence of questions in a structured interview format. We approach this problem from an audio-visual, dyadic, and nonverbal perspective, where sensing, cue extraction, and inference are automated. Our study shows that although nonverbal behavioral cues extracted from thin slices were not as predictive as when extracted from the full interaction, they were still predictive of hirability impressions with $R^2$ values up to $0.34$, which was comparable to the predictive validity of human observers on thin slices. Applicant audio cues were found to yield the most accurate results.

Supplementary Material

PDF File (icmi2456-file3.pdf)

References

[1]
Microcone: intelligent microphone array for groups {online}. Available: http://www.dev-audio.com/products/microcone/.
[2]
Speech feature extraction code {online}. Available: http://groupmedia.media.mit.edu/data.php.
[3]
N. Ambady, F. Bernieri, and J. Richeson. Toward a histology of social behavior: Judgmental accuracy from thin slices of the behavioral stream. Advances in Experimental Social Psychology, 2000.
[4]
N. Ambady, M. Hallahan, and R. Rosenthal. On Judging and Being Judged Accurately in Zero-Acquaintance Situations. J. of Personality and Social Psychology, 1995.
[5]
N. Ambady and R. Rosenthal. Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. Psychological Bulletin, 1992.
[6]
N. Anderson and V. Shackleton. Decision making in the graduate selection interview: A field study. J. of Occupational Psychology, 1990.
[7]
M. Barrick and M. Mount. The Big Five personality dimensions and job performance: A meta-analysis. J. of Personnel Psychology, 1991.
[8]
L. Batrinca, N. Mana, B. Lepri, F. Pianesi, and N. Sebe. Please, tell me about yourself: automatic personality assessment using short self-presentations. Proc. ICMI, 2011.
[9]
J. Biel, O. Aran, and D. Gatica-Perez. You are known by how you vlog: Personality impressions and nonverbal behavior in YouTube. In Proc. ICSWM, 2011.
[10]
L. Chen, M. Martin, and M. Ma. An initial analysis of structured video interviews by using multimodal emotion detection. In Proc. Workshop on Emotion Representations and Modelling for HCI Systems, 2014.
[11]
J. Curhan and A. Pentland. Thin slices of negotiation: Predicting outcomes from conversational dynamics within the first 5 minutes. J. of Applied Psychology, 2007.
[12]
T. DeGroot and S. Motowildo. Why visual and vocal interview cues can affect interviewers' judgments and predict job performance. J. of Applied Psychology, 1999.
[13]
R. Forbes and P. Jackson. Non-verbal behaviour and the outcome of selection interviews. J. of Occupational Psychology, 1980.
[14]
N. Gada-Jain. Intentional synchrony effects on job interview evaluation. Master's thesis, University of Toledo, 1999.
[15]
A. Huffcut, J. Conway, P. Roth, and N. Stone. Identification and meta-analytic assessment of psychological constructs measured in employment interviews. J. of Applied Psychology, 2001.
[16]
A. Imada and M. Hakel. Influence of nonverbal communication and rater proximity on impressions and decisions in simulated employment interviews. J. of Applied Psychology, 1977.
[17]
M. Knapp and J. Hall. Nonverbal communication in human interaction. Wadsworth, Cengage Learning, 2009.
[18]
B. Lepri, N. Mana, A. Cappelletti, and F. Pianesi. Automatic prediction of individual performance from "thin slices" of social behavior. In Proc. ICMI, 2009.
[19]
A. Madan. Thin Slices of Interest. PhD thesis, Massachusetts Institute of Technology, 2005.
[20]
I. Naim, M. Tanveer, D. Gildea, and M. E. Hoque. Automated prediction and analysis of job interview performance: The role of what you aay and how you say it. In Proc. FG, 2015.
[21]
L. Nguyen, D. Frauendorfer, M. Schmid Mast, and D. Gatica-Perez. Hire me: Computational inference of hirability in employment interviews based on nonverbal behavior. IEEE Trans. on Multimedia, 2014.
[22]
L. Nguyen, A. Marcos-Ramiro, M. Marrón Romera, and D. Gatica-Perez. Multimodal analysis of body communication cues in employment interviews. In Proc. ICMI, 2013.
[23]
L. Nguyen, J.-M. Odobez, and D. Gatica-Perez. Using self-context for multimodal detection of head nods in face-to-face interactions. In Proc. ICMI, 2012.
[24]
J.-M. Odobez and P. Bouthemy. Robust multiresolution estimation of parametric motion models. J. of Visual Communication and Image Representation, 1995.
[25]
C. Parsons and R. Liden. Interviewer perceptions of applicant qualifications: A multivariate field study of demographic characteristics and nonverbal cues. J. of Applied Psychology, 1984.
[26]
F. Pianesi, N. Mana, A. Cappelletti, B. Lepri, and M. Zancanaro. Multimodal recognition of personality traits in social interactions. In Proc. ICMI, 2008.
[27]
R. Posthuma, F. Morgeson, and M. Campion. Beyond employment interview validity: A comprehensive narrative review of recent research and trends over time. J. of Personnel Psychology, 2002.
[28]
S. Rothmann and E. Coetzer. The big five personality dimensions and job performance. J. of Industrial Psychology, 2003.
[29]
D. Sanchez-Cortes, O. Aran, M. Schmid Mast, and D. Gatica-Perez. A nonverbal behavior approach to identify emergent leaders in small groups. IEEE Trans. on Multimedia, 2012.
[30]
G. Schmidt. The effect of thin slicing on structured interview decisions. Master's thesis, University of South Florida, 2007.
[31]
A. Todorov, A. Mandisodza, A. Goren, and C. Hall. Inferences of competence from faces predict election outcomes. Science, 2005.

Cited By

View all

Index Terms

  1. I Would Hire You in a Minute: Thin Slices of Nonverbal Behavior in Job Interviews

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction
    November 2015
    678 pages
    ISBN:9781450339124
    DOI:10.1145/2818346
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 November 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. first impressions
    2. hirability
    3. job interview
    4. multimodal interaction
    5. nonverbal behavior
    6. social computing
    7. thin slices

    Qualifiers

    • Research-article

    Funding Sources

    • Swiss National Science Foundation

    Conference

    ICMI '15
    Sponsor:
    ICMI '15: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
    November 9 - 13, 2015
    Washington, Seattle, USA

    Acceptance Rates

    ICMI '15 Paper Acceptance Rate 52 of 127 submissions, 41%;
    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)112
    • Downloads (Last 6 weeks)10
    Reflects downloads up to 15 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media