short-paper

Studying Personality through the Content of Posted and Liked Images on Twitter

Authors:

Sharath Chandra Guntuku,

Jordan Carpenter,

Daniel Preoţiuc-PietroAuthors Info & Claims

WebSci '17: Proceedings of the 2017 ACM on Web Science Conference

Pages 223 - 227

https://doi.org/10.1145/3091478.3091522

Published: 25 June 2017 Publication History

Abstract

Interacting with images through social media has become widespread due to ubiquitous Internet access and multimedia enabled devices. Through images, users generally present their daily activities, preferences or interests. This study aims to identify the way and extent to which personality differences, measured using the Big Five model, are related to online image posting and liking. In two experiments, the larger consisting of ~1.5 million Twitter images both posted and liked by ~4,000 users, we extract interpretable semantic concepts using large-scale image content analysis and analyze differences specific of each personality trait. Predictive results show that image content can predict personality traits, and that there can be significant performance gain by fusing the signal from both posted and liked images.

References

[1]

Gerlof Bouma. 2009. Normalized (Pointwise) Mutual Information in Collocation Extraction. In Biennial GSCL Conference.

[2]

Anne Burdick, Johanna Drucker, Peter Lunenfeld, Todd Presner, and Jeffrey Schnapp. 2012. Digital Humanities. The MIT Press.

Digital Library

[3]

Paul T Costa and Robert R MacCrae. 1992. Revised NEO Personality Inventory and NEO Five-factor Inventory: Professional Manual. Psychological Assessment Resources.

[4]

Colin DeYoung, Lena Quilty, and Jordan Peterson. 2007. Between Facets and Domains: 10 aspects of the Big Five. JPSP (2007).

[5]

Gregory J Feist and Tara R Brady. 2004. Openness to Experience, Non-Conformity, and the Preference for Abstract Art. Empirical Studies of the Arts 22, 1 (2004).

[6]

Bruce Ferwerda, Markus Schedl, and Marko Tkalčič. 2016. Using Instagram Picture Features to Predict Users' Personality (MMM).

Digital Library

[7]

Venkata Rama Kiran Garimella, Abdulrahman Alfayad, and Ingmar Weber. 2016. Social Media Image Analysis for Public Health (CHI).

[8]

Samuel D Gosling, Sei Jin Ko, Thomas Mannarelli, and Margaret E Morris. 2002. A Room with a Cue: Personality Judgments based on Offices and Bedrooms. JPSP (2002).

[9]

Sharath Chandra Guntuku, Weisi Lin, Michael James Scott, and Gheorghita Ghinea. 2015. Modelling the Influence of Personality and Culture on Affect and Enjoyment in Multimedia (ACII).

[10]

Sharath Chandra Guntuku, Lin Qiu, Sujoy Roy, Weisi Lin, and Vinit Jakhetiya. 2015. Do others Perceive You as You want them To?: Modeling Personality based on Selfies. In Workshop on Affect & Sentiment in Multimedia (MM).

Digital Library

[11]

Sharath Chandra Guntuku, Joey T Zhou, Sujoy Roy, Lin Weisi, and Ivor W Tsang. 2016. Who likes what, and why? Insights into Personality Modeling based on Image 'Likes'. IEEE Transactions on Affective Computing (2016).

[12]

Kai-Qi Huang, Qiao Wang, and Zhen-Yang Wu. 2006. Natural Color Image Enhancement and Evaluation Algorithm Based on Human Visual System. CVIU (2006).

Digital Library

[13]

Gregory M Hurtz and John J Donovan. 2000. Personality and Job Performance: The Big Five Revisited. Journal of Applied Psychology 85, 6 (2000).

[14]

Vasileios Lampos, Nikolaos Aletras, Daniel Preoţiuc-Pietro, and Trevor Cohn. 2014. Predicting and Characterising User Impact on Twitter (EACL).

[15]

Leqi Liu, Daniel Preoţiuc-Pietro, Zahra Riahi Samani, Mohsen E. Moghaddam, and Lyle Ungar. 2016. Analyzing Personality through Social Media Profile Picture Choice (ICWSM).

[16]

Robert R McCrae and Oliver P John. 1992. An Introduction to the Five-factor Model and its Applications. Journal of Personality (1992).

[17]

Albert Mehrabian and James A Russell. 1974. An Approach to Environmental Psychology. The MIT Press.

[18]

GJ Meyer et al. 2001. Psychological Testing and Psychological Assessment: A Review of Evidence and Issues. American Psychologist (2001).

[19]

T Mikolov and J Dean. 2013. Distributed Representations of Words and Phrases and their Compositionality (NIPS).

Digital Library

[20]

Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. 2002. On Spectral Clustering: Analysis and an Algorithm (NIPS).

Digital Library

[21]

Jie Nie, Lei Huang, Peng Cui, Zhen Li, Yan Yan, Zhiqiang Wei, and Wenwu Zhu. 2016. Social Media Profiler: Inferring Your Social Media Personality from Visual Attributes in Portrait. In Pacific Rim Conference on MM.

[22]

Gregory Park, H.Andrew Schwartz, Johannes Eichstaedt, Margaret Kern, Michal Kosinski, David Stillwell, Lyle Ungar, and Martin Seligman. 2015. Automatic Personality Assessment through Social Media Language. JPSP (2015).

[23]

Daniel Preoţiuc-Pietro, Vasileios Lampos, and Nikolaos Aletras. 2015. An Analysis of the User Occupational Class through Twitter Content (ACL).

[24]

Daniel Preoţiuc-Pietro, Svitlana Volkova, Vasileios Lampos, Yoram Bachrach, and Nikolaos Aletras. 2015. Studying User Income through Language, Behaviour and Affect in Social Media. PLoS ONE (2015).

[25]

Jitao Sang, Huaiwen Zhang, and Changsheng Xu. 2016. Visual BFI: An Exploratory Study for Image-Based Personality Test (PCM).

Digital Library

[26]

H Andrew Schwartz, Johannes C Eichstaedt, Margaret L Kern, Lukasz Dziurzynski, Stephanie M Ramones, Megha Agrawal, Achal Shah, Michal Kosinski, David Stillwell, and Martin Seligman. 2013. Personality, Gender, and Age in the Language of Social Media: The Open-vocabulary Approach. PloS ONE (2013).

[27]

Michael James Scott, Sharath Chandra Guntuku, Weisi Lin, and Gheorghita Ghinea. 2016. Do personality and culture influence perceived video quality and enjoyment? IEEE Transactions on Multimedia 18, 9 (2016), 1796--1807.

Digital Library

[28]

Cristina Segalin, Dong Seon Cheng, and Marco Cristani. 2016. Social Profiling through Image Understanding: Personality Inference using Convolutional Neural Networks. Computer Vision and Image Understanding (2016).

Digital Library

[29]

Cristina Segalin, Alessandro Perina, Marco Cristani, and Alessandro Vinciarelli. 2016. The Pictures we like are our Image: Continuous Mapping of Favorite Pictures into Self-Assessed and Attributed Personality Traits. IEEE Transactions on Affective Computing (2016).

[30]

Jianbo Shi and Jitendra Malik. 2000. Normalized Cuts and Image Segmentation. Transactions on Pattern Analysis and Machine Intelligence (2000).

Digital Library

[31]

R John Simes. 1986. An Improved Bonferroni Procedure for Multiple Tests of Significance. Biometrika (1986).

[32]

Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition (ICLR).

[33]

Marcin Skowron, Marko Tkalčič, Bruce Ferwerda, and Markus Schedl. 2016. Fusing Social Media Cues: Personality Prediction from Twitter and Instagram (WWW Companion).

Digital Library

[34]

Patricia Valdez and Albert Mehrabian. 1994. Effects of Color on Emotions. Journal of Experimental Psychology (1994).

[35]

Ulrike von Luxburg. 2007. A Tutorial on Spectral Clustering. Statistics and Computing (2007).

Digital Library

[36]

Xiaoyu Xiong, Maurizio Filippone, and Alessandro Vinciarelli. 2016. Looking Good With Flickr Faves: Gaussian Processes for Finding Difference Makers in Personality Impressions (MM).

Digital Library

[37]

Yan Yan, Jie Nie, Lei Huang, Zhen Li, Qinglei Cao, and Zhiqiang Wei. 2015. Is your First Impression Reliable? Trustworthy Analysis using Facial Traits in portraits (MMM).

[38]

Huaiwen Zhang, Jiaming Zhang, Jitao Sang, and Changsheng Xu. 2017. A Demo for Image-Based Personality Test (MMM).

Cited By

Kim Y(2024)Personality of organizational social media accounts and its relationship with characteristics of their photos: analyses of startups’ Instagram photosBMC Psychology10.1186/s40359-024-01709-612:1Online publication date: 25-Apr-2024
https://doi.org/10.1186/s40359-024-01709-6
Micheli MValese A(2024)Modeling user personality traits from aesthetic preference on multiple imagesProceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3627043.3659568(189-194)Online publication date: 22-Jun-2024
https://dl.acm.org/doi/10.1145/3627043.3659568
Wu WGhazali MHazlin Huspi S(2024)A Review of User Profiling Based on Social NetworksIEEE Access10.1109/ACCESS.2024.343098712(122642-122670)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3430987
Show More Cited By

Index Terms

Studying Personality through the Content of Posted and Liked Images on Twitter

Recommendations

Twitter Profiles of Organisations Fighting Against Cyberbullying and Bullying: An Exploration of Tweet Content, Influence and Reachability

Cyberbullying has become more popular on social networks especially on Twitter due to the popularity of information sharing. However, there is limited research into the tweet content and influence of Twitter profiles of organisations fighting against ...
How images are conversed on Twitter?
ASIST '13: Proceedings of the 76th ASIS&T Annual Meeting: Beyond the Cloud: Rethinking Information Boundaries

In a way of understanding how people communicate with others through images on Twitter, 174 Boston Bombing related tweet messages with images were analyzed to identify the characteristics of tweet message, senders, and influential tweet messages. ...
Understanding the Use of Images to Spread COVID-19 Misinformation on Twitter
CSCW

While COVID-19 text misinformation has already been investigated by various scholars, fewer research efforts have been devoted to characterizing and understanding COVID-19 misinformation that is carried out through visuals like photographs and memes. In ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WebSci '17: Proceedings of the 2017 ACM on Web Science Conference

June 2017

438 pages

ISBN:9781450348966

DOI:10.1145/3091478

Conference Chairs:
Peter Fox
Rensselaer Polytechnic Institute, USA
,
Deborah McGuinness
Rensselaer Polytechnic Institute, USA
,
Lindsay Poirer
Rensselaer Polytechnic Institute, USA
,
Program Chairs:
Paolo Boldi
Universita degli Studi di Milano, Italy
,
Katharina Kinder-Kurlanda
GESIS - Leibniz Institute for the Social Sciences, Germany

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Templeton Religion Trust

Conference

WebSci '17

Sponsor:

SIGWEB

WebSci '17: ACM Web Science Conference

June 25 - 28, 2017

New York, Troy, USA

Acceptance Rates

WebSci '17 Paper Acceptance Rate 30 of 85 submissions, 35%;

Overall Acceptance Rate 245 of 933 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
489
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)1

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kim Y(2024)Personality of organizational social media accounts and its relationship with characteristics of their photos: analyses of startups’ Instagram photosBMC Psychology10.1186/s40359-024-01709-612:1Online publication date: 25-Apr-2024
https://doi.org/10.1186/s40359-024-01709-6
Micheli MValese A(2024)Modeling user personality traits from aesthetic preference on multiple imagesProceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3627043.3659568(189-194)Online publication date: 22-Jun-2024
https://dl.acm.org/doi/10.1145/3627043.3659568
Wu WGhazali MHazlin Huspi S(2024)A Review of User Profiling Based on Social NetworksIEEE Access10.1109/ACCESS.2024.343098712(122642-122670)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3430987
Biswas KPalaiahnakote SPal UChanda SWu X(2024)A New Impressive and Expressive Features Based Model for Personality Traits IdentificationPattern Recognition10.1007/978-3-031-78186-5_3(32-48)Online publication date: 30-Nov-2024
https://doi.org/10.1007/978-3-031-78186-5_3
Kosan MKaracan HUrgen B(2023)Personality traits prediction model from Turkish contents with semantic structuresNeural Computing and Applications10.1007/s00521-023-08603-z35:23(17147-17165)Online publication date: 27-Apr-2023
https://doi.org/10.1007/s00521-023-08603-z
Biswas KShivakumara PPal USarkar R(2023)A New Contrastive Learning Based Model for Estimating Degree of Multiple Personality Traits Using Social Media PostsPattern Recognition10.1007/978-3-031-47637-2_2(15-29)Online publication date: 5-Nov-2023
https://doi.org/10.1007/978-3-031-47637-2_2
Nasrullah SJalali A(2022)Detection of Types of Mental Illness through the Social Network Using Ensembled Deep Learning ModelComputational Intelligence and Neuroscience10.1155/2022/94042422022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/9404242
Engelmann SUllstein CPapakyriakopoulos OGrossklags J(2022)What People Think AI Should Infer From FacesProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3533080(128-141)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3531146.3533080
Huang XSang JXu C(2022)Image-Based Personality Questionnaire DesignACM Transactions on Multimedia Computing, Communications, and Applications10.1145/350348918:4(1-20)Online publication date: 26-Mar-2022
https://dl.acm.org/doi/10.1145/3503489
Panicheva PMararitsa LSorokin SKoltsova ORosso P(2022)Predicting subjective well-being in a high-risk sample of Russian mental health app usersEPJ Data Science10.1140/epjds/s13688-022-00333-x11:1Online publication date: 4-Apr-2022
https://doi.org/10.1140/epjds/s13688-022-00333-x
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents