short-paper

Prediction of favourite photos using social, visual, and textual signals

Authors:

Roelof van Zwol,

Adam Rae,

Lluis Garcia PueyoAuthors Info & Claims

MM '10: Proceedings of the 18th ACM international conference on Multimedia

Pages 1015 - 1018

https://doi.org/10.1145/1873951.1874138

Published: 25 October 2010 Publication History

Get Access

Abstract

This paper focuses on the prediction of users' favourite photos in Flickr. We propose a multi-modal, machine learned approach that combines social, visual and textual signals into a single prediction system. Although each individual user has different motivations for calling a photo a favourite, we show that the textual, visual, and social modalities effectively capture the needs of most active Flickr users.

We use gradient-boosted decision trees (GBDT) with a mod least squares loss function for the classification of a user's favourite photos, and evaluate the performance of our classifier with respect to the individual modalities and various combinations thereof. By using a combination of the social and visual modalities the GBDT creates a highly effective classifier. The addition of textual features allows us to significantly increase recall, with a slight trade off in precision.

References

[1]

N. Garg and I. Weber. Personalized, interactive tag recommendation for flickr. In Proceedings of the 2008 ACM Conference on Recommender Systems, pages 67--74, Lausanne, Switzerland, Oct. 2008. ACM.

Digital Library

Google Scholar

[2]

C.Y.Kim,J.K.Lee,Y.H.Cho,andD.H.Kim. VISCORS: a Visual-Content recommender for the mobile web. IEEE Intelligent Systems, 19(6):32--39, 2004.

Digital Library

Google Scholar

[3]

K. Lerman and L. Jones. Social browsing on flickr. In Proceedings of ICWSM, Dec. 2007.

Google Scholar

[4]

J. S. Pedro and S. Siersdorfer. Ranking and classifying attractiveness of photos in folksonomies. In WWW, Madrid, Spain, Apr. 2009.

Digital Library

Google Scholar

[5]

B. Sigurbjornsson and R. van Zwol. Flickr tag recommendation based on collective knowledge. In 17th international conference on World Wide Web, pages 327--336, Beijing, China, 2008. ACM.

Digital Library

Google Scholar

[6]

R. van Zwol. Flickr: Who is looking? In IEEE/WIC/ACM International Conference on Web Intelligence, pages 184--190, Washington, DC, USA, 2007. IEEE Computer Society.

Digital Library

Google Scholar

[7]

J. Ye, J.-H. Chow, J. Chen, and Z. Zheng. Stochastic gradient boosted distributed decision trees. In CIKM '09: Proceeding of the 18th ACM conference on Information and knowledge management, pages 2061--2064, New York, NY, USA, 2009. ACM.

Digital Library

Google Scholar

[8]

Z. Zheng, K. Chen, G. Sun, and H. Zha. A regression framework for learning ranking functions using relative relevance judgments. In SIGIR '07, pages 287--294, New York, NY, USA, 2007. ACM.

Digital Library

Google Scholar

Cited By

View all

Cui CLin PNie XJian MYin Y(2020)Social-sensed Image Aesthetics AssessmentACM Transactions on Multimedia Computing, Communications, and Applications10.1145/341484316:3s(1-19)Online publication date: 31-Dec-2020
https://dl.acm.org/doi/10.1145/3414843
Chu WMotomura HTsumura NYamasaki T(2019)[Invited papers] A Survey on Multimedia Artworks Analysis and Attractiveness Computing in MultimediaITE Transactions on Media Technology and Applications10.3169/mta.7.607:2(60-67)Online publication date: 2019
https://doi.org/10.3169/mta.7.60
Wang XZhang YYamasaki TAmsaleg LHuet BLarson MGravier GHung HNgo CTsang Ooi W(2019)User-Aware Folk Popularity RankProceedings of the 27th ACM International Conference on Multimedia10.1145/3343031.3350920(1970-1978)Online publication date: 15-Oct-2019
https://dl.acm.org/doi/10.1145/3343031.3350920
Show More Cited By

Index Terms

Prediction of favourite photos using social, visual, and textual signals
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing systems and tools
2. Information systems
  1. Information retrieval
    1. Document representation
  2. World Wide Web

Recommendations

Social image tag enrichment based on textual similarity modeling

In social image sharing websites, users provide several descriptive tags to annotate their shared images. Usually, the user annotated tags are noisy, biased and incomplete. How to improve tag quality is very important for tag based applications. The ...
Automatic tag expansion using visual similarity for photo sharing websites

In this paper we present an automatic photo tag expansion method designed for photo sharing websites. The purpose of the method is to suggest tags that are relevant to the visual content of a given photo at upload time. Both textual and visual cues are ...
Tagging photos using users' vocabularies

Online social image share websites such as Flickr and Panoramio allow users to manually annotate their images with their own words, which can be used to facilitating image retrieval and other image applications. The smart-phones have made it possible ...

Comments

Information & Contributors

Information

Published In

MM '10: Proceedings of the 18th ACM international conference on Multimedia

October 2010

1836 pages

ISBN:9781605589336

DOI:10.1145/1873951

General Chairs:
Alberto del Bimbo
University of Florence, Italy
,
Shih-Fu Chang
Columbia University, USA
,
Program Chair:
Arnold Smeulders
University of Amsterdam, NL

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM '10

Sponsor:

SIGMM

MM '10: ACM Multimedia Conference

October 25 - 29, 2010

Firenze, Italy

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
380
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Cui CLin PNie XJian MYin Y(2020)Social-sensed Image Aesthetics AssessmentACM Transactions on Multimedia Computing, Communications, and Applications10.1145/341484316:3s(1-19)Online publication date: 31-Dec-2020
https://dl.acm.org/doi/10.1145/3414843
Chu WMotomura HTsumura NYamasaki T(2019)[Invited papers] A Survey on Multimedia Artworks Analysis and Attractiveness Computing in MultimediaITE Transactions on Media Technology and Applications10.3169/mta.7.607:2(60-67)Online publication date: 2019
https://doi.org/10.3169/mta.7.60
Wang XZhang YYamasaki TAmsaleg LHuet BLarson MGravier GHung HNgo CTsang Ooi W(2019)User-Aware Folk Popularity RankProceedings of the 27th ACM International Conference on Multimedia10.1145/3343031.3350920(1970-1978)Online publication date: 15-Oct-2019
https://dl.acm.org/doi/10.1145/3343031.3350920
Samani ZMoghaddam M(2018)A multi-criteria context-sensitive approach for social image collection summarizationSādhanā10.1007/s12046-018-0908-943:9Online publication date: 20-Jul-2018
https://doi.org/10.1007/s12046-018-0908-9
Yamasaki THu JSano SAizawa K(2017)FolkpopularityrankProceedings of the 26th International Joint Conference on Artificial Intelligence10.5555/3172077.3172340(3231-3237)Online publication date: 19-Aug-2017
https://dl.acm.org/doi/10.5555/3172077.3172340
Aloufi SZhu SEl Saddik A(2017)On the Prediction of Flickr Image Popularity by Analyzing Heterogeneous Social Sensory DataSensors10.3390/s1703063117:3(631)Online publication date: 19-Mar-2017
https://doi.org/10.3390/s17030631
Cui CShen JNie LHong RMa J(2017)Augmented Collaborative Filtering for Sparseness Reduction in Personalized POI RecommendationACM Transactions on Intelligent Systems and Technology10.1145/30866358:5(1-23)Online publication date: 12-Sep-2017
https://dl.acm.org/doi/10.1145/3086635
Rui TCui PZhu W(2017)Joint user-interest and social-influence emotion prediction for individualsNeurocomputing10.1016/j.neucom.2016.11.054230:C(66-76)Online publication date: 22-Mar-2017
https://dl.acm.org/doi/10.1016/j.neucom.2016.11.054
Haifeng GShoubao SZhoubao S(2017)Image tag recommendation based on friendshipsMultimedia Tools and Applications10.1007/s11042-016-3802-776:13(14581-14597)Online publication date: 1-Jul-2017
https://dl.acm.org/doi/10.1007/s11042-016-3802-7
Cao JZhang YJi RXie FSu Y(2016)Web video topics discovery and structuralization with social networkNeurocomputing10.1016/j.neucom.2014.10.103172(53-63)Online publication date: Jan-2016
https://doi.org/10.1016/j.neucom.2014.10.103
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Social image tag enrichment based on textual similarity modeling

Automatic tag expansion using visual similarity for photo sharing websites

Tagging photos using users' vocabularies