research-article

PictureSort: gamification of image ranking

Authors:

Mathias Lux,

Mario Guggenberger,

Michael RieglerAuthors Info & Claims

GamifIR '14: Proceedings of the First International Workshop on Gamification for Information Retrieval

Pages 57 - 60

https://doi.org/10.1145/2594776.2594789

Published: 13 April 2014 Publication History

Get Access

Abstract

Human computation is a very powerful tool for solving tasks that cannot be solved by computers efficiently. One such problem is ranking images upon their relevance for a semantic query or upon how well they depict a semantic concept. In this paper we investigate a method to leverage human computation in a divide-and-conquer approach to create precise ranking models. We discuss the basic technique, our prototype client, its adoption to a gamification approach, and present the results of a study with the prototype. Results from the study indicate that with our method the ranking aggregated from the user input converges fast to an optimal ranking.

References

[1]

A. Anderson, D. Huttenlocher, J. Kleinberg, and J. Leskovec. Steering user behavior with badges. In Proceedings of the 22nd international conference on World Wide Web, pages 95--106. International World Wide Web Conferences Steering Committee, 2013.

Digital Library

Google Scholar

[2]

N. Ballas, B. Labbé, A. Shabou, H. Le Borgne, P.-H. Gosselin, M. Redi, B. Merialdo, H. Jégou, J. Delhumeau, R. Vieux, et al. Irim at trecvid 2012: Semantic indexing and instance search. In Proceedings of the workshop on TREC Video Retrieval Evaluation (TRECVID), 2012.

Google Scholar

[3]

G. Griffin, A. Holub, and P. Perona. Caltech-256 object category dataset. 2007.

Google Scholar

[4]

D. R. Hardoon and K. Pasupa. Image ranking with implicit feedback from eye movements. In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, pages 291--298. ACM, 2010.

Digital Library

Google Scholar

[5]

J. H. Janssens. Ranking images on semantic attributes using human computation. In NIPS Workshop on Computational Social Science and the Wisdom of Crowds, 2010.

Google Scholar

[6]

B. Loni, A. Bozzon, M. Larson, and L. Gottlieb. Crowdsourcing for Multimedia at MediaEval 2013: Challenges, data set, and evaluation. In MediaEval 2013 Workshop, Barcelona, Spain, October 18-19 2013.

Google Scholar

[7]

B. Siddiquie, R. S. Feris, and L. S. Davis. Image ranking and retrieval based on multi-attribute queries. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pages 801--808. IEEE, 2011.

Digital Library

Google Scholar

[8]

L. von Ahn and L. Dabbish. Designing games with a purpose. Commun. ACM, 51(8):58--67, Aug. 2008.

Digital Library

Google Scholar

[9]

L. Von Ahn, B. Maurer, C. McMillen, D. Abraham, and M. Blum. recaptcha: Human-based character recognition via web security measures. Science, 321(5895):1465--1468, 2008.

Google Scholar

Cited By

View all

Medlar AGłowacka D(2022)Game over?ACM SIGIR Forum10.1145/3527546.352755155:2(1-18)Online publication date: 17-Mar-2022
https://dl.acm.org/doi/10.1145/3527546.3527551
Furini MMontangero M(2018)Sentiment analysis and TwitterPersonal and Ubiquitous Computing10.1007/s00779-018-1142-522:4(771-785)Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1007/s00779-018-1142-5
Riegler MLux MZellot CKnoch LSchnattler HNapetschnig SKogler JDegendorfer CSpot NZoderer MHua KRui YSteinmetz RHanjalic ANatsev AZhu W(2014)GoneProceedings of the 22nd ACM international conference on Multimedia10.1145/2647868.2655619(701-704)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2647868.2655619

Index Terms

PictureSort: gamification of image ranking

Recommendations

Social-Sensed Image Search

Although Web search techniques have greatly facilitate users’ information seeking, there are still quite a lot of search sessions that cannot provide satisfactory results, which are more serious in Web image search scenarios. How to understand user ...
An Empirical Evaluation on Semantic Search Performance of Keyword-Based and Semantic Search Engines: Google, Yahoo, Msn and Hakia
ICIMP '09: Proceedings of the 2009 Fourth International Conference on Internet Monitoring and Protection

This paper investigates the semantic search performance of search engines. Initially, three keyword-based search engines (Google, Yahoo and Msn) and a semantic search engine (Hakia) were selected. Then, ten queries, from various topics, and four phrases,...
Web image retrieval using majority-based ranking approach

Web image retrieval has characteristics different from typical content-based image retrieval; web images have associated textual cues. However, a web image retrieval system often yields undesirable results, because it uses limited text information such ...

Comments

Information & Contributors

Information

Published In

GamifIR '14: Proceedings of the First International Workshop on Gamification for Information Retrieval

April 2014

68 pages

ISBN:9781450328920

DOI:10.1145/2594776

Conference Chairs:
Frank Hopfgartner
TU Berlin
,
Gabriella Kazai
Microsoft Research
,
Udo Kruschwitz
University of Essex
,
Michael Meder
TU Berlin

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Carinthian Economic Promotion Fund (KWF)
European Regional Development Fund

Conference

GamifIR '14

Sponsor:

Technische Universitat Berlin
Microsoft Research

GamifIR '14: Workshop on Gamification for Information Retrieval

April 13, 2014

Amsterdam, The Netherlands

Acceptance Rates

GamifIR '14 Paper Acceptance Rate 14 of 18 submissions, 78%;

Overall Acceptance Rate 14 of 18 submissions, 78%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
455
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Medlar AGłowacka D(2022)Game over?ACM SIGIR Forum10.1145/3527546.352755155:2(1-18)Online publication date: 17-Mar-2022
https://dl.acm.org/doi/10.1145/3527546.3527551
Furini MMontangero M(2018)Sentiment analysis and TwitterPersonal and Ubiquitous Computing10.1007/s00779-018-1142-522:4(771-785)Online publication date: 1-Aug-2018
https://dl.acm.org/doi/10.1007/s00779-018-1142-5
Riegler MLux MZellot CKnoch LSchnattler HNapetschnig SKogler JDegendorfer CSpot NZoderer MHua KRui YSteinmetz RHanjalic ANatsev AZhu W(2014)GoneProceedings of the 22nd ACM international conference on Multimedia10.1145/2647868.2655619(701-704)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2647868.2655619

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Social-Sensed Image Search

An Empirical Evaluation on Semantic Search Performance of Keyword-Based and Semantic Search Engines: Google, Yahoo, Msn and Hakia

Web image retrieval using majority-based ranking approach

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Social-Sensed Image Search

An Empirical Evaluation on Semantic Search Performance of Keyword-Based and Semantic Search Engines: Google, Yahoo, Msn and Hakia

Web image retrieval using majority-based ranking approach

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations