research-article

Little search game: term network acquisition via a human computation game

Authors:

Michal Tvarozek,

Maria BielikovaAuthors Info & Claims

HT '11: Proceedings of the 22nd ACM conference on Hypertext and hypermedia

Pages 57 - 62

https://doi.org/10.1145/1995966.1995977

Published: 06 June 2011 Publication History

Abstract

Semantic structures, ranging from ontologies to flat folksonomies, are widely used on the Web despite the fact that their creation in sufficient quality is often a costly task. We propose a new approach for acquiring a lightweight network of related terms via the Little Search Game - a competitive browser game in search query formulation. The format of game queries forces players to express their perception of term relatedness. The term network is aggregated using "votes" from multiple players playing the same problem instance. We show that nearly 91% of the relationships produced by Little Search Game are correct and also elaborate on the game's unique ability to discover term relations, that are otherwise hidden to typical corpora mining methods.

References

[1]

J. Bai, D. Song, P. Bruza, J. Nie, and G. Cao. Query expansion using term relationships in language models for information retrieval. In Proc. of the 14th ACM int. conf. on Information and knowledge management, volume 05, pages 688--695. ACM, 2005.

Digital Library

[2]

M. Barla. Towards social-based user modeling and personalization. Information Sciences and Technologies Bulletin of the ACM Slovakia, 3(1):52--60, 2011.

[3]

M. Barla, M. Bieliková, A. B. Ezzeddinne, T. Kramár, M. Simko, and O. Vozár. On the impact of adaptive test question selection for learning efficiency. Computers and Education, 55(2):846 -- 857, 2010.

Digital Library

[4]

J. Bhogal, A. Macfarlane, and P. Smith. A review of ontology based query expansion. Inf. Process. Manage., 43:866--886, July 2007.

Digital Library

[5]

J. Chamberlain and M. Poesio. A Demonstration Of Human Computation Using The Phrase Detectives Annotation Game . Discourse, pages 23--24, 2009.

Digital Library

[6]

T. Kramár, M. Barla, and M. Bieliková. Disambiguating search by leveraging the social network context based on the stream of user's activity. In UMAP '10: Proc. of the 18th Int. Conf. on User Modeling, Adaptation, and Personalization, pages 387--392, Hawaii, HI, USA, 2010. Springer.

Digital Library

[7]

D. B. Lenat. Cyc: a large-scale investment in knowledge infrastructure. Commun. ACM, 38(11):33--38, 1995.

Digital Library

[8]

G. Marchionini. From finding to understanding. Communications of the ACM, 49(4):41--46, 2006.

Digital Library

[9]

L. A. F. Park and K. Ramamohanarao. An analysis of latent semantic term self-correlation. ACM Trans. Inf. Syst., 27:8:1--8:35, March 2009.

Digital Library

[10]

K. Siorpaes and M. Hepp. Games with a Purpose for the Semantic Web. IEEE Intelligent Systems, 23(3):50--60, May 2008.

Digital Library

[11]

R. Stewart, G. Scott, and V. Zelevinsky. Idea navigation: structured browsing for unstructured text. In CHI '08: Proc. of the 26th SIGCHI conf. on Human factors in computing systems, pages 1789--1792, New York, NY, USA, 2008. ACM.

Digital Library

[12]

M. Tvaro\vzek and M. Bieliková. Generating exploratory search interfaces for the semantic web. In Human-Computer Interaction, volume 332 of IFIP Advances in Information and Communication Technology, pages 175--186. Springer Boston, 2010.

[13]

L. von Ahn and L. Dabbish. Designing games with a purpose. Communications of the ACM, 51(8), 2008.

Digital Library

[14]

J. Simko, M. Tvarozek, and M. Bieliková. Semantic History Map : Graphs Aiding Web Revisitation Support. Proc. of theWorkshops on Database and Expert Systems Applications, pages 206--210, 2010.

Digital Library

[15]

T. Wang, D. Maynard, W. Peters, K. Bontcheva, and H. Cunningham. Extracting a domain ontology from linguistic resource based on relatedness measurements. In WI '05: Proc. of the 2005 IEEE/WIC/ACM Int. Conf. on Web Intelligence, pages 345--351, Washington, DC, USA, 2005. IEEE CS.

Digital Library

Cited By

Gurevych IEckle-Kohler JMatuschek M(2016)Linked Lexical Knowledge Bases: Foundations and ApplicationsSynthesis Lectures on Human Language Technologies10.2200/S00717ED1V01Y201605HLT0349:3(1-146)Online publication date: 12-Jul-2016
https://doi.org/10.2200/S00717ED1V01Y201605HLT034
Masiar ASimko J(2015)Short video metadata acquisition gameProceedings of the 2015 10th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP)10.1109/SMAP.2015.7370092(1-5)Online publication date: 5-Nov-2015
https://dl.acm.org/doi/10.1109/SMAP.2015.7370092
Šimko JBieliková MŠimko JBieliková M(2014)Our SAGs: Design Aspects and ImprovementsSemantic Acquisition Games10.1007/978-3-319-06115-3_8(119-137)Online publication date: 11-Apr-2014
https://doi.org/10.1007/978-3-319-06115-3_8
Show More Cited By

Index Terms

Little search game: term network acquisition via a human computation game

Recommendations

Semantics Discovery via Human Computation Games

The effective acquisition of semantic metadata is crucial for many present day applications. Games with a purpose address this issue by transforming computational problems into computer games. The authors present a novel approach to metadata acquisition ...
Incremental Game Mechanics Applied to Text Annotation
CHI PLAY '19: Proceedings of the Annual Symposium on Computer-Human Interaction in Play

We argue that the mechanics of 'Ville type Free-To-Play (F2P) games in general, and incremental games in particular, is especially suited for Games-With-A-Purpose. We demonstrate this through WordClicker, an incremental game whose mechanics is designed ...
Evaluating game genres for tagging images
NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries

Applications that use games to harness human intelligence are increasing in popularity and such games are also known as Games With A Purpose (GWAP). Most GWAPs are collaborative in nature, requiring pairs of players to cooperate in a game to receive ...

Comments

Information & Contributors

Information

Published In

HT '11: Proceedings of the 22nd ACM conference on Hypertext and hypermedia

June 2011

348 pages

ISBN:9781450302562

DOI:10.1145/1995966

General Chair:
Paul De Bra
Eindhoven University of Technology, the Netherlands
,
Program Chair:
Kaj Grønbæk
Aarhus University, Denmark

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HT '11

Sponsor:

SIGWEB

HT '11: 22nd ACM Conference on Hypertext and Hypermedia

June 6 - 9, 2011

Eindhoven, The Netherlands

Acceptance Rates

Overall Acceptance Rate 378 of 1,158 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
230
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gurevych IEckle-Kohler JMatuschek M(2016)Linked Lexical Knowledge Bases: Foundations and ApplicationsSynthesis Lectures on Human Language Technologies10.2200/S00717ED1V01Y201605HLT0349:3(1-146)Online publication date: 12-Jul-2016
https://doi.org/10.2200/S00717ED1V01Y201605HLT034
Masiar ASimko J(2015)Short video metadata acquisition gameProceedings of the 2015 10th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP)10.1109/SMAP.2015.7370092(1-5)Online publication date: 5-Nov-2015
https://dl.acm.org/doi/10.1109/SMAP.2015.7370092
Šimko JBieliková MŠimko JBieliková M(2014)Our SAGs: Design Aspects and ImprovementsSemantic Acquisition Games10.1007/978-3-319-06115-3_8(119-137)Online publication date: 11-Apr-2014
https://doi.org/10.1007/978-3-319-06115-3_8
Šimko JBieliková MŠimko JBieliková M(2014)State-of-the-Art: Design of the Semantics Acquisition GamesSemantic Acquisition Games10.1007/978-3-319-06115-3_7(95-117)Online publication date: 11-Apr-2014
https://doi.org/10.1007/978-3-319-06115-3_7
Šimko JTvarožek MBieliková M(2013)Semantics Discovery via Human Computation GamesSemantic Web10.4018/978-1-4666-3610-1.ch012(286-308)Online publication date: 2013
https://doi.org/10.4018/978-1-4666-3610-1.ch012
Harinek JŠimko MMarinai SMarriott K(2013)Improving term extraction by utilizing user annotationsProceedings of the 2013 ACM symposium on Document engineering10.1145/2494266.2494306(185-188)Online publication date: 10-Sep-2013
https://dl.acm.org/doi/10.1145/2494266.2494306
Yule DBlustein J(2013)Of hoverboards and hypertextProceedings of the Second international conference on Design, User Experience, and Usability: design philosophy, methods, and tools - Volume Part I10.1007/978-3-642-39229-0_19(162-170)Online publication date: 21-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-39229-0_19
Dulačka Pšimko JBieliková MPresutti VPinto H(2012)Validation of music metadata via game with a purposeProceedings of the 8th International Conference on Semantic Systems10.1145/2362499.2362526(177-180)Online publication date: 5-Sep-2012
https://dl.acm.org/doi/10.1145/2362499.2362526
Majer TŠimko M(2012)Leveraging microblogs for resource rankingProceedings of the 38th international conference on Current Trends in Theory and Practice of Computer Science10.1007/978-3-642-27660-6_42(518-529)Online publication date: 21-Jan-2012
https://dl.acm.org/doi/10.1007/978-3-642-27660-6_42
Šimko JTvarožek MBieliková M(2011)Semantics Discovery via Human Computation GamesInternational Journal on Semantic Web & Information Systems10.4018/jswis.20110701027:3(23-45)Online publication date: 1-Jul-2011
https://dl.acm.org/doi/10.4018/jswis.2011070102
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents