Article

The importance of link evidence in Wikipedia

Authors:

Marijn KoolenAuthors Info & Claims

ECIR'08: Proceedings of the IR research, 30th European conference on Advances in information retrieval

Pages 270 - 282

Published: 30 March 2008 Publication History

Abstract

Wikipedia is one of the most popular information sources on the Web. The free encyclopedia is densely linked. The link structure in Wikipedia differs from the Web at large: internal links in Wikipedia are typically based on words naturally occurring in a page, and link to another semantically related entry. Our main aim is to find out if Wikipedia's link structure can be exploited to improve ad hoc information retrieval. We first analyse the relation between Wikipedia links and the relevance of pages. We then experiment with use of link evidence in the focused retrieval of Wikipedia content, based on the test collection of INEX 2006. Our main findings are: First, our analysis of the link structure reveals that the Wikipedia link structure is a (possibly weak) indicator of relevance. Second, our experiments on INEX ad hoc retrieval tasks reveal that if the link evidence is made sensitive to the local context we see a significant improvement of retrieval effectiveness. Hence, in contrast with earlier TREC experiments using crawled Web data, we have shown that Wikipedia's link structure can help improve the effectiveness of ad hoc retrieval.

References

[1]

Wikipedia: The free encyclopedia (2008), http://en.wikipedia.org/

[2]

Page, L., Brin, S., Motwani, R., Winograd, T.: The pagerank citation ranking: Bringing order to the web. Technical report, Stanford Digital Library Technologies Project (1998).

[3]

Kleinberg, J.M.: Authoritative structures in a hyperlinked environment. Journal of the ACM 46, 604-632 (1999).

Digital Library

[4]

Hawking, D.: Overview of the TREC-9 web track. In: Ninth Text REtrieval Conference (TREC-9), National Institute for Standards and Technology, pp. 87-102. NIST Special Publication 500-249 (2001).

[5]

Kraaij, W., Westerveld, T.: How different are web documents? In: Proceedings of the ninth Text Retrieval Conference, TREC-9, May 2001, NIST Special Publication (2001).

[6]

Hawking, D., Craswell, N.: Very large scale retrieval and web search. In: TREC: Experiment and Evaluation in Information Retrieval, pp. 199-231. MIT Press, Cambridge (2005).

[7]

Kraaij, W.,Westerveld, T., Hiemstra, D.: The importance of prior probabilities for entry page search. In: Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 27-34. ACM Press, New York (2002).

Digital Library

[8]

Ogilvie, P., Callan, J.: Combining document representations for known-item search. In: Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 143-150. ACM Press, New York (2003).

Digital Library

[9]

Kamps, J.: Web-centric language models. In: CIKM 2005: Proceedings of the 14th ACM International Conference on Information and Knowledge Management, pp. 307-308. ACM Press, New York (2005).

Digital Library

[10]

Broder, A.: A taxonomy of web search. SIGIR Forum 36(2), 3-10 (2002).

Digital Library

[11]

INEX: INitiative for the Evaluation of XML retrieval (2007), http://inex.is. informatik.uni-duisburg.de/

[12]

Denoyer, L., Gallinari, P.: The Wikipedia XML Corpus. SIGIR Forum 40, 64-69 (2006).

Digital Library

[13]

Faloutsos, M., Faloutsos, P., Faloutsos, C.: On power-law relationships of the internet topology. In: SIGCOMM 1999: Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication, pp. 251- 262. ACM Press, New York (1999).

Digital Library

[14]

ILPS: The ILPS extension of the Lucene search engine (2008), http://ilps. science.uva.nl/Resources/

[15]

Hiemstra, D.: Using Language Models for Information Retrieval. PhD thesis, Center for Telematics and Information Technology, University of Twente (2001).

[16]

Sparck Jones, K.: A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation 28, 11-21 (1972).

[17]

Sigurbjörnsson, B., Kamps, J., de Rijke, M.: An element-based approach to XML retrieval. In: INEX 2003 Workshop Proceedings, pp. 19-26 (2004).

[18]

Lalmas, M., Kazai, G., Kamps, J., Pehcevski, J., Piwowarski, B., Robertson, S.: INEX 2006 evaluation measures. In: Fuhr, N., Lalmas, M., Trotman, A. (eds.) INEX 2006. LNCS, vol. 4518, pp. 20-34. Springer, Heidelberg (2007).

Cited By

Petersen CSimonsen JLioma C(2016)Power Law Distributions in Information RetrievalACM Transactions on Information Systems10.1145/281681534:2(1-37)Online publication date: 16-Feb-2016
https://dl.acm.org/doi/10.1145/2816815
Deja DNielek RLin XWierzbicki A(2014)Hybrid Algorithm for Precise Recommendation from Almost Infinite Set of WebsitesProceedings of the 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT) - Volume 0110.1109/WI-IAT.2014.50(318-322)Online publication date: 11-Aug-2014
https://dl.acm.org/doi/10.1109/WI-IAT.2014.50
Son JKim APark SJones GSheridan PKelly Dde Rijke MSakai T(2013)A location-based news article recommendation with explicit localized semantic analysisProceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval10.1145/2484028.2484064(293-302)Online publication date: 28-Jul-2013
https://dl.acm.org/doi/10.1145/2484028.2484064
Show More Cited By

The importance of link evidence in Wikipedia
1. Information systems

Recommendations

Is Wikipedia link structure different?
WSDM '09: Proceedings of the Second ACM International Conference on Web Search and Data Mining

In this paper, we investigate the difference between Wikipedia and Web link structure with respect to their value as indicators of the relevance of a page for a given topic of request. Our experimental evidence is from two IR test-collections: the .GOV ...
Topic Modeling for Wikipedia Link Disambiguation

Many articles in the online encyclopedia Wikipedia have hyperlinks to ambiguous article titles; these ambiguous links should be replaced with links to unambiguous articles, a process known as disambiguation. We propose a novel statistical topic model ...
Comparative evaluation of link-based approaches for candidate ranking in link-to-wikipedia systems

In recent years, the task of automatically linking pieces of text (anchors) mentioned in a document to Wikipedia articles that represent the meaning of these anchors has received extensive research attention. Typically, link-to-Wikipedia systems try to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ECIR'08: Proceedings of the IR research, 30th European conference on Advances in information retrieval

March 2008

718 pages

ISBN:3540786457

Editors:
Craig Macdonald
University of Glasgow, Department of Computing Science, Glasgow, UK
,
Iadh Ounis
University of Glasgow, Department of Computing Science, Glasgow, UK
,
Vassilis Plachouras
Yahoo! Research, Barcelona, Spain
,
Ian Ruthven
University of Strathclyde, Department of Computing and Information Sciences, Glasgow, UK
,
Ryen W. White
Microsoft Research, Redmond, WA

Sponsors

Yahoo! Research
Google Inc.
Microsoft Research: Microsoft Research
Matrixware Information Services

In-Cooperation

SIGIR: ACM Special Interest Group on Information Retrieval
British Computer Society: BCS

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 30 March 2008

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
4
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Petersen CSimonsen JLioma C(2016)Power Law Distributions in Information RetrievalACM Transactions on Information Systems10.1145/281681534:2(1-37)Online publication date: 16-Feb-2016
https://dl.acm.org/doi/10.1145/2816815
Deja DNielek RLin XWierzbicki A(2014)Hybrid Algorithm for Precise Recommendation from Almost Infinite Set of WebsitesProceedings of the 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT) - Volume 0110.1109/WI-IAT.2014.50(318-322)Online publication date: 11-Aug-2014
https://dl.acm.org/doi/10.1109/WI-IAT.2014.50
Son JKim APark SJones GSheridan PKelly Dde Rijke MSakai T(2013)A location-based news article recommendation with explicit localized semantic analysisProceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval10.1145/2484028.2484064(293-302)Online publication date: 28-Jul-2013
https://dl.acm.org/doi/10.1145/2484028.2484064
Son JNoh YSong HPark S(2012)Location Comparison through Geographical TopicsProceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 0110.5555/2457524.2457700(311-318)Online publication date: 4-Dec-2012
https://dl.acm.org/doi/10.5555/2457524.2457700
Norozi MArvola Pde Vries AChen XLebanon GWang HZaki M(2012)Contextualization using hyperlinks and internal hierarchical structure of Wikipedia documentsProceedings of the 21st ACM international conference on Information and knowledge management10.1145/2396761.2396855(734-743)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1145/2396761.2396855
Balog KBron MDe Rijke M(2011)Query modeling for entity search based on terms, categories, and examplesACM Transactions on Information Systems10.1145/2037661.203766729:4(1-31)Online publication date: 8-Dec-2011
https://dl.acm.org/doi/10.1145/2037661.2037667
van Erp MLendvai Pvan den Bosch A(2009)Comparing alternative data-driven ontological vistas of natural historyProceedings of the Eighth International Conference on Computational Semantics10.5555/1693756.1693788(282-285)Online publication date: 7-Jan-2009
https://dl.acm.org/doi/10.5555/1693756.1693788
van Erp Mvan den Bosch AWubben SHunt SBorin LLendvai P(2009)Instance-driven discovery of ontological relation labelsProceedings of the EACL 2009 Workshop on Language Technology and Resources for Cultural Heritage, Social Sciences, Humanities, and Education10.5555/1642049.1642057(60-68)Online publication date: 30-Mar-2009
https://dl.acm.org/doi/10.5555/1642049.1642057
Kamps JKoolen M(2009)Is Wikipedia link structure different?Proceedings of the Second ACM International Conference on Web Search and Data Mining10.1145/1498759.1498831(232-241)Online publication date: 9-Feb-2009
https://dl.acm.org/doi/10.1145/1498759.1498831
Koolen MKazai GCraswell N(2009)Wikipedia pages as entry points for book searchProceedings of the Second ACM International Conference on Web Search and Data Mining10.1145/1498759.1498807(44-53)Online publication date: 9-Feb-2009
https://dl.acm.org/doi/10.1145/1498759.1498807
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents