Article

PageRank without hyperlinks: structural re-ranking using links induced by language models

Authors:

Lillian LeeAuthors Info & Claims

SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval

Pages 306 - 313

https://doi.org/10.1145/1076034.1076087

Published: 15 August 2005 Publication History

Abstract

Inspired by the PageRank and HITS (hubs and authorities) algorithms for Web search, we propose a structural re-ranking approach to ad hoc information retrieval: we reorder the documents in an initially retrieved set by exploiting asymmetric relationships between them. Specifically, we consider generation links, which indicate that the language model induced from one document assigns high probability to the text of another; in doing so, we take care to prevent bias against long documents. We study a number of re-ranking criteria based on measures of centrality in the graphs formed by generation links, and show that integrating centrality into standard language-model-based retrieval is quite effective at improving precision at top ranks.

References

[1]

Sergey Brin and Lawrence Page. The anatomy of a large-scale hypertextual web search engine. In Proceedings of the 7th International World Wide Web Conference, pages 107--117, 1998.]]

Digital Library

[2]

W. Bruce Croft and John Lafferty, editors. Language Modeling for Information Retrieval. Number 13 in Information Retrieval Book Series. Kluwer, 2003.]]

Digital Library

[3]

Inderjit Dhillon. Co-clustering documents and words using bipartite spectral graph partitioning. In Proceedings of the Seventh ACM SIGKDD Conference, pages 269--274, 2001.]]

Digital Library

[4]

Güneş Erkan and Dragomir R. Radev. LexRank: Graph-based lexical centrality as salience in text summarization. Journal of Artificial Intelligence Research, 22:457--479, 2004.]]

[5]

Eugene Garfield. Citation analysis as a tool in journal evaluation. Science, 178:471--479, 1972.]]

[6]

Gene H. Golub and Charles F. Van Loan. Matrix Computations. The Johns Hopkins University Press, third edition, 1996.]]

[7]

Winfried K. Grassmann, Michael I. Taksar, and Daniel P. Heyman. Regenerative analysis and steady state distributions for Markov chains. Operations Research, 33(5):1107--1116, 1985.]]

Digital Library

[8]

Geoffrey R. Grimmett and David R. Stirzaker. Probability and Random Processes. Oxford Science Publications, third edition, 2001.]]

[9]

Vasileios Hatzivassiloglou and Kathleen McKeown. Predicting the semantic orientation of adjectives. In Proceedings of the 35th ACL/8th EACL, pages 174--181, 1997.]]

Digital Library

[10]

Marti A. Hearst and Jan O. Pedersen. Reexamining the cluster hypothesis: Scatter/Gather on retrieval results. In Proceedings of SIGIR, 1996.]]

Digital Library

[11]

Djoerd Hiemstra and Wessel Kraaij. Twenty-One at TREC7: Ad hoc and cross-language track. In Proceedings of the Seventh Text Retrieval Conference (TREC-7), pages 227--238, 1999.]]

[12]

Thorsten Joachims. Transductive learning via spectral graph partitioning. In Proceedings of ICML, 2003.]]

[13]

Jon Kleinberg. Authoritative sources in a hyperlinked environment. Journal of the ACM, 46:604--632, 1999.]]

Digital Library

[14]

Wessel Kraaij and Thijs Westerveld. TNO-UT at TREC9: How different are web documents? In Proceedings of the Ninth Text Retrieval Conference (TREC-9), pages 665--671, 2001.]]

[15]

Wessel Kraaij, Thijs Westerveld, and Djoerd Hiemstra. The importance of prior probabilities for entry page search. In Proceedings of SIGIR, pages 27--34, 2002.]]

Digital Library

[16]

Oren Kurland and Lillian Lee. Corpus structure, language models, and ad hoc information retrieval. In Proceedings of SIGIR, pages 194--201, 2004.]]

Digital Library

[17]

Oren Kurland, Lillian Lee, and Carmel Domshlak. Better than the real thing? Iterative pseudo-query processing using cluster-based language models. In Proceedings of SIGIR, 2005.]]

Digital Library

[18]

John D. Lafferty and Chengxiang Zhai. Document language models, query models, and risk minimization for information retrieval. In Proceedings of SIGIR, pages 111--119, 2001.]]

Digital Library

[19]

Victor Lavrenko, James Allan, Edward DeGuzman, Daniel LaFlamme, Veera Pollard, and Steven Thomas. Relevance models for topic detection and tracking. In Proceedings of the Human Language Technology Conference (HLT), pages 104--110, 2002.]]

Digital Library

[20]

Anton Leuski. Evaluating document clustering for interactive information retrieval. In Proceedings of the tenth International Conference on Information and Knowledge Managment (CIKM), pages 33--40, 2001.]]

Digital Library

[21]

Xiaoyan Li and W. Bruce Croft. Time-based language models. In Proceedings of the 12th International Conference on Information and Knowledge Managment (CIKM), pages 469--475, 2003.]]

Digital Library

[22]

Xiaoyong Liu and W. Bruce Croft. Cluster-based retrieval using language models. In Proceedings of SIGIR, pages 186--193, 2004.]]

Digital Library

[23]

Rada Mihalcea. Graph-based ranking algorithms for sentence extraction, applied to text summarization. In The Companion Volume to the Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics, pages 170--173, 2004.]]

Digital Library

[24]

Rada Mihalcea and Paul Tarau. TextRank: Bringing order into texts. In Proceedings of EMNLP, pages 404--411, 2004. Poster.]]

[25]

David R. H. Miller, Tim Leek, and Richard~M. Schwartz. A hidden Markov model information retrieval system. In Proceedings of SIGIR, pages 214--221, 1999.]]

Digital Library

[26]

Kenney Ng. A maximum likelihood ratio information retrieval model. In Proceedings of the Eighth Text Retrieval Conference (TREC-8), pages 483--492, 2000.]]

[27]

Paul Ogilvie and Jamie Callan. Experiments using the LEMUR toolkit. In Proceedings of the Tenth Text Retrieval Conference (TREC-10), pages 103--108, 2001.]]

[28]

Bo Pang and Lillian Lee. A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In Proceedings of the ACL, pages 271--278, 2004.]]

Digital Library

[29]

Gabriel Pinski and Francis Narin. Citation influence for journal aggregates of scientific publications: Theory, with application to the literature of physics. Information Processing and Management, 12:297--312, 1976.]]

[30]

Jay M. Ponte and W. Bruce Croft. A language modeling approach to information retrieval. In Proceedings of SIGIR, pages 275--281, 1998.]]

Digital Library

[31]

Ian Ruthven and Mounia Lalmas. A survey on the use of relevance feedback for information access systems. Knowledge Engineering Review, 18(2):95--145, 2003.]]

Digital Library

[32]

Chirag Shah and W. Bruce Croft. Evaluating high accuracy retrieval techniques. In Proceedings of SIGIR, pages 2--9, 2004.]]

Digital Library

[33]

Amit Singhal, Chris Buckley, and Mandar Mitra. Pivoted document length normalization. In Proceedings of SIGIR, pages 21--29, 1996.]]

Digital Library

[34]

William J. Stewart. Introduction to the numerical solution of Markov chains. Princeton University Press, 1994.]]

[35]

Tao Tao and ChengXiang Zhai. A two-stage mixture model for pseudo feedback. In Proceedings of the 27th SIGIR, pages 486--487, 2004. Poster.]]

Digital Library

[36]

Naftali Tishby and Noam Slonim. Data clustering by Markovian relaxation and the information bottleneck method. In Advances in Neural Information Processing Systems (NIPS) 14, pages 640--646, 2000.]]

[37]

Anastasios Tombros, Robert Villa, and C.J. van Rijsbergen. The effectiveness of query-specific hierarchic clustering in information retrieval. Information Processing and Management, 38(4):559--582, 2002.]]

Digital Library

[38]

Kristina Toutanova, Christopher D. Manning, and Andrew Y. Ng. Learning random walk models for inducing word dependency distributions. In Proceedings of the International Conference on Machine Learning, 2004.]]

Digital Library

[39]

Peter Willett. Query specific automatic document classification. International Forum on Information and Documentation, 10(2):28--32, 1985.]]

[40]

Chengxiang Zhai and John D. Lafferty. A study of smoothing methods for language models applied to ad hoc information retrieval. In Proceedings of SIGIR, pages 334--342, 2001.]]

Digital Library

Cited By

Markovskiy ERaiber FSabach SKurland OAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)From Cluster Ranking to Document RankingProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531819(2137-2141)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3531819
Ghosh K(2022)Remediating textbook deficiencies by leveraging community question answersEducation and Information Technologies10.1007/s10639-022-10937-527:7(10065-10105)Online publication date: 11-Apr-2022
https://doi.org/10.1007/s10639-022-10937-5
Ghosh KNangi SKanchugantla YRayapati PBhowmick PGoyal P(2021)Augmenting Video Lectures: Identifying Off-topic Concepts and Linking to Relevant Video Lecture SegmentsInternational Journal of Artificial Intelligence in Education10.1007/s40593-021-00257-z32:2(382-412)Online publication date: 6-Jul-2021
https://doi.org/10.1007/s40593-021-00257-z
Show More Cited By

Index Terms

PageRank without hyperlinks: structural re-ranking using links induced by language models
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking

Recommendations

PageRank without hyperlinks: Structural reranking using links induced by language models

The ad hoc retrieval task is to find documents in a corpus that are relevant to a query. Inspired by the PageRank and HITS (hubs and authorities) algorithms for Web search, we propose a structural reranking approach to ad-hoc retrieval that applies to ...
Respect my authority!: HITS without hyperlinks, utilizing cluster-based language models
SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval

We present an approach to improving the precision of an initial document ranking wherein we utilize cluster information within a graph-based framework. The main idea is to perform reranking based on centrality within bipartite graphs of documents (on ...
Authority Rankings from HITS, PageRank, and SALSA: Existence, Uniqueness, and Effect of Initialization

Algorithms such as Kleinberg's HITS algorithm, the PageRank algorithm of Brin and Page, and the SALSA algorithm of Lempel and Moran use the link structure of a network of web pages to assign weights to each page in the network. The weights can then be ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '05: Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval

August 2005

708 pages

ISBN:1595930345

DOI:10.1145/1076034

General Chairs:
Ricardo Baeza-Yates
University of Chile, Chile
,
Nivio Ziviani
Federal University of Minas Gerais, Brazil
,
Program Chairs:
Gary Marchionini
University of North Carolina, USA
,
Alistair Moffat
University of Melbourne, Australia
,
John Tait
University of Sunderland, UK

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 August 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGIR05

Sponsor:

SIGIR

SIGIR05: The 28th ACM/SIGIR International Symposium on Information Retrieval 2005

August 15 - 19, 2005

Salvador, Brazil

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

111
Total Citations
View Citations
1,450
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Markovskiy ERaiber FSabach SKurland OAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)From Cluster Ranking to Document RankingProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531819(2137-2141)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3531819
Ghosh K(2022)Remediating textbook deficiencies by leveraging community question answersEducation and Information Technologies10.1007/s10639-022-10937-527:7(10065-10105)Online publication date: 11-Apr-2022
https://doi.org/10.1007/s10639-022-10937-5
Ghosh KNangi SKanchugantla YRayapati PBhowmick PGoyal P(2021)Augmenting Video Lectures: Identifying Off-topic Concepts and Linking to Relevant Video Lecture SegmentsInternational Journal of Artificial Intelligence in Education10.1007/s40593-021-00257-z32:2(382-412)Online publication date: 6-Jul-2021
https://doi.org/10.1007/s40593-021-00257-z
Aouadi HKhemakhem MJemaa M(2019)Uncovering Hidden Links Between Images Through Their Textual ContextEnterprise Information Systems10.1007/978-3-030-26169-6_18(370-395)Online publication date: 28-Jul-2019
https://doi.org/10.1007/978-3-030-26169-6_18
Roitman HRabinovich ESar Shalom OLee DSastry NWeber I(2018)As Stable As You AreProceedings of the 29th on Hypertext and Social Media10.1145/3209542.3209567(33-37)Online publication date: 3-Jul-2018
https://dl.acm.org/doi/10.1145/3209542.3209567
Levi OGuy IRaiber FKurland O(2018)Selective Cluster Presentation on the Search Results PageACM Transactions on Information Systems10.1145/315867236:3(1-42)Online publication date: 28-Feb-2018
https://dl.acm.org/doi/10.1145/3158672
Ghosh KBhowmick PGoyal PSheth ANgonga AWang yChang EŚlęzak DFranczyk BAlt RTao X(2017)Using re-ranking to boost deep learning based community question retrievalProceedings of the International Conference on Web Intelligence10.1145/3106426.3106442(807-814)Online publication date: 23-Aug-2017
https://dl.acm.org/doi/10.1145/3106426.3106442
Wang YLin Jde Rijke MShokouhi MTomkins AZhang M(2017)Partitioning and Segment Organization Strategies for Real-Time Selective Search on Document StreamsProceedings of the Tenth ACM International Conference on Web Search and Data Mining10.1145/3018661.3018727(221-230)Online publication date: 2-Feb-2017
https://dl.acm.org/doi/10.1145/3018661.3018727
Zhao WZhou D(2017)A Normalized Framework Based on Multiple Relationships for Document Re-rankingInformation Retrieval10.1007/978-3-319-68699-8_10(122-135)Online publication date: 21-Oct-2017
https://doi.org/10.1007/978-3-319-68699-8_10
Levi ORaiber FKurland OGuy IMukhopadhyay SZhai CBertino ECrestani FMostafa JTang JSi LZhou XChang YLi YSondhi P(2016)Selective Cluster-Based Document RetrievalProceedings of the 25th ACM International on Conference on Information and Knowledge Management10.1145/2983323.2983737(1473-1482)Online publication date: 24-Oct-2016
https://dl.acm.org/doi/10.1145/2983323.2983737
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents