skip to main content
10.1145/1458082.1458093acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Efficient and effective link analysis with precomputed salsa maps

Published: 26 October 2008 Publication History

Abstract

SALSA is a link-based ranking algorithm that takes the result set of a query as input, extends the set to include additional neighboring documents in the web graph, and performs a random walk on the induced subgraph. The stationary probability distribution of this random walk, used as a relevance score, is significantly more effective for ranking purposes than popular query-independent link-based ranking algorithms such as PageRank. Unfortunately, this requires significant effort at query-time, to access the link graph and compute the stationary probability distribution. In this paper, we explore whether it is possible to perform most of the computation off-line, prior to the arrival of any queries. The off-line phase of our approach computes a "score map" for each node in the web graph by performing a SALSA-like algorithm on the neighborhood of that node and retaining the scores of the most promising nodes in the neighborhood graph. The on-line phase takes the results to a query, retrieves the score map of each result, and returns for each result a score that is the sum of the matching scores from each score map. We evaluated this algorithm on a collection of about 28,000 queries with partially labeled results, and found that it is significantly more effective than PageRank, although not quite as effective as SALSA. We also studied the trade-off between ranking effectiveness and space requirements.

References

[1]
A. Broder, M. Charikar, A. Frieze, M. Mitzenmacher. Min-wise independent permutations. Journal of Computer and System Sciences 60(3):630--659, 2000.
[2]
J. Dean and M. Henzinger. Finding related pages in the World Wide Web. In Proc. of the 8th International World Wide Web Conference,pages 389--401, 1999.
[3]
S. Gollapudi, M. Najork and R. Panigrahy. Using Bloom filters to speed up HITS-like ranking algorithms. In Proc. of the 5th Workshop on Algorithms and Models for the Web Graph,pages 195--201, 2007.
[4]
K. Järvelin and J. Kekäläinen. Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems, 20(4):422--446, 2002.
[5]
J.M. Kleinberg. Authoritative sources in a hyperlinked environment. In Proc. of the 9th Annual ACM-SIAM Symposium on Discrete Algorithms, pages 668--677, 1998.
[6]
R. Lempel and S. Moran. The stochastic approach for link-structure analysis (SALSA) and the TKC effect. Computer Networks and ISDN Systems, 33(1-6):387--401, 2000.
[7]
R. Lempel and S. Moran. SALSA: The stochastic approach for link-structure analysis. ACM Transactions on Information Systems, 19(2):131--160, 2001.
[8]
G. Linden. Marissa Mayer at Web 2.0. Online at: http://glinden.blogspot.com/2006/11/marissa-mayer-at-web-20.html
[9]
M. Marchiori. The quest for correct information on the Web: hyper search engines. In Computer Networks and ISDN Systems, 29(8-13):1225--1236, 1997.
[10]
F. McSherry and M. Najork. Computing information retrieval performance measures efficiently in the presence of tied scores. In 30th European Conference on Information Retrieval, pages 414--421, 2008.
[11]
M. Najork, H. Zaragoza and M. Taylor. HITS on the Web: how does it compare? In 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 471--478, 2007.
[12]
M. Najork. Comparing the effectiveness of HITS and SALSA. In 16th ACM Conference on Information and Knowledge Management,pages 157--164, 2007.
[13]
L. Page, S. Brin, R. Motwani, and T. Winograd. The PageRank citation ranking: bringing order to the Web. Technical report, Stanford Digital Library Technologies Project, 1998.
[14]
H. Zaragoza, N. Craswell, M. Taylor, S. Saria, and S. Robertson. Microsoft Cambridge at TREC-13: Web and HARD tracks. In Proc. of the 13th Text Retrieval Conference, 2004.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '08: Proceedings of the 17th ACM conference on Information and knowledge management
October 2008
1562 pages
ISBN:9781595939913
DOI:10.1145/1458082
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2008

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. link-based ranking
  2. retrieval performance
  3. salsa
  4. web search

Qualifiers

  • Research-article

Conference

CIKM08
CIKM08: Conference on Information and Knowledge Management
October 26 - 30, 2008
California, Napa Valley, USA

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 29 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media