research-article

Freshness matters: in flowers, food, and web authority

Authors:

Brian D. DavisonAuthors Info & Claims

SIGIR '10: Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval

Pages 114 - 121

https://doi.org/10.1145/1835449.1835471

Published: 19 July 2010 Publication History

Abstract

The collective contributions of billions of users across the globe each day result in an ever-changing web. In verticals like news and real-time search, recency is an obvious significant factor for ranking. However, traditional link-based web ranking algorithms typically run on a single web snapshot without concern for user activities associated with the dynamics of web pages and links. Therefore, a stale page popular many years ago may still achieve a high authority score due to its accumulated in-links. To remedy this situation, we propose a temporal web link-based ranking scheme, which incorporates features from historical author activities. We quantify web page freshness over time from page and in-link activity, and design a web surfer model that incorporates web freshness, based on a temporal web graph composed of multiple web snapshots at different time points. It includes authority propagation among snapshots, enabling link structures at distinct time points to influence each other when estimating web page authority. Experiments on a real-world archival web corpus show our approach improves upon PageRank in both relevance and freshness of the search results.

References

[1]

A. Acharya, M. Cutts, J. Dean, P. Haahr, M. Henzinger, U. Hoelzle, S. Lawrence, K. Pfleger, O. Sercinoglu, and S. Tong. Information retrieval based on historical data. US Patent 7,346,839, USPTO, Mar. 2008.

[2]

E. Adar, J. Teevan, S. Dumais, and J. L. Elsas. The web changes everything: understanding the dynamics of web content. In Proc. of 2nd ACM WSDM Conf., pages 282--291. Feb, 2009.

Digital Library

[3]

Amazon, Inc. Amazon mechanical turk home page, 2010. http://www.mturk.com/.

[4]

E. Amitay, D. Carmel, M. Herscovici, R. Lempel, and A. Soffer. Trend detection through temporal link analysis. Journal of the American Society for Information Science and Technology, 55(14):1270--1281, 2004.

Digital Library

[5]

Z. Bar-Yossef, A. Z. Broder, R. Kumar, and A. Tomkins. Sic transit gloria telae: Towards an understading of the web's decay. In Proc. of 13th Int'l World Wide Web Conference, pages 328--337. May 2004.

Digital Library

[6]

K. Berberich, S. Bedathur, M. Vazirgiannis, and G. Weikum. Buzzrank... and the trend is your friend. In Proc. of 15th Int'l World Wide Web Conference, pages 937--938, May 2006.

Digital Library

[7]

K. Berberich, S. Bedathur, G. Weikum, and M. Vazirgiannis. Comparing apples and oranges: Normalized PageRank for evolving graphs. In Proc. of 16th Int'l World Wide Web Conference, pages 1145--1146, May 2007.

Digital Library

[8]

K. Berberich, M. Vazirgiannis, and G. Weikum. Time-aware authority ranking. Internet Mathematics, 2(3):301--332, 2005.

[9]

J. Bian, Y. Liu, D. Zhou, E. Agichtein, and H. Zha. Learning to recognize reliable users and content in social media with coupled mutual reinforcement. In Proc. of 18th Int'l World Wide Web Conference, pages 51--60, Apr. 2009.

Digital Library

[10]

S. Brin and L. Page. The anatomy of a large-scale hypertextual Web search engine. In Proc. of 7th Int'l World Wide Web Conference, pages 107--117, Apr. 1998.

Digital Library

[11]

D. Cai, X. He, J. R.Wen, and W. Y. Ma. Block-level link analysis. In Proc. of 27th Annual Int'l ACM SIGIR Conf., Sheffield, UK, July 2004.

Digital Library

[12]

D. Chakrabarti and C. Faloutsos. Graph mining: Laws, generators, and algorithms. ACM Comput. Surv., 38(1):2, 2006.

Digital Library

[13]

J. Cho, S. Roy, and R. E. Adams. Page quality: In search of an unbiased web ranking. In Proc. of ACM SIGMOD, Baltimore, MD, June 2005.

Digital Library

[14]

Y. J. Chung, M. Toyoda, and M. Kitsuregawa. A study of link farm distribution and evolution using a time series of web snapshots. In Proc. of the 5th Int'l Workshop on Adversarial Information Retrieval on the Web, pages 9--16, New York, NY, USA, 2009. ACM.

Digital Library

[15]

O. de Kretser and A. Moffat. Effective document presentation with a locality-based similarity heuristic. In Proc. of 22nd Annual Int'l ACM SIGIR Conf., pages 113--120, New York, NY, USA, 1999. ACM.

Digital Library

[16]

J. L. Elsas and S. T. Dumais. Leveraging temporal dynamics of document content in relevance ranking. In Proc. of 3nd ACM WSDM Conf., pages 1--10. Feb, 2010.

Digital Library

[17]

B. Gao, T. Y. Liu, Z. Ma, T.Wang, and H. Li. A general markov framework for page importance computation. In Proc. of 18th ACM CIKM Conf., pages 1835--1838, New York, NY, USA, 2009. ACM.

Digital Library

[18]

Google Inc. Google trends home page, 2010. http://www.google.com/trends.

[19]

T. Haveliwala, S. Kamvar, A. Kamvar, and G. Jeh. An analytical comparison of approaches to personalizing pagerank. Technical report, Stanford University, 2003.

[20]

Internet Archive. The Internet Archive. 2010. http://www.archive.org/.

[21]

K. Jarvelin and J. Kekalainen. IR evaluation methods for retrieving highly relevant documents. In Proc. of 23rd Annual Int'l ACM SIGIR Conf., pages 41--48, July 2000.

Digital Library

[22]

K. Kise, M. Junker, A. Dengel, and K. Matsumoto. Passage Retrieval Based on Density Distributions of Terms and Its Applications to Document Retrieval and Question Answering. In volume 2956 of LNCS, pages 306--327. Springer, Berlin/Heidelberg, 2004.

[23]

J. M. Kleinberg. Authoritative sources in a hyperlinked environment. In Proc. of the ACM-SIAM Symposium on Discrete Algorithms (SODA-98), pages 668--677, San Francisco, CA, Jan. 1998.

Digital Library

[24]

Y. Li and J. Tang. Expertise search in a time-varying social network. In Proc. of 9th Int'l Web-Age Information Management Conf. (WAIM 08), July 2008.

Digital Library

[25]

Y. Liu, B. Gao, T. Y. Liu, Y. Zhang, Z. Ma, S. He, and H. Li. Browserank: letting web users vote for page importance. In Proc. of 31st Annual Int'l ACM SIGIR Conf., pages 451--458, New York, NY, USA, 2008. ACM.

Digital Library

[26]

Y. Lv and C. Zhai. Positional language models for information retrieval. In Proc. of 32nd Annual Int'l ACM SIGIR Conf., pages 299--306, New York, NY, USA, 2009. ACM.

Digital Library

[27]

NIST. Text REtrieval Conference (TREC) home page, 2010. http://trec.nist.gov/.

[28]

D. Petkova and W. B. Croft. Proximity-based document representation for named entity retrieval. In Proc. of 16th ACM CIKM Conf., pages 731--740, New York, NY, USA, 2007. ACM.

Digital Library

[29]

S. E. Robertson. Overview of the OKAPI projects. Journal of Documentation, 53:3--7, 1997.

[30]

S. M. Ross. Introduction to Probability Models, Ninth Edition. Academic Press, Inc., Orlando, FL, USA, 2006.

Digital Library

[31]

G. Shen, B. Gao, T.Y. Liu, G. Feng, S. Song, and H. Li. Detecting link spam using temporal information. In Proc. of IEEE International Conference on Data Mining, pages 1049--1053, 2006.

Digital Library

[32]

B. Wu, V. Goel and B. D. Davison. Propagating Trust and Distrust to Demote Web Spam. In Proc. of WWW2006 MTW Workshop, 2006.

[33]

Yahoo!, Inc. Yahoo! site explorer, 2010. http://siteexplorer.search.yahoo.com/.

[34]

L. Yang, L. Qi, Y. P. Zhao, B. Gao, and T.Y. Liu. Link analysis using time series of web graphs. In Proc. of 16th ACM CIKM Conf., pages 1011--1014, New York, NY, USA, 2007. ACM.

Digital Library

[35]

P. S. Yu, X. Li, and B. Liu. On the temporal dimension of search. In Proc. of 13rd Int'l World Wide Web Conference, pages 448--449. ACM Press, May 2004.

Digital Library

Cited By

Zhao SChen MBorcea CChen Y(2022)Personalized Dynamic Counter Ad-Blocking Using Deep LearningIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.3201058(1-14)Online publication date: 2022
https://doi.org/10.1109/TKDE.2022.3201058
Kucukyilmaz T(2021)Exploiting temporal changes in query submission behavior for improving the search engine result cache performanceInformation Processing and Management: an International Journal10.1016/j.ipm.2021.10253358:3Online publication date: 1-May-2021
https://dl.acm.org/doi/10.1016/j.ipm.2021.102533
Ali FKhusro S(2021)Content and link-structure perspective of ranking webpagesComputer Science Review10.1016/j.cosrev.2021.10039740:COnline publication date: 1-May-2021
https://dl.acm.org/doi/10.1016/j.cosrev.2021.100397
Show More Cited By

Index Terms

Freshness matters: in flowers, food, and web authority
1. Information systems
  1. Information retrieval

Recommendations

A study of results overlap and uniqueness among major web search engines

The performance and capabilities of Web search engines is an important and significant area of research. Millions of people world wide use Web search engines very day. This paper reports the results of a major study examining the overlap among results ...
Ranking by community relevance
SIGIR '07: Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval

A web page may be relevant to multiple topics; even when nominally on a single topic, the page may attract attention (and thus links) from multiple communities. Instead of indiscriminately summing the authority provided by all pages, we decompose a web ...
Topical TrustRank: using topicality to combat web spam
WWW '06: Proceedings of the 15th international conference on World Wide Web

Web spam is behavior that attempts to deceive search engine ranking algorithms. TrustRank is a recent algorithm that can combat web spam. However, TrustRank is vulnerable in the sense that the seed set used by TrustRank may not be sufficiently ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '10: Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval

July 2010

944 pages

ISBN:9781450301534

DOI:10.1145/1835449

General Chairs:
Fabio Crestani
University of Lugano, CH
,
Stéphane Marchand-Maillet
University of Geneva, CH
,
Program Chairs:
Hsin-Hsi Chen
National Taiwan University, TW
,
Efthimis N. Efthimiadis
University of Washington, USA
,
Jacques Savoy
University of Neuchatel, CH

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 July 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGIR '10

Sponsor:

SIGIR

SIGIR '10: The 33rd International ACM SIGIR conference on research and development in Information Retrieval

July 19 - 23, 2010

Geneva, Switzerland

Acceptance Rates

SIGIR '10 Paper Acceptance Rate 87 of 520 submissions, 17%;

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
797
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)2

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhao SChen MBorcea CChen Y(2022)Personalized Dynamic Counter Ad-Blocking Using Deep LearningIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2022.3201058(1-14)Online publication date: 2022
https://doi.org/10.1109/TKDE.2022.3201058
Kucukyilmaz T(2021)Exploiting temporal changes in query submission behavior for improving the search engine result cache performanceInformation Processing and Management: an International Journal10.1016/j.ipm.2021.10253358:3Online publication date: 1-May-2021
https://dl.acm.org/doi/10.1016/j.ipm.2021.102533
Ali FKhusro S(2021)Content and link-structure perspective of ranking webpagesComputer Science Review10.1016/j.cosrev.2021.10039740:COnline publication date: 1-May-2021
https://dl.acm.org/doi/10.1016/j.cosrev.2021.100397
Wang JJatowt AFärber MYoshikawa M(2021)Improving question answering for event-focused questions in temporal collections of news articlesInformation Retrieval Journal10.1007/s10791-020-09387-9Online publication date: 2-Jan-2021
https://doi.org/10.1007/s10791-020-09387-9
Chen RAi QJayasinghe GCroft WZhu WTao DCheng XCui PRundensteiner ECarmel DHe QXu Yu J(2019)Correcting for Recency Bias in Job RecommendationProceedings of the 28th ACM International Conference on Information and Knowledge Management10.1145/3357384.3358131(2185-2188)Online publication date: 3-Nov-2019
https://dl.acm.org/doi/10.1145/3357384.3358131
Zhao SKalra AWang CBorcea CChen Y(2019)Ad Blocking Whitelist Prediction for Online Publishers2019 IEEE International Conference on Big Data (Big Data)10.1109/BigData47090.2019.9006402(1711-1716)Online publication date: Dec-2019
https://doi.org/10.1109/BigData47090.2019.9006402
Król K(2018)The Quality of the Websites of Agritourism Farms in Visegrad Group Countries in the Light of Selected Synthetic MeasuresEconomic and Regional Studies / Studia Ekonomiczne i Regionalne10.29316/ers-seir.2017.3610:4(76-85)Online publication date: 3-Oct-2018
https://doi.org/10.29316/ers-seir.2017.36
(2018)Activity-based linkage and ranking methods for personal dataspaceInternational Journal of Mobile Communications10.1504/IJMC.2018.09138116:3(266-285)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1504/IJMC.2018.091381
Neumann MSchaer PMichels CSchenkel RChen JGonçalves MAllen JFox EKan MPetras V(2018)Prioritizing and Scheduling Conferences for Metadata Harvesting in dblpProceedings of the 18th ACM/IEEE on Joint Conference on Digital Libraries10.1145/3197026.3197069(45-48)Online publication date: 23-May-2018
https://dl.acm.org/doi/10.1145/3197026.3197069
Tanioka HBando TMatsuura KOhira KSano MUeta T(2017)Improving Document Availability in Storage2017 6th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI)10.1109/IIAI-AAI.2017.139(997-1000)Online publication date: Jul-2017
https://doi.org/10.1109/IIAI-AAI.2017.139
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents