Article

Efficient prediction of web accesses on a proxy server

Authors:

Hongjun LuAuthors Info & Claims

CIKM '02: Proceedings of the eleventh international conference on Information and knowledge management

Pages 169 - 176

https://doi.org/10.1145/584792.584823

Published: 04 November 2002 Publication History

Abstract

Web access prediction is an active research topic with many applications. Various approaches have been proposed for Web access prediction in the domain of individual Web servers but they have to be tailored to the domain of proxy servers to satisfy its special requirements in prediction efficiency and scalability. In this paper, the design and implementation of proxy-based prediction service (PPS) is presented. For prediction efficiency, PPS applies a new prediction scheme which employs a two-layer navigation model to capture both inter-site and intra-site access patterns, incorporated with a bottom-up prediction mechanism that exploits reference locality in proxy logs. For system scalability, PPS manages the navigation model in disk database and adopts a predictive cache replacement strategy for data shipping between the model database and cache. We show the superiority of our prediction scheme over existing approaches and validate our model management and caching strategies, with a detailed performance study using real-world data.

References

[1]

M.-S. Chen, J. S. Park, and P. S. Yu. Efficient data mining for path traversal patterns. Knowledge and Data Engineering, 10(2):209--221, 1998.]]

Digital Library

[2]

R. Cooley, B. Mobasher, and J. Srivastava. Data preparation for mining world wide web browsing patterns. Knowledge and Information Systems, 1(1):5--32, 1999.]]

Digital Library

[3]

J. Dean and M. R. Henzinger. Finding related pages in the world wide web. WWW8 / Computer Networks, 31(11-16):1467--1479, 1999.]]

Digital Library

[4]

M. Deshpande and G. Karypis. Selective markov models for predicting web-page accesses. In Proc. SIAM Int. Conference on Data Mining, Apr. 2001.]]

[5]

D. J. DeWitt, P. Futtersack, D. Maier, and F. Velez. A study of three alternative workstation-server architectures for object oriented database systems. In The VLDB Journal, pages 107--121, 1990.]]

Digital Library

[6]

L. Fan, P. Cao, W. Lin, and Q. Jacobson. Web prefetching between low-bandwidth clients and proxies: Potential and performance. In Proc. of the SIGMETRICS'99 Conference, Atlanta, May 1999.]]

Digital Library

[7]

J. Griffioen and R. Appleton. Reducing file system latency using a predictive approach. In USENIX Summer, pages 197--207, 1994.]]

Digital Library

[8]

W. Lou, G. Liu, H. Lu, and Q. Yang. Cut-and-pick transactions for proxy log mining. In Proc. of the 8th EDBT Conference, Prague, Czech, March 2002.]]

Digital Library

[9]

W. Lou and H. Lu. Proxy-based web access prediciton: Design and implementation. Technical report, CS Department, Hong Kong University of Science and Technology, May 2002.]]

[10]

A. Nanopoulos, D. Katsaros, and Y. Manolopoulos. Effective prediction of web-user accesses, a data mining approach. In Proc. of Workshop on WebKDD'01, San Francisco, CA, Aug 2001.]]

[11]

V. N. Padmanabhan and J. C. Mogul. Using predictive prefetching to improve World-Wide Web latency. In Proc. of the SIGCOMM'96 conference, 1996.]]

Digital Library

[12]

T. Palpanas and A. Mendelzon. Web prefetching using partial match prediction. Technical report CSRG-376. CS Department, University of Toronto, 1998.]]

[13]

A. Papoulis. Probability, Random Variables, and Stochastic Processes. McGraw Hill, 1991.]]

[14]

J. Pitkow and P. Pirolli. Mining longest repeated subsequences to predict world wide web surfing. In Proc. of Second USENIX Symposium on Internet Technologies and Systems, Oct 1999.]]

Digital Library

[15]

R. Ramakrishnan and J. Gehrke. Database Management Systems (2nd Edt.). McGraw-Hill, 2000.]]

Digital Library

[16]

B. M. Sarwar, G. Karypis, J. A. Konstan, and J. Riedl. Analysis of recommendation algorithms for e-commerce. In ACM Conference on Electronic Commerce, pages 158--167, 2000.]]

Digital Library

[17]

Q. Yang, H. H. Zhang, and T. Li. Mining web logs for prediction models in www caching and prefetching. In Proc. of the 7th ACM SIGKDD'01, San Francisco, California, USA, August 2001.]]

Digital Library

Cited By

Huang YHsu J(2018)Mining web logs to improve hit ratios of prefetching and cachingKnowledge-Based Systems10.1016/j.knosys.2006.11.00421:1(62-69)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1016/j.knosys.2006.11.004
Khare SBhandari AMurthy H(2014)URL classification using non negative matrix factorization2014 Twentieth National Conference on Communications (NCC)10.1109/NCC.2014.6811274(1-6)Online publication date: Feb-2014
https://doi.org/10.1109/NCC.2014.6811274
Bommepally KGlisa TPrakash JSingh SMurthy H(2010)Internet activity analysis through proxy log2010 National Conference On Communications (NCC)10.1109/NCC.2010.5430163(1-5)Online publication date: Jan-2010
https://doi.org/10.1109/NCC.2010.5430163
Show More Cited By

Index Terms

Efficient prediction of web accesses on a proxy server
1. Information systems
  1. Information retrieval
  2. Information storage systems

Recommendations

Improving the performance of the web proxy server through group prefetching
ICUIMC '12: Proceedings of the 6th International Conference on Ubiquitous Information Management and Communication

The web proxy server has widely been used to reduce the internet latency that the client perceived. With the help of the proxy server, the client may receive requested web objects from it rather than from the web server hosting them. Nevertheless, the ...
Intelligent Naïve Bayes-based approaches for Web proxy caching

Web proxy caching is one of the most successful solutions for improving the performance of Web-based systems. In Web proxy caching, the popular Web objects that are likely to be revisited in the near future are stored on the proxy server, which plays ...
A neural network proxy cache replacement strategy and its implementation in the Squid proxy server

As the Internet has become a more central aspect for information technology, so have concerns with supplying enough bandwidth and serving web requests to end users in an appropriate time frame. Web caching was introduced in the 1990s to help decrease ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '02: Proceedings of the eleventh international conference on Information and knowledge management

November 2002

704 pages

ISBN:1581134924

DOI:10.1145/584792

General Chair:
Charles Nicholas
University of Maryland Baltimore County
,
Program Chairs:
David Grossman
Illinois Institute of Technology
,
Konstantinos Kalpakis
University of Maryland Baltimore County
,
Sajda Qureshi
Erasmus University, Rotterdam
,
Han van Dissel
Erasmus University, Rotterdam
,
Len Seligman
The MITRE Corporation

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CIKM02

Sponsor:

CIKM02: Eleventh ACM International Conference on Information and Knowledge Management

November 4 - 9, 2002

Virginia, McLean, USA

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
829
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Huang YHsu J(2018)Mining web logs to improve hit ratios of prefetching and cachingKnowledge-Based Systems10.1016/j.knosys.2006.11.00421:1(62-69)Online publication date: 31-Dec-2018
https://dl.acm.org/doi/10.1016/j.knosys.2006.11.004
Khare SBhandari AMurthy H(2014)URL classification using non negative matrix factorization2014 Twentieth National Conference on Communications (NCC)10.1109/NCC.2014.6811274(1-6)Online publication date: Feb-2014
https://doi.org/10.1109/NCC.2014.6811274
Bommepally KGlisa TPrakash JSingh SMurthy H(2010)Internet activity analysis through proxy log2010 National Conference On Communications (NCC)10.1109/NCC.2010.5430163(1-5)Online publication date: Jan-2010
https://doi.org/10.1109/NCC.2010.5430163
Yang SHsu C(2009)An ontological Proxy Agent with prediction, CBR, and RBR techniques for fast query processingExpert Systems with Applications: An International Journal10.5555/1512993.151313336:5(9358-9370)Online publication date: 1-Jul-2009
https://dl.acm.org/doi/10.5555/1512993.1513133
Yang SHsu C(2009)An ontological Proxy Agent with prediction, CBR, and RBR techniques for fast query processingExpert Systems with Applications10.1016/j.eswa.2009.01.01136:5(9358-9370)Online publication date: Jul-2009
https://doi.org/10.1016/j.eswa.2009.01.011
Yang MGu Z(2006)Personalized recommendation based on partial similarity of interestsProceedings of the Second international conference on Advanced Data Mining and Applications10.1007/11811305_56(509-516)Online publication date: 14-Aug-2006
https://dl.acm.org/doi/10.1007/11811305_56
Huang YHsu J(2005)Mining Web Logs to Improve Hit Ratios of Prefetching and CachingProceedings of the 2005 IEEE/WIC/ACM International Conference on Web Intelligence10.1109/WI.2005.100(577-580)Online publication date: 19-Sep-2005
https://dl.acm.org/doi/10.1109/WI.2005.100
Goh STan K(2005)Activities Awareness in a Cache NetworkProceedings of the 11th International Conference on Parallel and Distributed Systems - Volume 0110.1109/ICPADS.2005.62(161-167)Online publication date: 20-Jul-2005
https://dl.acm.org/doi/10.1109/ICPADS.2005.62

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents