Article

Make it fresh, make it quick: searching a network of personal webservers

Authors:

Roberto J. Bayardo, Jr.,

Sridhar Rajagopalan,

Eugene J. ShekitaAuthors Info & Claims

WWW '03: Proceedings of the 12th international conference on World Wide Web

Pages 577 - 586

https://doi.org/10.1145/775152.775234

Published: 20 May 2003 Publication History

Abstract

Personal webservers have proven to be a popular means of sharing files and peer collaboration. Unfortunately, the transient availability and rapidly evolving content on such hosts render centralized, crawl-based search indices stale and incomplete. To address this problem, we propose YouSearch, a distributed search application for personal webservers operating within a shared context (e.g., a corporate intranet). With YouSearch, search results are always fast, fresh and complete -- properties we show arise from an architecture that exploits both the extensive distributed resources available at the peer webservers in addition to a centralized repository of summarized network state. YouSearch extends the concept of a shared context within web communities by enabling peers to aggregate into groups and users to search over specific groups. In this paper, we describe the challenges, design, implementation and experiences with a successful intranet deployment of YouSearch.

References

[1]

Apache's HTTP Server Project. http://httpd.apache.org/.]]

[2]

BadBlue -- The P2P File Sharing Web Server. http://www.badblue.com/]]

[3]

The Gnutella Network. http://www.gnutella.com/.]]

[4]

Google -- The Web Search Engine. http://www.google.com/.]]

[5]

Groove Networks, Inc. Desktop Collaboration Software. http://www.groove.net/.]]

[6]

ht://Dig - Internet Search Engine Software. http://htdig.org/.]]

[7]

The KaZaa Media Network. http://www.kazaa.com/.]]

[8]

Mac OS X: Personal Web Sharing. http://www.mac3d.com/.]]

[9]

LAN-Based web caching for accelerated web access. http://www.mangosoft.com/products/cachelink.]]

[10]

Microsoft's Personal Web Server and Peer Web Services. http://www.microsoft.com/.]]

[11]

The Napster Company. http://www.napster.com/.]]

[12]

SWISH-E: Simple Web Indexing System for Humans-Enhanced. http://swish-e.org/.]]

[13]

The XDegrees Company. http://www.xdegrees.com/.]]

[14]

R. J. Bayardo Jr., A. Somani, D. Gruhl and R. Agrawal.YouServ: A Web Hosting and Content Sharing Tool for the Masses.In Proc. Intl. World Wide Web Conf. (WWW), 2002.]]

Digital Library

[15]

K. Bharat.SearchPad: Explicit Capture of Search Context to Support Web Search.In Proc. 9th Intl. World Wide Web (WWW) Conference, 2000.]]

Digital Library

[16]

B. Bloom.Space/time Trade-offs in Hash Coding with Allowable Errors.In Communications of ACM, volume 13(7), pages 422--426, 1970.]]

Digital Library

[17]

D. Carmel, E. Amitay, M. Herscovici, Y. Maarek, Y. Petruschka, and A. Soffer.Juru at TREC 10 - Experiments with Index Pruning.In Proc. Text REtrieval Conference (TREC), 2001.]]

[18]

F. M. Cuenca-Acuna and T. D. Nguyen.Text-Based Content Search and Retrieval in Ad Hoc P2P Communities.In Proc. Intl. Workshop in Peer-to-Peer Computing, 2002.]]

Digital Library

[19]

F. Dabek, E. Brunskill, M. F. Kaashoek, D. Karger, R. Morris, I. Stoica, and H. Balakrishnan.Building Peer-to-Peer Systems with Chord, a Distributed Lookup Service.In Proc. Workshop on Hot Topics in Operating Systems (HotOS), 2001.]]

Digital Library

[20]

C. Dwork, R. Kumar, M. Naor, and D. Sivakumar.Rank Aggregation Methods for the Web.In Proc. Intl. World Wide Web Conf. (WWW), 2001.]]

Digital Library

[21]

S. Iyer, A. Rowstron, and P. Druschel.Squirrel: A decentralized peer-to-peer web cache. In Proc. ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (PODC), 2002.]]

Digital Library

[22]

M. Mitzenmacher.Compressed Bloom Filters. In Proc. ACM SIGACT-SIGOPS Symposium on Principles of Distributed Computing (PODC), 2001.]]

Digital Library

[23]

V. N. Padmanabhan and K. Sripanidkulchai. The Case for Cooperative Networking. In Proc. Intl. Peer-to-Peer Systems (IPTPS) Workshop, 2002.]]

Digital Library

[24]

S. Ratnasamy, P. Francis, M. Handley, and R. Karp. A Scalable Content-Addressable Network (CAN). In Proc. of ACM SIGCOMM, 2001.]]

Digital Library

[25]

R. Rivest. RFC 1321: The MD5 Message-Digest Algorithm. As Technical report, Network Working Group, 1992.]]

Digital Library

[26]

A. Rowstron and P. Druschel. Pastry: Scalable, Distributed Object Location and Routing for Large-scale Peer-to-Peer Systems. In Proc. IFIP/ACM Intl. Conf. on Distributed Systems Platforms (Middleware), 2001.]]

Digital Library

[27]

T. Stading, P. Maniatis, and M. Baker. Peer-to-peer Caching Schemes to Address Flash Crowds. In Proc. Intl. Peer-to-Peer Systems (IPTPS) Workshop, 2002.]]

Digital Library

[28]

A. Stavrou, D. Rubenstein, and S. Sahu. A Lightweight, Robust P2P System to Handle Flash Crowds. In Proc. IEEE Intl. Conf. on Network Protocols (ICNP), 2002.]]

Digital Library

[29]

Y. Xie and D. O'Hallaron. Locality in Search Engine Queries and its Implications for Caching. In Proc. IEEE INFOCOM, 2000.]]

Cited By

Bondade APatil PPatle G(2020)Attribute based Encryption for Improved Multi-Keyword Search in Information Network2020 5th International Conference on Communication and Electronics Systems (ICCES)10.1109/ICCES48766.2020.9138046(692-696)Online publication date: Jun-2020
https://doi.org/10.1109/ICCES48766.2020.9138046
Syed BIndurthi VGupta MShrivastava MVarma V(2019)Inductive Transfer Learning for Detection of Well-Formed Natural Language Search QueriesAdvances in Information Retrieval10.1007/978-3-030-15719-7_6(45-52)Online publication date: 7-Apr-2019
https://doi.org/10.1007/978-3-030-15719-7_6
Yuzhe Tang Ling Liu (2015)Privacy-Preserving Multi-Keyword Search in Information NetworksIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2015.240733027:9(2424-2437)Online publication date: 4-Aug-2015
https://dl.acm.org/doi/10.1109/TKDE.2015.2407330
Show More Cited By

Index Terms

Recommendations

Incentive Mechanisms in P2P Media Streaming Systems

Free riding, whereby a peer utilizes network resources but doesn't contribute services, could have a huge impact on the efficacy of streaming systems, leading to scalability issues and service degradation. BitTorrent-like tit-for-tat mechanisms can't ...
YouServ: a web-hosting and content sharing tool for the masses
WWW '02: Proceedings of the 11th international conference on World Wide Web

YouServ is a system that allows its users to pool existing desktop computing resources for high availability web hosting and file sharing. By exploiting standard web and internet protocols (e.g. HTTP and DNS), YouServ does not require those who access ...
Cost-effective broadcast for fully decentralized peer-to-peer networks

Fully unstructured and decentralized peer-to-peer networks such as Gnutella are appealing for a variety of applications, among which file-sharing is the most prominent one. The decentralized nature of these systems provides a high degree of robustness ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '03: Proceedings of the 12th international conference on World Wide Web

May 2003

772 pages

ISBN:1581136803

DOI:10.1145/775152

Conference Chairs:
Gusztáv Hencsey
MTA SZTAKI, Hungary
,
Bebo White
Stanford Linear Accelerator Center, USA
,
Program Chairs:
Yih-Farn Robin Chen
AT&T Labs -- Research, USA
,
László Kovács
MTA SZTAKI, Hungary
,
Steve Lawrence
Google Inc., USA

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 May 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
1,038
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bondade APatil PPatle G(2020)Attribute based Encryption for Improved Multi-Keyword Search in Information Network2020 5th International Conference on Communication and Electronics Systems (ICCES)10.1109/ICCES48766.2020.9138046(692-696)Online publication date: Jun-2020
https://doi.org/10.1109/ICCES48766.2020.9138046
Syed BIndurthi VGupta MShrivastava MVarma V(2019)Inductive Transfer Learning for Detection of Well-Formed Natural Language Search QueriesAdvances in Information Retrieval10.1007/978-3-030-15719-7_6(45-52)Online publication date: 7-Apr-2019
https://doi.org/10.1007/978-3-030-15719-7_6
Yuzhe Tang Ling Liu (2015)Privacy-Preserving Multi-Keyword Search in Information NetworksIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2015.240733027:9(2424-2437)Online publication date: 4-Aug-2015
https://dl.acm.org/doi/10.1109/TKDE.2015.2407330
Ding SGollapudi SIeong SKenthapadi KNtoulas AMa WNie JBaeza-Yates RChua TCroft W(2011)Indexing strategies for graceful degradation of search qualityProceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval10.1145/2009916.2009994(575-584)Online publication date: 24-Jul-2011
https://dl.acm.org/doi/10.1145/2009916.2009994
Wu LMenczer FShin SOssowski S(2009)Diverse peer selection in collaborative web searchProceedings of the 2009 ACM symposium on Applied Computing10.1145/1529282.1529666(1709-1713)Online publication date: 8-Mar-2009
https://dl.acm.org/doi/10.1145/1529282.1529666
Bawa MBayardo RAgrawal RVaidya J(2009)Privacy-preserving indexing of documents on the networkThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-008-0129-718:4(837-856)Online publication date: 1-Aug-2009
https://dl.acm.org/doi/10.1007/s00778-008-0129-7
Menczer FWu LAkavipat R(2008)Intelligent Peer Networks for Collaborative Web SearchAI Magazine10.1609/aimag.v29i3.215529:3(35-46)Online publication date: 1-Sep-2008
https://dl.acm.org/doi/10.1609/aimag.v29i3.2155
Tiago PKotilainen NVapa MKokkinen HNurminen J(2008)Mobile Search - Social Network Search Using Mobile Devices2008 5th IEEE Consumer Communications and Networking Conference10.1109/ccnc08.2007.268(1201-1205)Online publication date: Jan-2008
https://doi.org/10.1109/ccnc08.2007.268
Seshadri SCooper B(2007)Routing Queries through a Peer-to-Peer InfoBeacons Network Using Information Retrieval TechniquesIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2007.110718:12(1754-1765)Online publication date: 1-Dec-2007
https://dl.acm.org/doi/10.1109/TPDS.2007.1107
Zeinalipour-Yazti DKalogeraki VGunopulos D(2007)pFusionIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2007.106018:6(804-817)Online publication date: 1-Jun-2007
https://dl.acm.org/doi/10.1109/TPDS.2007.1060
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten