research-article

Improving content delivery using provider-aided distance information

Authors:

Benjamin Frank,

Georgios Smaragdakis,

Anja FeldmannAuthors Info & Claims

IMC '10: Proceedings of the 10th ACM SIGCOMM conference on Internet measurement

Pages 22 - 34

https://doi.org/10.1145/1879141.1879145

Published: 01 November 2010 Publication History

Abstract

Content delivery systems constitute a major portion of today's Internet traffic. While they are a good source of revenue for Internet Service Providers (ISPs), the huge volume of content delivery traffic also poses a significant burden and traffic engineering challenge for the ISP. The difficulty is due to the immense volume of transfers, while the traffic engineering challenge stems from the fact that most content delivery systems themselves utilize a distributed infrastructure. They perform their own traffic flow optimization and realize this using the DNS system. While content delivery systems may, to some extent, consider the user's performance within their optimization criteria, they currently have no incentive to consider any of the ISP's constraints. As a consequence, the ISP has ``lost control'' over a major part of its traffic. To overcome this impairment, we propose a solution where the ISP offers a Provider-aided Distance Information System (PaDIS). PaDIS uses information available only to the ISP to rank any client-host pair based on distance information, such as delay, bandwidth or number of hops.

In this paper we show that the applicability of the system is significant. More than 70% of the HTTP traffic of a major European ISP can be accessed via multiple different locations. Moreover, we show that deploying PaDIS is not only beneficial to ISPs, but also to users. Experiments with different content providers show that improvements in download times of up to a factor of four are possible. Furthermore, we describe a high performance implementation of PaDIS and show how it can be deployed within an ISP.

References

[1]

Hrishikesh B. Acharya and Mohamed G. Gouda. The Theory of Network Tracing. In Proc. of ACM PODC'09.

Digital Library

[2]

Bernhard Ager, Fabian Schneider, Juhoon Kim, and Anja Feldmann. Revisiting cacheability in times of user generated content. In Proc. of IEEE Global Internet Symp. '10.

[3]

Vinay Aggarwal, Obi Akonjang, and Anja Feldmann. Improving User and ISP Experience through ISP-aided P2P Locality. In Proc. of IEEE Global Internet Symp. ’08.

[4]

Vinay Aggarwal, Anja Feldmann, and Christian Scheideler. Can ISPs and P2P Users Cooperate for Improved Performance? SIGCOMM Comput. Commun. Rev., 37(3), 2007.

Digital Library

[5]

B. Agger, W. Mühlbauer, G. Smaragdakis, and S. Uhlig. Comparing DNS Resolvers in the Wild. In Proc. of ACM IMC '10.

Digital Library

[6]

Hussein A. Alzoubi, Michael Rabinovich, and Oliver Spatscheck. MyXDNS: A Request Routing DNS Server with Decoupled Server Selection. In Proc. of WWW '07.

Digital Library

[7]

Demetres Antoniades, Evangelos P. Markatos, and Constantine Dovrolis. One-click Hosting Services: a File-sharing Hideout. In Proc. of ACM IMC '09.

Digital Library

[8]

Ruchir Bindal, Pei Cao, William Chan, Jan Medved, George Suwala, Tony Bates, and Amy Zhang. Improving Traffic Locality in BitTorrent via Biased Neighbor Selection. In Proc. of IEEE ICDCS '06.

Digital Library

[9]

Robert L. Carter and Mark E. Crovella. On the Network Impact of Dynamic Server Selection. Computer Networks, 31((23--24)):2529--2558, 1999.

Digital Library

[10]

Meeyoung Cha, Haewoon Kwak, Pablo Rodriguez, Yong-Yeol Ahn, and Sue Moon. Analyzing the Video Popularity Characteristics of Large-scale User Generated Content Systems. IEEE/ACM Trans. Networking, 17(5):1357--1370, 2009.

Digital Library

[11]

David R. Choffnes and Fabián E. Bustamante. Taming the Torrent: a Practical Approach to Reducing Cross-ISP Traffic in Peer-to-peer Systems. In Proc. of ACM SIGCOMM ’08.

Digital Library

[12]

C. Contavalli, W. van der Gaast, S. Leach, and D. Rodden. Client IP Information in DNS Requests. IETF draft, work in progress, draft-vandergaast-edns-client-ip-00.txt, Jan 2010.

[13]

Graham Cormode and Marios Hadjieleftheriou. Methods for Finding Frequent Items in Data Streams. The VLDB J., 19(1):3--20, 2010.

Digital Library

[14]

Dominic DiPalantino and Ramesh Johari. Traffic Engineering versus Content Distribution: A Game-theoretic Perspective. In Proc. of IEEE INFOCOM ’09.

[15]

Holger Dreger, Anja Feldmann, Michael Mai, Vern Paxson, and Robin Sommer. Dynamic Application-Layer Protocol Analysis for Network Intrusion Detection. In Proc. of USENIX Security Symp. '06.

Digital Library

[16]

Roy Fielding, Jim Gettys, Jeffrey Mogul, Henrik Frystyk, Larry Masinter, Paul Leach, and Tim Berners-Lee. Hypertext Transfer Protocol -- HTTP/1.1. RFC 2616, Jun 1999.

[17]

Cheng Huang, Angela Wang, Jin Li, and Keith W. Ross. Measuring and Evaluating Large-scale CDNs. In Proc. of ACM SIGCOMM IMC '08, paper withdrawn.

[18]

Wenjie Jiang, Rui Zhang-Shen, Jennifer Rexford, and Mung Chiang. Cooperative Content Distribution and Traffic Engineering in an ISP Network. In Proc. of ACM SIGMETRICS '09.

Digital Library

[19]

Thomas Karagiannis, Pablo Rodriguez, and Konstantina Papagiannaki. Should ISPs fear Peer-Assisted Content Distribution? In Proc. of ACM IMC '05.

Digital Library

[20]

Balachander Krishnamurthy, Craig Wills, and Yin Zhang. On the Use and Performance of Content Distribution Networks. In Proc. of ACM SIGCOMM IMW '01.

Digital Library

[21]

Rupa Krishnan, Harsha V. Madhyastha, Sridhar Srinivasan, Sushant Jain, Arvind Krishnamurthy, Thomas Anderson, and Jie Gao. Moving Beyond End-to-end Path Information to Optimize CDN Performance. In Proc. of ACM SIGCOMM IMC '09.

Digital Library

[22]

Craig Labovitz, Scott lekel Johnson, Danny McPherson, Jon Oberheide, and Farnam Jahanian. Internet Inter-Domain Traffic. In Proc. of ACM SIGCOMM '10.

Digital Library

[23]

Tom Leighton. Improving Performance on the Internet. Commun. ACM, 52(2):44--51, 2009.

Digital Library

[24]

Gregor Maier, Anja Feldmann, Vern Paxson, and Mark Allman. On Dominant Characteristics of Residential Broadband Internet Traffic. In Proc. of ACM SIGCOMM IMC '09.

Digital Library

[25]

P. Mockapetris. Domain Names - Implementation and Specification. RFC 1035, Nov 1987.

[26]

Jianping Pan, Y. Thomas Hou, and Bo Li. An Overview of DNS-based Server Selections in Content Distribution Networks. Comput. Netw., 43(6):695--711, 2003.

Digital Library

[27]

Vern Paxson. Bro: A System for Detecting Network Intruders in Real-Time. Computer Networks, 31(23--24), 1999.

Digital Library

[28]

Sylvia Ratnasamy, Mark Handley, Richard Karp, and Scott Shenker. Topologically Aware Overlay Construction and Server Selection. In Proc. of IEEE INFOCOM '02.

[29]

Sandvine Inc. 2009 global broadband phenomena. http://www.sandvine.com/news/global_broadband_trends.asp.

[30]

Fabian Schneider. Analysis of New Trends in the Web from a Network Perspective. PhD thesis, Technische Universität Berlin, Mar 2010.

[31]

Hendrik Schulze and Klaus Mochalski. Internet study 2008--9. http://www.ipoque.com/resources/internet-studies.

[32]

Jan Seedorf and Eric W. Burger. Application-Layer Traffic Optimization (ALTO) Problem Statement. RFC 5693, Oct 2009.

[33]

S. S. Siwpersad, Bamba Gueye, and Steve Uhlig. Assessing the Geographic Resolution of Exhaustive Tabulation for Geolocating Internet Hosts. In Proc. of PAM ’08.

Digital Library

[34]

Ao-Jan Su, David R. Choffnes, Aleksandar Kuzmanovic, and Fabián E. Bustamante. Drafting behind Akamai: Inferring Network Conditions based on CDN Redirections. IEEE/ACM Trans. Netw., 17(6):1752--1765, 2009.

Digital Library

[35]

Sipat Triukose, Zakaria Al-Qudah, and Michael Rabinovich. Content Delivery Networks: Protection or Threat? In Proc. of ESORICS '09.

Digital Library

[36]

Haiyong Xie, Y. Richard Yang, Arvind Krishnamurthy, Yanbin Grace Liu, and Abraham Silberschatz. P4P: Provider Portal for applications. In Proc. of ACM SIGCOMM ’08.

Digital Library

Cited By

Zerwas JPoese ISchmid SBlenk A(2022)On the Benefits of Joint Optimization of Reconfigurable CDN-ISP InfrastructureIEEE Transactions on Network and Service Management10.1109/TNSM.2021.311913419:1(158-173)Online publication date: Mar-2022
https://doi.org/10.1109/TNSM.2021.3119134
Zhu GGu W(2022)User Mapping Strategy in Multi-CDN Streaming: A Data-Driven ApproachIEEE Internet of Things Journal10.1109/JIOT.2021.31125619:9(6638-6649)Online publication date: 1-May-2022
https://doi.org/10.1109/JIOT.2021.3112561
Fan QYin HJiao LLyu YHuang HZhang X(2021)Towards Optimal Request Mapping and Response Routing for Content Delivery NetworksIEEE Transactions on Services Computing10.1109/TSC.2018.279656714:2(606-613)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TSC.2018.2796567
Show More Cited By

Index Terms

Improving content delivery using provider-aided distance information

Recommendations

Improving Content Delivery with PaDIS

Content-delivery networks (CDNs) originate a large fraction of Internet traffic; yet, due to how CDNs often perform traffic optimization, users aren't always assigned to the best servers for end-user performance. To improve user assignment of CDNs, the ...
QoS dynamic routing in content delivery networks
NETWORKING'05: Proceedings of the 4th IFIP-TC6 international conference on Networking Technologies, Services, and Protocols; Performance of Computer and Communication Networks; Mobile and Wireless Communication Systems

Recently, much research in quality of service (QoS) routing has focused on the unicast communication technique. However, Content Delivery Network (CDN) approach becomes popular because CDN enables effective and inexpensive improvement of Internet ...
Enabling content-aware traffic engineering

Today, a large fraction of Internet traffic is originated by Content Delivery Networks (CDNs). To cope with increasing demand for content, CDNs have deployed massively distributed infrastructures. These deployments pose challenges for CDNs as they have ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IMC '10: Proceedings of the 10th ACM SIGCOMM conference on Internet measurement

November 2010

496 pages

ISBN:9781450304832

DOI:10.1145/1879141

Program Chair:
Mark Allman
International Computer Science Institute

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

USENIX Assoc: USENIX Assoc

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IMC '10

Sponsor:

IMC '10: Internet Measurement Conference

November 1 - 30, 2010

Melbourne, Australia

Acceptance Rates

Overall Acceptance Rate 277 of 1,083 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

70
Total Citations
View Citations
553
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zerwas JPoese ISchmid SBlenk A(2022)On the Benefits of Joint Optimization of Reconfigurable CDN-ISP InfrastructureIEEE Transactions on Network and Service Management10.1109/TNSM.2021.311913419:1(158-173)Online publication date: Mar-2022
https://doi.org/10.1109/TNSM.2021.3119134
Zhu GGu W(2022)User Mapping Strategy in Multi-CDN Streaming: A Data-Driven ApproachIEEE Internet of Things Journal10.1109/JIOT.2021.31125619:9(6638-6649)Online publication date: 1-May-2022
https://doi.org/10.1109/JIOT.2021.3112561
Fan QYin HJiao LLyu YHuang HZhang X(2021)Towards Optimal Request Mapping and Response Routing for Content Delivery NetworksIEEE Transactions on Services Computing10.1109/TSC.2018.279656714:2(606-613)Online publication date: 1-Mar-2021
https://doi.org/10.1109/TSC.2018.2796567
Rapaport EPoese IZilberman PHolschke OPuzis R(2021)Spillover Today? Predicting Traffic Overflows on Private Peering of Major Content ProvidersIEEE Transactions on Network and Service Management10.1109/TNSM.2021.312664318:4(4169-4182)Online publication date: Dec-2021
https://doi.org/10.1109/TNSM.2021.3126643
Ghaznavi MJalalpour ESalahuddin MBoutaba RMigault DPreda S(2021)Content Delivery Network Security: A SurveyIEEE Communications Surveys & Tutorials10.1109/COMST.2021.309349223:4(2166-2190)Online publication date: Dec-2022
https://doi.org/10.1109/COMST.2021.3093492
Zhao YSaeed AAmmar MZegura E(2019)Unison: Enabling Content Provider/ISP Collaboration using a vSwitch Abstraction2019 IEEE 27th International Conference on Network Protocols (ICNP)10.1109/ICNP.2019.8888032(1-11)Online publication date: Oct-2019
https://doi.org/10.1109/ICNP.2019.8888032
Silva WSadok D(2018)A Survey on Efforts to Evolve the Control Plane of Inter-Domain RoutingInformation10.3390/info90501259:5(125)Online publication date: 18-May-2018
https://doi.org/10.3390/info9050125
Blendin JBendfeldt FPoese IKoldehofe BHohlfeld O(2018)Dissecting Apple's Meta-CDN during an iOS UpdateProceedings of the Internet Measurement Conference 201810.1145/3278532.3278567(408-414)Online publication date: 31-Oct-2018
https://dl.acm.org/doi/10.1145/3278532.3278567
Wohlfart FChatzis NDabanoglu CCarle GWillinger WGorinsky STapolcai J(2018)Leveraging interconnections for performanceProceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication10.1145/3230543.3230576(206-220)Online publication date: 7-Aug-2018
https://dl.acm.org/doi/10.1145/3230543.3230576
Hohlfeld ORüth JWolsing KZimmermann T(2018)Characterizing a Meta-CDNPassive and Active Measurement10.1007/978-3-319-76481-8_9(114-128)Online publication date: 2-Mar-2018
https://doi.org/10.1007/978-3-319-76481-8_9
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents