Article

An empirical evaluation of wide-area internet bottlenecks

Authors:

Srinivasan Seshan,

Anees ShaikhAuthors Info & Claims

IMC '03: Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement

Pages 101 - 114

https://doi.org/10.1145/948205.948219

Published: 27 October 2003 Publication History

Abstract

Conventional wisdom has been that the performance limitations in the current Internet lie at the edges of the network -- i.e last mile connectivity to users, or access links of stub ASes. As these links are upgraded, however, it is important to consider where new bottlenecks and hot-spots are likely to arise. In this paper, we address this question through an investigation of non-access bottlenecks. These are links within carrier ISPs or between neighboring carriers that could potentially constrain the bandwidth available to long-lived TCP flows. Through an extensive measurement study, we discover, classify, and characterize bottleneck links (primarily in the U.S.) in terms of their location, latency, and available capacity.We find that about 50% of the Internet paths explored have a non-access bottleneck with available capacity less than 50 Mbps, many of which limit the performance of well-connected nodes on the Internet today. Surprisingly, the bottlenecks identified are roughly equally split between intra-ISP links and peering links between ISPs. Also, we find that low-latency links, both intra-ISP and peering, have a significant likelihood of constraining available bandwidth. Finally, we discuss the implications of our findings on related issues such as choosing an access provider and optimizing routes through the network. We believe that these results could be valuable in guiding the design of future network services, such as overlay routing, in terms of which links or paths to avoid (and how to avoid them) in order to improve performance.

References

[1]

D. Andersen, H. Balakrishnan, M. Kaashoek, and R. Morris. Resilient Overlay Networks. In Proceedings of the 18th Symposium on Operating System Principles, Banff, Canada, October 2001.

Digital Library

[2]

H. Balakrishnan, S. Seshan, M. Stemm, and R. H. Katz. Analyzing stability in wide-area network performance. In Proceedings of ACM SIGMETRICS, Seattle, WA, June 1997.

Digital Library

[3]

L.S.Brakmo,S.W.O'Malley,andL.L.Peterson. TCP Vegas: New Techniques for Congestion Detection and Avoidance. In Proceedings of the SIGCOMM '94 Symposium on Communications Architectures and Protocols, August 1994.

Digital Library

[4]

T. Bu, N. Duffield, F. L. Presti, and D. Towsley. Network tomography on general topologies. In Proceedings of ACM SIGMETRICS, Marina Del Ray, CA, June 2002.

Digital Library

[5]

R. L. Carter and M. E. Crovella. Measuring bottleneck link speed in packet-switched networks. Performance Evaluation, 27-28:297--318, October 1996.

Digital Library

[6]

Cooperative Association for Internet Data Analysis (CAIDA). Internet tools taxonomy. http://www.caida.org/tools/taxonomy/, October 2002.

[7]

A. Downey. Using pathchar to estimate internet link characteristics. In Proceedings of ACM SIGCOMM, Cambridge, MA, August 1999.

Digital Library

[8]

L. Gao. On inferring autonomous system relationships in the Internet. IEEE/ACM Transactions on Networking, 9(6), December 2001.

Digital Library

[9]

R. Govindan and V. Paxson. Estimating router ICMP generation delays. In Proceedings of Passive and Active Measurement Workshop (PAM), Fort Collins, CO, 2002.

[10]

J. Guojun, G. Yang, B. R. Crowley, and D. A. Agarwal. Network characterization service (NCS). In Proceedings of IEEE International Symposium on High Performance Distributed Computing (HPDC), San Francisco, CA, August 2001.

Digital Library

[11]

U. Hengartner, S. Moon, R. Mortier, and C. Diot. Detection and analysis of routing loops in packet traces. In Proceedings of ACM SIGCOMM Internet Measurement Workshop (IMW), November 2002.

Digital Library

[12]

V. Jacobson. pathchar - A Tool to Infer Characteristics of Internet Paths. ftp://ee.lbl.gov/pathchar/, 1997.

[13]

M. Jain and C. Dovrolis. End-to-end available bandwidth: Measurement methodology, dynamics, and relation with TCP throughput. In Proceedings of ACM SIGCOMM, Pittsburgh, PA, August 2002.

Digital Library

[14]

M. Jain and C. Dovrolis. Pathload: A measurement tool for end-to-end available bandwidth. In Proceedings of Passive and Active Measurement Workshop (PAM), Fort Collins, CO, March 2002.

[15]

S. Jaiswal, G. Iannaccone, C. Diot, J. Kurose, and D. Towsley. Measurement and classification of out-of-sequence packets in a tier-1 IP backbone. In Proceedings of ACM SIGCOMM Internet Measurement Workshop (IMW), November 2002.

Digital Library

[16]

C. Labovitz, A. Ahuja, and F. Jahanian. Experimental study of Internet stability and backbone failures. In Proceedings of IEEE International Symposium on Fault-Tolerant Computing (FTCS), Madison, WI, June 1999.

Digital Library

[17]

K. Lai and M. Baker. Nettimer: A tool for measuring bottleneck link bandwidth. In Proceedings of USENIX Symposium on Internet Technologies and Systems, March 2001.

Digital Library

[18]

B. A. Mah. pchar: A tool for measuring internet path characteristics. http://www.employees.org/~bmah/Software/pchar/, June 2000.

[19]

A. P. Markopoulou, F. A. Tobagi, and M. J. Karam. Assessment of VoIP quality over Internet backbones. In Proceedings of IEEE INFOCOM'02, New York, NY, June 2002.

[20]

M. Mathis and J. Mahdavi. Diagnosing Internet Congestion with a Transport Layer Performance Tool . In Proc. INET '96, Montreal, Canada, June 1996. http://www.isoc.org/inet96/proceedings/.

[21]

Network Characterization Service: Netest and Pipechar. http://www-didc.lbl.gov/pipechar, 1999.

[22]

ns-2 Network Simulator. http://www.isi.edu/nsnam/ns/, 2000.

[23]

V. Paxson. End-to-end internet packet dynamics. Proceedings of the SIGCOMM '97 Symposium on Communications Architectures and Protocols, pages 139--152, September 1997.

Digital Library

[24]

V. Paxson. End-to-end routing behavior in the internet. IEEE/ACM Transactions on Networking, 5(5):601--615, October 1997.

Digital Library

[25]

V. Paxson, A. Adams, and M. Mathis. Experiences with NIMI. In Proceedings of Passive and Active Measurement Workshop (PAM), Hamilton, New Zealand, April 2000.

[26]

PlanetLab. http://www.planet-lab.org, 2002.

[27]

RADB whois Server. whois.radb.net.

[28]

RIPE whois Service. whois.ripe.net.

[29]

BGP Tables from the University of Oregon RouteViews Project. http://moat.nlanr.net/AS/data.

[30]

University of Oregon, RouteViews Project. http://www.routeviews.org.

[31]

S. Savage, T. Anderson, A. Aggarwal, D. Becker, N. Cardwell, A. Collins, E. Hoffman, J. Snell, A. Vahdat, J. Voelker, and J. Zahorjan. Detour: a case for informed internet routing and transport. IEEE Micro, volume 19 no. 1:50--59, January 1999.

Digital Library

[32]

S. Savage, A. Collins, E. Hoffman, J. Snell, and T. Anderson. The end-to-end effects of internet path selection. In Proceedings of the SIGCOMM '99 Symposium on Communications Architectures and Protocols, pages 289--299, 1999.

Digital Library

[33]

L. Subramanian, S. Agarwal, J. Rexford, and R. H. Katz. Characterizing the Internet hierarchy from multiple vantage points. In Proceedings of IEEE INFOCOM, June 2002.

[34]

Traceroute.org. http://www.traceroute.org.

[35]

Y. Zhang, L. Breslau, V. Paxson, and S. Shenker. On the characteristics and origins of Internet flow rates. In Proceedings of ACM SIGCOMM, Pittsburgh, PA, August 2002.

Digital Library

[36]

Y. Zhang, N. Duffield, V. Paxson, and S. Shenker. On the constancy of Internet path properties. In Proceedings of ACM SIGCOMM Internet Measurement Workshop (IMW), November 2001.

Digital Library

[37]

Y. Zhang, V. Paxson, and S. Shenker. The stationarity of internet path properties: Routing, loss, and throughput. Technical report, ICSI Center for Internet Research, May 2000.

Cited By

Wu CHo J(2022)Time-Critical Data Dissemination Under Flash Crowd TrafficIEEE Open Journal of the Computer Society10.1109/OJCS.2022.31494113(11-22)Online publication date: 2022
https://doi.org/10.1109/OJCS.2022.3149411
Gamero-Garrido ACarisimo EHao SHuffaker BSnoeren ADainotti A(2022)Quantifying Nations’ Exposure to Traffic Observation and Selective TamperingPassive and Active Measurement10.1007/978-3-030-98785-5_29(645-674)Online publication date: 22-Mar-2022
https://doi.org/10.1007/978-3-030-98785-5_29
Philip AWare RAthapathu RSherry JSekar VLevin DMislove AAmann JLuckie M(2021)Revisiting TCP congestion control throughput models & fairness properties at scaleProceedings of the 21st ACM Internet Measurement Conference10.1145/3487552.3487834(96-103)Online publication date: 2-Nov-2021
https://dl.acm.org/doi/10.1145/3487552.3487834
Show More Cited By

Index Terms

An empirical evaluation of wide-area internet bottlenecks
1. Hardware
  1. Communication hardware, interfaces and storage
2. Networks
  1. Network properties
    1. Network range
      1. Local area networks
      2. Wide area networks

Recommendations

Locating internet bottlenecks: algorithms, measurements, and implications

The ability to locate network bottlenecks along end-to-end paths on the Internet is of great interest to both network operators and researchers. For example, knowing where bottleneck links are, network operators can apply traffic engineering either at ...
An empirical evaluation of wide-area internet bottlenecks

Performance limitations in the current Internet are thought to lie at the edges of the network -- i.e last mile connectivity to users, or access links of stub ASes. As these links are upgraded, however, it is important to consider where new bottlenecks ...
Enhancing TCP performance in wide-area cellular wireless networks: transport level approaches
Wireless communications systems and networks

Internet technology-based architectures and protocols for supporting multimedia traffic over wireless networks are evolving. Since TCP (Transmission Control Protocol)/IP (Internet Protocol) is the standard network protocol stack on the Internet, its use ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IMC '03: Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement

October 2003

328 pages

ISBN:1581137737

DOI:10.1145/948205

Program Chair:
Mark Crovella
Boston University, MA

Copyright © 2003 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2003

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

IMC03

Sponsor:

IMC03: Internet Measurement Conference

October 27 - 29, 2003

FL, Miami Beach, USA

Acceptance Rates

IMC '03 Paper Acceptance Rate 32 of 109 submissions, 29%;

Overall Acceptance Rate 277 of 1,083 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

93
Total Citations
View Citations
1,139
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)2

Reflects downloads up to 07 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wu CHo J(2022)Time-Critical Data Dissemination Under Flash Crowd TrafficIEEE Open Journal of the Computer Society10.1109/OJCS.2022.31494113(11-22)Online publication date: 2022
https://doi.org/10.1109/OJCS.2022.3149411
Gamero-Garrido ACarisimo EHao SHuffaker BSnoeren ADainotti A(2022)Quantifying Nations’ Exposure to Traffic Observation and Selective TamperingPassive and Active Measurement10.1007/978-3-030-98785-5_29(645-674)Online publication date: 22-Mar-2022
https://doi.org/10.1007/978-3-030-98785-5_29
Philip AWare RAthapathu RSherry JSekar VLevin DMislove AAmann JLuckie M(2021)Revisiting TCP congestion control throughput models & fairness properties at scaleProceedings of the 21st ACM Internet Measurement Conference10.1145/3487552.3487834(96-103)Online publication date: 2-Nov-2021
https://dl.acm.org/doi/10.1145/3487552.3487834
Manzoor JSadre RDrago ICerda-Alabern L(2018)Is There a Case for Parallel Connections with Modern Web Protocols?2018 IFIP Networking Conference (IFIP Networking) and Workshops10.23919/IFIPNetworking.2018.8696647(1-9)Online publication date: May-2018
https://doi.org/10.23919/IFIPNetworking.2018.8696647
Rahman MUddin MHasan TRahman MKaykobad M(2018)Using Adaptive Heartbeat Rate on Long-Lived TCP ConnectionsIEEE/ACM Transactions on Networking10.1109/TNET.2017.277427526:1(203-216)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1109/TNET.2017.2774275
Sharma AKaur MKoradia ZNishant RPandit SRaman ASeth ASathiaseelan AZennaro MBelding EChen J(2015)Revisiting the State of Cellular Data Connectivity in IndiaProceedings of the 2015 Annual Symposium on Computing for Development10.1145/2830629.2830649(149-157)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1145/2830629.2830649
Anchuri PSumbaly RShah SLi JWang XGarofalakis MSoboroff ISuel TWang M(2014)Hotspot Detection in a Service-Oriented ArchitectureProceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management10.1145/2661829.2661991(1749-1758)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2661829.2661991
Kang MGligor VAhn GYung MLi N(2014)Routing Bottlenecks in the InternetProceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security10.1145/2660267.2660299(321-333)Online publication date: 3-Nov-2014
https://dl.acm.org/doi/10.1145/2660267.2660299
Mehmood MFeldmann AUhlig SWillinger W(2014)We are all treated equal, aren't we? — Flow-level performance as a function of flow size2014 IFIP Networking Conference10.1109/IFIPNetworking.2014.6857100(1-9)Online publication date: Jun-2014
https://doi.org/10.1109/IFIPNetworking.2014.6857100
Zhang WLei WLiu SLi G(2014)A general framework of multipath transport system based on application-level relayComputer Communications10.1016/j.comcom.2014.05.01451(70-80)Online publication date: 1-Sep-2014
https://dl.acm.org/doi/10.1016/j.comcom.2014.05.014
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents