research-article

A server-to-server view of the internet

Authors:

Balakrishnan Chandrasekaran,

Georgios Smaragdakis,

Matthew Luckie,

Keung-Chi NgAuthors Info & Claims

CoNEXT '15: Proceedings of the 11th ACM Conference on Emerging Networking Experiments and Technologies

Article No.: 40, Pages 1 - 13

https://doi.org/10.1145/2716281.2836125

Published: 01 December 2015 Publication History

Abstract

While the performance characteristics of access networks and end-user-to-server paths are well-studied, measuring the performance of the Internet's core remains, largely, an uncharted territory. With more content being moved closer to the end-user, server-to-server paths have increased in length and have a significant role in dictating the quality of services offered by content and service providers. In this paper, we present a large-scale study of the effects of routing changes and congestion on the end-to-end latencies of server-to-server paths in the core of the Internet.

We exploit the distributed platform of a large content delivery network, composed of thousands of servers around the globe, to assess the performance characteristics of the Internet's core. We conduct measurement campaigns between thousands of server pairs, in both forward and reverse directions, and analyze the performance characteristics of server-to-server paths over both long durations (months) and short durations (hours). Our analyses show that there is a large variation in the frequency of routing changes. While routing changes typically have marginal or no impact on the end-to-end round-trip times (RTTs), 20% of them impact IPv4 (IPv6) paths by at least 26 ms (31 ms). We highlight how dual-stack servers can be utilized to reduce server-to-server latencies by up to 50 ms. Our results indicate that significant daily oscillations in end-to-end RTTs of server-to-server paths is not the norm, but does occur, and, in most cases, contributes about a 20 ms increase in server-to-server path latencies.

References

[1]

AMS-IX Service Level Agreement. https://ams-ix.net/services-pricing/service-level-agreement.

[2]

Netflix Open Connect. https://signup.netflix.com/openconnect.

[3]

V. K. Adhikari, Y. Guo, F. Hao, M. Varvello, V. Hilt, M. Steiner, and Z. L. Zhang. Unreeling Netflix: Understanding and Improving Multi-CDN Movie Delivery. In IEEE INFOCOM, 2012.

[4]

V. K. Adhikari, S. Jain, and Z. L. Zhang. YouTube traffic dynamics and its interplay with a tier-1 ISP: an ISP perspective. In ACM IMC, 2010.

Digital Library

[5]

B. Ager, N. Chatzis, A. Feldmann, N. Sarrar, S. Uhlig, and W. Willinger. Anatomy of a Large European IXP. In ACM SIGCOMM, 2012.

Digital Library

[6]

B. Ager, W. Mühlbauer, G. Smaragdakis, and S. Uhlig. Web Content Cartography. In ACM IMC, 2011.

Digital Library

[7]

M. Allman. On Changing the Culture of Empirical Internet Assessment. ACM CCR, 43(3), 2013.

Digital Library

[8]

B. Augustin, X. Cuvellier, B. Orgogozo, F. Viger, T. Friedman, M. Latapy, C. Magnien, and R. Teixeira. Avoiding Traceroute Anomalies with Paris Traceroute. In ACM IMC, 2006.

Digital Library

[9]

R. Bush, O. Maennel, M. Roughan, and S. Uhlig. Internet Optometry: Assessing the Broken Glasses in Internet Reachability. In ACM IMC, 2009.

Digital Library

[10]

M. Calder, X. Fan, Z. Hu, E. Katz-Bassett, J. Heidemann, and R. Govindan. Mapping the Expansion of Google's Serving Infrastructure. In ACM IMC, 2013.

Digital Library

[11]

H. Chang, S. Jamin, and W. Willinger. Inferring as-level internet topology from router-level path traces. In Proceedings of SPIE ITCom, 2001.

[12]

N. Chatzis, G. Smaragdakis, A. Feldmann, and W. Willinger. There is More to IXPs than Meets the Eye. ACM CCR, 43(5), 2013.

Digital Library

[13]

N. Chatzis, G. Smaragdakis, A. Feldmann, and W. Willinger. Quo vadis Open-IX? Trying to boost public peering in the US. ACM CCR, 45(1), 2015.

Digital Library

[14]

F. Chen, R. K. Sitaraman, and M. Torres. End-User Mapping: Next Generation Request Routing for Content Delivery. In ACM SIGCOMM, 2015.

Digital Library

[15]

K. Chen, D. Choffnes, R. Potharaju, Y. Chen, F. Bustamante, D. Pei, and Y. Zhao. Where the Sidewalk Ends: Extending the Internet AS Graph Using Traceroutes From P2P Users. In CoNEXT, 2009.

Digital Library

[16]

J. Czyz, M. Allman, J. Zhang, S. Iekel-Johnson, E. Osterweil, and M. Bailey. Measuring IPv6 Adoption. In ACM SIGCOMM, 2014.

Digital Library

[17]

L. Deng and A. Kuzmanovic. Monitoring Persistently Congested Internet Links. In IEEE ICNP, 2008.

[18]

A. Dhamdhere and C. Dovrolis. Twelve Years in the Evolution of the Internet Ecosystem. IEEE/ACM Trans. Networking, 19(5), 2011.

Digital Library

[19]

F. Dobrian, A. Awan, D. Joseph, A. Ganjam, J. Zhan, V. Sekar, I. Stoica, and H. Zhang. Understanding the Impact of Video Quality on User Engagement. In ACM SIGCOMM, 2011.

Digital Library

[20]

I. Drago, M. Mellia, M. Munafo, A. Sperotto, R. Sadre, and A. Pras. Inside Dropbox: Understanding Personal Cloud Storage Services. In ACM IMC, 2012.

Digital Library

[21]

T. Holderbach, C. Pelsser, R. Bush, and L. Vanbever. Quantifying interference between measurements on the RIPE Atlas platform. In ACM IMC, 2015.

Digital Library

[22]

Y. Hyun, A. Broido, and k. claffy. Traceroute and BGP AS Path Incongruities. Technical report, Cooperative Association for Internet Data Analysis (CAIDA), Mar 2003.

[23]

S. Jain, A. Kumar, S. Mandal, J. Ong, L. Poutievski, A. Singh, S. Venkata, J. Wanderer, J. Zhou, M. Zhu, J. Zolla, U. Holzle, S. Stuart, and A. Vahdat. B4: Experience with a Globally-Deployed Software Defined WAN. In ACM SIGCOMM, 2013.

Digital Library

[24]

A. Khan, T. Kwon, H. C. Kim, and Y. Choi. AS-level Topology Collection through Looking Glass Servers. In ACM IMC, 2013.

Digital Library

[25]

A. Li, X. Yang, S. Kandula, and M. Zhang. CloudCmp: Comparing Public Cloud Providers. In ACM IMC, 2010.

Digital Library

[26]

A. Lodhi, A. Dhamdhere, and C. Dovrolis. Open Peering by Internet Transit Providers: Peer Preference or Peer Pressure? In IEEE INFOCOM, 2014.

[27]

M. Luckie, A. Dhamdhere, D. Clark, B. Huffaker, and kc claffy. Challenges in Inferring Internet Interdomain Congestion. In ACM IMC, 2014.

Digital Library

[28]

M. Luckie, A. Dhamdhere, k. claffy, and D. Murrell. Measured Impact of Crooked Traceroute. ACM CCR, 44(1), Jan 2011.

Digital Library

[29]

M. Luckie, B. Huffaker, A. Dhamdhere, V. Giotsas, and kc claffy. AS Relationships, Customers Cones, and Validations. In ACM IMC, 2013.

Digital Library

[30]

M. Dischinger and M. Marcon and S. Guha and K. P. Gummadi and R. Mahajan and S. Saroiu. Glasnost: Enabling End Users to Detect Traffic Differentiation. In NSDI, 2010.

Digital Library

[31]

H. V. Madhyastha, T. Isdal, M. Piatek, C. Dixon, T. Anderson, A. Krishnamurthy, and A. Venkataramani. iplane: An information plane for distributed services. 2006.

[32]

Z. M. Mao, J. Rexford, J. Wang, and R. H. Katz. Towards an Accurate AS-level Traceroute Tool. In ACM SIGCOMM, 2003.

Digital Library

[33]

M. Nikkhah, R. Guérin, Y. Lee, and R. Woundy. Assessing IPv6 through web access a measurement study and its findings. In CoNEXT, 2011.

Digital Library

[34]

E. Nygren, R. K. Sitaraman, and J. Sun. The Akamai Network: A Platform for High-performance Internet Applications. SIGOPS Oper. Syst. Rev., 2010.

Digital Library

[35]

V. Paxson. End-to-End Routing Behavior in the Internet. IEEE/ACM Trans. Networking, 5(5), 1997.

Digital Library

[36]

C. Pelsser, L. Cittadini, S. Vissicchio, and R. Bush. From Paris to Tokyo: On the Suitability of ping to Measure Latency. In ACM IMC, 2013.

Digital Library

[37]

I. Poese, B. Frank, B. Ager, G. Smaragdakis, and A. Feldmann. Improving Content Delivery using Provider-aided Distance Information. In ACM IMC, 2010.

Digital Library

[38]

M. Roughan, W. Willinger, O. Maennel, D. Pertouli, and R. Bush. 10 Lessons from 10 Years of Measuring and Modeling the Internet's Autonomous Systems. IEEE J. on Sel. Areas in Comm., 29(9), 2011.

[39]

M. A. Sanchez, J. S. Otto, Z. S. Bischof, D. R. Choffnes, F. E. Bustamante, B. Krishnamurthy, and W. Willinger. Dasu: Pushing Experiments to the Internet's Edge. In NSDI, 2013.

Digital Library

[40]

J. Sherry, S. Hasan, C. Scott, A. Krishnamurthy, S. Ratsanamy, and V. Sekar. Making Middleboxes Someone Else's Problem: Network Processing as a Cloud Service. In SIGCOMM, 2012.

Digital Library

[41]

A. Singla, B. Chandrasekaran, P. B. Godfrey, and B. M. Maggs. The Internet at the Speed of Light. In SIGCOMM HotNets, New York, NY, USA, 2014.

Digital Library

[42]

S. Sundaresan, W. de Donato, N. Feamster, R. Teixeira, S. Crawford, and A. Pescape. Broadband Internet Performance: A View From the Gateway. In ACM SIGCOMM, 2011.

Digital Library

[43]

S. Triukose, Z. Wen, and M. Rabinovich. Measuring a Commercial Content Delivery Network. In WWW, 2011.

Digital Library

[44]

Y. Zhang, R. Oliveira, H. Zhang, and L. Zhang. Quantifying the pitfalls of traceroute in AS connectivity inference. In PAM, 2010.

Digital Library

[45]

Y. Zhu, B. Helsley, J. Rexford, A. Siganporia, and S. Srinivasan. LatLong: Diagnosing Wide-Area Latency Changes for CDNs. IEEE Tran. on Netw. and Serv. Manag., 43, 2012.

Cited By

Gigis PHandley MVissicchio SSekar VYu MSeneviratne AVeitch D(2024)Bad Packets Come Back, Worse Ones Don'tProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672259(311-326)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672259
Zeynali DWeyulu EFathalli SChandrasekaran BFeldmann A(2024)Promises and Potential of BBRv3Passive and Active Measurement10.1007/978-3-031-56252-5_12(249-272)Online publication date: 20-Mar-2024
https://doi.org/10.1007/978-3-031-56252-5_12
Ozcan SLivadariu ISmaragdakis GGriwodz C(2023)Longitudinal Analysis of Inter-City Network Delays2023 7th Network Traffic Measurement and Analysis Conference (TMA)10.23919/TMA58422.2023.10198987(1-9)Online publication date: 26-Jun-2023
https://doi.org/10.23919/TMA58422.2023.10198987
Show More Cited By

Index Terms

A server-to-server view of the internet
1. Networks
  1. Network performance evaluation
    1. Network experimentation
  2. Network properties
    1. Network dynamics
    2. Network structure
      1. Physical topologies

Recommendations

One Server Per City: Using TCP for Very Large SIP Servers
Principles, Systems and Applications of IP Telecommunications. Services and Security for Next Generation Networks

The transport protocol for SIP can be chosen based on the requirements of services and network conditions. How does the choice of TCP affect the scalability and performance compared to UDP? We experimentally analyze the impact of using TCP as a ...
Server Side "Compresslets" for Internet Multimedia Streams
ICMCS '99: Proceedings of the 1999 IEEE International Conference on Multimedia Computing and Systems - Volume 02

We introduce a new concept of a server-based architecture for continuos media streams, e.g. audio and video. This server architecture provides highly flexible, scalable media streaming for Internet applications. One of it's key features is the client ...
Apache HTTP Server introduction

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '15: Proceedings of the 11th ACM Conference on Emerging Networking Experiments and Technologies

December 2015

483 pages

ISBN:9781450334129

DOI:10.1145/2716281

General Chairs:
Felipe Huici
NEC Europe Ltd
,
Giuseppe Bianchi
University of Rome Tor Vergata

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CoNEXT '15

Sponsor:

SIGCOMM

CoNEXT '15: Conference on emerging Networking Experiments and Technologies

December 1 - 4, 2015

Heidelberg, Germany

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
156
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)3

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gigis PHandley MVissicchio SSekar VYu MSeneviratne AVeitch D(2024)Bad Packets Come Back, Worse Ones Don'tProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672259(311-326)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672259
Zeynali DWeyulu EFathalli SChandrasekaran BFeldmann A(2024)Promises and Potential of BBRv3Passive and Active Measurement10.1007/978-3-031-56252-5_12(249-272)Online publication date: 20-Mar-2024
https://doi.org/10.1007/978-3-031-56252-5_12
Ozcan SLivadariu ISmaragdakis GGriwodz C(2023)Longitudinal Analysis of Inter-City Network Delays2023 7th Network Traffic Measurement and Analysis Conference (TMA)10.23919/TMA58422.2023.10198987(1-9)Online publication date: 26-Jun-2023
https://doi.org/10.23919/TMA58422.2023.10198987
Spang BArslan SMcKeown N(2021)Updating the theory of buffer sizingPerformance Evaluation10.1016/j.peva.2021.102232151:COnline publication date: 1-Nov-2021
https://dl.acm.org/doi/10.1016/j.peva.2021.102232
Stocker VSmaragdakis GLehr W(2020)The state of network neutrality regulationACM SIGCOMM Computer Communication Review10.1145/3390251.339025850:1(45-59)Online publication date: 23-Mar-2020
https://dl.acm.org/doi/10.1145/3390251.3390258
Motamedi RYeganeh BChandrasekaran BRejaie RMaggs BWillinger W(2019)On Mapping the Interconnections in Today’s InternetIEEE/ACM Transactions on Networking10.1109/TNET.2019.294036927:5(2056-2070)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1109/TNET.2019.2940369
Bogdanov KReda WMaguire GKostić DCanini M(2018)Fast and Accurate Load Balancing for Geo-Distributed Storage SystemsProceedings of the ACM Symposium on Cloud Computing10.1145/3267809.3267820(386-400)Online publication date: 11-Oct-2018
https://dl.acm.org/doi/10.1145/3267809.3267820
Dhamdhere AClark DGamero-Garrido ALuckie MMok RAkiwate GGogia KBajpai VSnoeren AClaffy KGorinsky STapolcai J(2018)Inferring persistent interdomain congestionProceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication10.1145/3230543.3230549(1-15)Online publication date: 7-Aug-2018
https://dl.acm.org/doi/10.1145/3230543.3230549
Shao WRougier JParis ADevienne FViste M(2017)One-to-One Matching of RTT and Path Changes2017 29th International Teletraffic Congress (ITC 29)10.23919/ITC.2017.8064356(196-204)Online publication date: Sep-2017
https://doi.org/10.23919/ITC.2017.8064356
Fontugne RPelsser CAben EBush RUhlig SMaennel O(2017)Pinpointing delay and forwarding anomalies using large-scale traceroute measurementsProceedings of the 2017 Internet Measurement Conference10.1145/3131365.3131384(15-28)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1145/3131365.3131384
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents