research-article

Open access

A Hop Away from Everywhere: A View of the Intercontinental Long-haul Infrastructure

Authors:

Esteban Carisimo,

Fabián E. Bustamante,

Paul BarfordAuthors Info & Claims

Proceedings of the ACM on Measurement and Analysis of Computing Systems, Volume 7, Issue 3

Article No.: 47, Pages 1 - 26

https://doi.org/10.1145/3626778

Published: 12 December 2023 Publication History

Abstract

We present a longitudinal study of intercontinental long-haul links (LHLs) - links with latencies significantly higher than that of all other links in a traceroute path. Our study is motivated by the recognition of these LHLs as a network-layer manifestation of critical transoceanic undersea cables. We present a methodology and associated processing system for identifying long-haul links in traceroute measurements. We apply this system to a large corpus of traceroute data and report on multiple aspects of long haul connectivity including country-level prevalence, routers as international gateways, preferred long-haul destinations, and the evolution of these characteristics over a 7 year period. We identify 85,620 layer-3 links (out of 2.7M links in a large traceroute dataset) that satisfy our definition for intercontinental long haul with many of them terminating in a relatively small number of nodes. An analysis of connected components shows a clearly dominant component with a relative size that remains stable despite a significant growth of the long-haul infrastructure.

References

[1]

Bernhard Ager, Nikolas Chatzis adn Anja Feldmann, Nadi Sarrar, Steve Uhlig, and Walter Willinger. 2012. Anatomy of a large European IXP. In Proc. of ACM SIGCOMM.

Digital Library

[2]

Réka Albert and Albert-László Barabási. 2002. Statistical mechanics of complex networks. Reviews of modern physics, Vol. 74, 1 (2002), 47.

[3]

José Ignacio Alvarez-Hamelin, Luca Dall'Asta, Alain Barrat, and Alessandro Vespignani. 2008. K-core decomposition of Internet graphs: hierarchies, self-similarity and measurement biases. Networks and Heterogeneous Media, Vol. 3, 2 (2008), 371--393.

[4]

Scott Anderson, Loqman Slamanatian, Zachary S. Bischof, Alberto Dainotti, and Paul Barford. 2022. iGDB: Connecting the Physical and Logical Layers of the Internet. In Proc. of IMC.

Digital Library

[5]

ARUNO. 2022. ADTK Detectors. (2022).

[6]

Robert Beverly, Arthur Berger, and Geoffrey Xie. 2010. Primitives for active Internet topology mapping: Toward high-frequency characterization. In Proc. of IMC.

Digital Library

[7]

Zachary S. Bischof, Romain Fontugne, and Fabián E. Bustamante. 2018. Untangling the world-wide mesh of undersea cables. In Proc. of HotNets.

[8]

Ilker Nadi Bozkurt, Waqar Aqeel, Debopam Bhattacherjee, Balakrishnan Chandrasekaran, Philip Brighten Godfrey, Gregory Laughlin, Bruce M Maggs, and Ankit Singla. 2018. Dissecting Latency in the Internet's Fiber Infrastructure. arXiv preprint arXiv:1811.10737 (2018).

[9]

CAIDA. 2019. Macroscopic Internet Topology Data Kit (ITDK). http://www.caida.org/data/internet-topology-data-kit/. (2019).

[10]

CAIDA. 2023 a. Archipelago Measurement Infrastructure Updates. https://catalog.caida.org/details/media/2011_archipelago. (2023). Accessed: 2021--9--30.

[11]

CAIDA. 2023 b. AS Relationships (serial-1). https://catalog.caida.org/details/dataset/as_relationships_serial_1. (2023). Accessed: 2022--1--15.

[12]

CAIDA. 2023 c. CAIDA Ark IPv4 prefix-probing data. https://catalog.caida.org/details/dataset/ark_ipv4_prefix_probing. (2023). Accessed: 2021--12--22.

[13]

CAIDA. 2023 d. Internet eXchange Points Dataset. https://catalog.caida.org/details/dataset/ixps/. (2023). Accessed: 2022--1--17.

[14]

Esteban Carisimo, Julián M Del Fiore, Diego Dujovne, Cristel Pelsser, and J Ignacio Alvarez-Hamelin. 2020. A first look at the Latin American IXPs. ACM SIGCOMM Computer Communication Review, Vol. 50, 1 (2020), 18--24.

Digital Library

[15]

Esteban Carisimo, Alexander Gamero-Garrido, Alex C Snoeren, and Alberto Dainotti. 2021. Identifying ASes of state-owned internet operators. In Proc. of IMC.

Digital Library

[16]

Esteban Carisimo, Carlos Selmo, J Ignacio Alvarez-Hamelin, and Amogh Dhamdhere. 2019. Studying the evolution of content providers in IPv4 and IPv6 internet cores. The International Journal for the Computer and Telecommunications Industry, Vol. 145 (2019), 54--65.

Digital Library

[17]

Yi-Ching Chiu, Brandon Schlinker, Abhishek Balaji Radhakrishnan, Ethan Katz-Bassett, and Ramesh Govindan. 2015. Are we one hop away from a better internet?. In Proc. of IMC.

Digital Library

[18]

Aaron Clauset, Cosma Rohilla Shalizi, and Mark EJ Newman. 2009. Power-law distributions in empirical data. arXiV (2009).

[19]

Reuven Cohen, Keren Erez, Daniel ben Avraham, and Shlomo Havlin. 2000. Resilience of the Internet to Random Breakdowns. Phys. Rev. Lett., Vol. 85 (Nov 2000), 4626--4628. Issue 21. https://doi.org/10.1103/PhysRevLett.85.4626

[20]

Amogh Dhamdhere, David D Clark, Alexander Gamero-Garrido, Matthew Luckie, Ricky KP Mok, Gautam Akiwate, Kabir Gogia, Vaibhav Bajpai, Alex C Snoeren, and Kc Claffy. 2018. Inferring persistent interdomain congestion. In Proc. of ACM SIGCOMM.

Digital Library

[21]

Amogh Dhamdhere and Constantine Dovrolis. 2010. The Internet is flat: modeling the transition from a transit hierarchy to a peering mesh. In Proc. of CoNEXT.

Digital Library

[22]

Benoit Donnet, Matthew Luckie, Pascal Mérindol, and Jean-Jacques Pansiot. 2012. Revealing MPLS Tunnels Obscured from Traceroute. ACM SIGCOMM Computer Communication Review, Vol. 42, 2 (mar 2012), 87--93.

Digital Library

[23]

Ramakrishnan Durairajan, Paul Barford, Joel Sommers, and Walter Willinger. 2015. InterTubes: A Study of the US Long-haul Fiber-optic Infrastructure. In Proc. of ACM SIGCOMM.

Digital Library

[24]

Anne Edmundson, Roya Ensafi, Nick Feamster, and Jennifer Rexford. 2018. Nation-state hegemony in internet routing. In Proc. of the ACM SIGCAS Conference on Computing and Sustainable Societies.

Digital Library

[25]

European Comission. 2022. General Data Protection Regulation. https://www.gdpreu.org. (2022).

[26]

European Investment Bank. 2009. EU-Africa Infrastructure Trust Fund: Annual report 2009. https://www.eib.org/attachments/country/eu_africa_infrastructure_trust_fund_annual_report_2009_en.pdf. (2009).

[27]

Michalis Faloutsos, Petros Faloutsos, and Christos Faloutsos. 1999. On Power-Law Relationships of the Internet Topology. (1999).

[28]

Rodérick Fanou, Pierre Francois, and Emile Aben. 2015. On the diversity of interdomain routing in africa. In Proc. of PAM.

[29]

Rodérick Fanou, Bradley Huffaker, Ricky Mok, and Kimberly C Claffy. 2020. Unintended consequences: Effects of submarine cable deployment on Internet routing. In Proc. of PAM. Springer, 211--227.

[30]

Lixin Gao and Jennifer Rexford. 2001. Stable Internet routing without global coordination. IEEE/ACM Transactions on networking, Vol. 9, 6 (2001), 681--692.

[31]

Petros Gigis, Matt Calder, Lefteris Manassakis, George Nomikos, Vasileios Kotronis, Xenofontas Dimitropoulos, Ethan Katz-Bassett, and Georgios Smaragdakis. 2021. Seven years in the life of Hypergiants' off-nets. In Proc. of ACM SIGCOMM.

Digital Library

[32]

Vasileios Giotsas, Matthew Luckie, Bradley Huffaker, and KC Claffy. 2014. Inferring complex AS relationships. In Proc. of IMC.

Digital Library

[33]

Arpit Gupta, Matt Calder, Nick Feamster, Marshini Chetty, Enrico Calandro, and Ethan Katz-Bassett. 2014. Peering at the internet's frontier: A first look at isp interconnectivity in africa. In Proc. of PAM.

Digital Library

[34]

Melissa E Hathaway. 2014. Connected choices: how the Internet is challenging sovereign decisions. American Foreign Policy Interests, Vol. 36, 5 (2014), 300--313.

[35]

Rebecca Hersher. 2018. Rising Seas Could Cause Problems For Internet Infrastructure. https://www.npr.org/2018/07/16/627254166/rising-seas-could-cause-problems-for-internet-infrastructure. (2018).

[36]

Chi-Yao Hong, Srikanth Kandula, Ratul Mahajan, Ming Zhang, Vijay Gill, Mohan Nanduri, and Roger Wattenhofer. 2013. Achieving high utilization with software-driven WAN. In Proc. of ACM SIGCOMM.

Digital Library

[37]

Bradley Huffaker, Marina Fomenkov, and K Claffy. 2011. Geocompare: a comparison of public and commercial geolocation databases. In Proc. of NMMC.

[38]

The International Cable Protection Committee (ICPC). 2021. Statement at the 21st Meeting of Informal Consultative Process on Seal-level Rise and its Impacts. https://www.un.org/depts/los/consultative_process/icp21/ICP21_item%203_ICPC_English.pdf. (2021).

[39]

IODA. 2021. IODA Signals for Valle del Cauca between April 1 2021 and April 29 2021. https://bit.ly/3sGUtU0. (2021).

[40]

Quentin Jacquemart, Clément Pigout, and Guillaume Urvoy-Keller. 2019. Inferring the Deployment of Top Domains over Public Clouds using DNS Data. In Proc. of TMA.

[41]

Sushant Jain, Alok Kumar, Subhasree Mandal, Joon Ong, Leon Poutievski, Arjun Singh, Subbaiah Venkata, Jim Wanderer, Junlan Zhou, Min Zhu, et al. 2013. B4: Experience with a globally-deployed software defined WAN. In Proc. of ACM SIGCOMM.

Digital Library

[42]

Ethan Katz-Bassett, John P John, Arvind Krishnamurthy, David Wetherall, Thomas Anderson, and Yatin Chawathe. 2006. Towards IP geolocation using delay and topology measurements. In Proc. of IMC.

Digital Library

[43]

Ken Keys, Young Hyun, Matthew Luckie, and Kim Claffy. 2012. Internet-scale IPv4 alias resolution with MIDAR. IEEE/ACM TONS, Vol. 21, 2 (2012), 383--399.

Digital Library

[44]

Rowan Klöti, Bernhard Ager, Vasileios Kotronis, George Nomikos, and Xenofontas Dimitropoulos. 2016. A comparative look into public IXP datasets. ACM SIGCOMM Computer Communication Review, Vol. 46, 1 (2016), 21--29.

Digital Library

[45]

Rupa Krishnan, Harsha V Madhyastha, Sridhar Srinivasan, Sushant Jain, Arvind Krishnamurthy, Thomas Anderson, and Jie Gao. 2009. Moving beyond end-to-end path information to optimize CDN performance. In Proc. of ACM SIGCOMM.

Digital Library

[46]

Craig Labovitz, Scott Iekel-Johnson, Danny McPherson, Jon Oberheide, and Farnam Jahanian. 2010. Internet inter-domain traffic. In Proc. of ACM SIGCOMM.

Digital Library

[47]

Dave Levin, Youndo Lee, Luke Valenta, Zhihao Li, Victoria Lai, Cristian Lumezanu, Neil Spring, and Bobby Bhattacharjee. 2015. Alibi Routing. In Proc. of ACM SIGCOMM.

[48]

Shucheng Liu, Zachary S Bischof, Ishaan Madan, Peter K Chan, and Fabián E Bustamante. 2020. Out of Sight, Not Out of Mind: A User-View on the Criticality of the Submarine Cable Network. In Proc. of IMC.

Digital Library

[49]

Ioana Livadariu, Thomas Dreibholz, Anas Saeed Al-Selwi, Haakon Bryhni, Olav Lysne, Steinar Bjørnstad, and Ahmed Elmokashfi. 2020. On the Accuracy of Country-Level IP Geolocation. In Proceedings of the Applied Networking Research Workshop.

Digital Library

[50]

Aemen Lodhi, Natalie Larson, Amogh Dhamdhere, Constantine Dovrolis, and Kc Claffy. 2014. Using peeringDB to understand the peering ecosystem. ACM SIGCOMM Computer Communication Review, Vol. 44, 2 (2014), 20--27.

Digital Library

[51]

Matthew Luckie, Bradley Huffaker, Amogh Dhamdhere, Vasileios Giotsas, and KC Claffy. 2013. AS relationships, customer cones, and validation. In Proc. of IMC.

Digital Library

[52]

M. Luckie, B. Huffaker, A. Marder, Z. Bischof, M. Fletcher, and k. claffy. 2021. Learning to Extract Geographic Information from Internet Router Hostnames. In Proc. of CoNEXT.

Digital Library

[53]

M. Luckie, A. Marder, B. Huffaker, and k. claffy. 2021--12. Learning Regexes to Extract Network Names from Hostnames. In Asian Internet Engineering Conference (AINTEC).

Digital Library

[54]

Alexander Marder, Matthew Luckie, Amogh Dhamdhere, Bradley Huffaker, kc Claffy, and Jonathan M Smith. 2018. Pushing the boundaries with bdrmapit: Mapping router ownership at Internet scale. In Proc. of IMC.

Digital Library

[55]

Maxmind. 2023. Maxmind Geolocation Data. https://www.maxmind.com/en/geoip2-services-and-databases. (2023).

[56]

Thierry Mayer and Soledad Zignago. 2011. Notes on CEPII's distances measures: The GeoDist database. (2011).

[57]

The United Nations. 2016. Summary of the First Global Integrated Marine Assessment. https://www.un.org/depts/los/global_reporting/WOA_RPROC/Summary.pdf. (2016).

[58]

Jonathan A Obar and Andew Clement. 2012. Internet surveillance and boomerang routing: A call for Canadian network sovereignty. In TEM 2013: Proceedings of the Technology & Emerging Media Track-Annual Conference of the Canadian Communication Association (Victoria.

[59]

Abhinav Pathak, Mingn Zhang, Y Charlie Hu, Ratul Mahajan, and Dave Maltz. 2011. Latency inflation with MPLS-based traffic engineering. In Proc. of IMC.

Digital Library

[60]

Ingmar Poese, Steve Uhlig, Mohamed Ali Kaafar, Benoit Donnet, and Bamba Gueye. 2011. IP geolocation databases: Unreliable? ACM SIGCOMM Computer Communication Review, Vol. 41, 2 (2011), 53--56.

Digital Library

[61]

RCN Radio. 2021. Falla en cable del Pacífico afecta a miles de usuarios de Internet en todo el país. https://www.rcnradio.com/colombia/falla-en-cable-del-pacifico-afecta-miles-de-usuarios-de-internet-en-todo-el-pais. (2021).

[62]

Justine Sherry, Peter Xiang Gao, Soumya Basu, Aurojit Panda, Arvind Krishnamurthy, Christian Maciocco, Maziar Manesh, Jo ao Martins, Sylvia Ratnasamy, Luigi Rizzo, and Scott Shenker. 2015. Rollback-Recovery for Middleboxes. In Proc. of ACM SIGCOMM.

Digital Library

[63]

Joel Sommers, Paul Barford, and Brian Eriksson. 2011. On the prevalence and characteristics of MPLS deployments in the open Internet. In Proc. of IMC.

Digital Library

[64]

Richard A. Steenbergen. 2009. A practical guide to (correctly) troubleshooting with traceroute. NANOG.

[65]

the Federative Republic of Brazil. 2022. Brazilian General Data Protection Law. https://www.lgpdbrasil.com.br. (2022).

[66]

T-Mobile USA. 2020. T-Mobile Completes Merger with Sprint to Create the New T-Mobile. https://www.t-mobile.com/news/un-carrier/t-mobile-sprint-one-company. (2020).

[67]

Yves Vanaubel, Pascal Mérindol, Jean-Jacques Pansiot, and Benoit Donnet. 2017. Through the wormhole: Tracking invisible MPLS tunnels. In Proc. of IMC.

Digital Library

[68]

Colin Wall and Pierre Morcos. 2021. Invisible and Vital: Undersea cables and transatlantic security. Center for Strategic and International Studies June (2021).

[69]

Walter Willinger, David Alderson, and John C. Doyle. 2009. Mathematics and the internet: A source of enormous confusion and great potential. Notices of the American Mathematical Society, Vol. 56, 5 (2009), 586--599.

Cited By

Salamatian LVermeulen KCunha IGiotsas VKatz-Bassett EVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)metAScritic: Reframing AS-Level Topology Discovery as a Recommendation SystemProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688429(337-364)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3688429

Index Terms

A Hop Away from Everywhere: A View of the Intercontinental Long-haul Infrastructure
1. Networks
  1. Network properties
    1. Network structure
      1. Topology analysis and generation

Recommendations

A Hop Away from Everywhere: A View of the Intercontinental Long-haul Infrastructure
SIGMETRICS '24

We present a longitudinal study of intercontinental long-haul links (LHL) - links with latencies significantly higher than that of all other links in a traceroute path. Our study is motivated by the recognition of these LHLs as a network-layer ...
A Hop Away from Everywhere: A View of the Intercontinental Long-haul Infrastructure
SIGMETRICS/PERFORMANCE '24: Abstracts of the 2024 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems

We present a longitudinal study of intercontinental long-haul links (LHL) - links with latencies significantly higher than that of all other links in a traceroute path. Our study is motivated by the recognition of these LHLs as a network-layer ...
WDM-PONs Hold Promise for the Long Haul

As they face challenging times, networking-service providers are looking to save money by studying the use of relatively new wavelength-division-multiplexing-based passive optical networks to create more efficient systems that increase data rates.

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Measurement and Analysis of Computing Systems

Proceedings of the ACM on Measurement and Analysis of Computing Systems Volume 7, Issue 3

POMACS

December 2023

599 pages

EISSN:2476-1249

DOI:10.1145/3637453

Editors:
Augustin Chaintreau
Columbia University
,
Leana Golubchik
University of Southern California, United States
,
Zhi-Li Zhang
University of Minnesota, United States

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 December 2023

Published in POMACS Volume 7, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
466
Total Downloads

Downloads (Last 12 months)456
Downloads (Last 6 weeks)55

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Salamatian LVermeulen KCunha IGiotsas VKatz-Bassett EVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)metAScritic: Reframing AS-Level Topology Discovery as a Recommendation SystemProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688429(337-364)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3688429

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents