skip to main content
10.1145/1654059.1654094acmconferencesArticle/Chapter ViewAbstractPublication PagesscConference Proceedingsconference-collections
research-article

Improving GridFTP performance using the Phoebus session layer

Published: 14 November 2009 Publication History

Abstract

Phoebus is an infrastructure for improving end-to-end throughput in high-bandwidth, long-distance networks by using a "session layer" protocol and "gateways" in the network. Phoebus has the ability to dynamically allocate network resources and to use segmentspecific transport protocols between gateways, as well as to apply other performance-improving techniques on behalf of the user.
One of the key data movement applications in high-performance and Grid computing is GridFTP from the Globus project. GridFTP features a modular library interface called XIO that allows it to use alternative transport mechanisms. To facilitate use of the Phoebus system, we have implemented a Globus XIO driver for Phoebus.
This paper presents tests of the Phoebus-enabled GridFTP over a network testbed that allows us to modify latency and loss rates. We discuss use of various transport connections, both end-to-end and hop-by-hop, and evaluate the performance of a variety of cases. We demonstrate that Phoebus can easily improve performance in a diverse set of scenarios and of cases, in many instance it outperforms the state of the art.

References

[1]
Enabling high performance data transfers. http://www.psc.edu/networking/projects/tcptune/.
[2]
Net:netem. http://www.linux-foundation.org/en/Net:Netem.
[3]
TCP tuning guide. http://dsd.lbl.gov/TCP-tuning/linux.html.
[4]
Vfer: High performance data-transfer in user-space. http://vfer.sourceforge.net/cgi-bin/index.cgi?page=home.
[5]
W. Allcock, J. Bresnahan, R. Kettimuthu, and M. Link. The globus striped gridftp framework and server. In Proceedings of the ACM/IEEE SC 2005 Conference, page 54, 2005.
[6]
A. Brown, E. Kissel, M. Swany, and G. Almes. Phoebus: A session protocol for dynamic and heterogeneous networks. UDCIS Technical Report 2008:334, http://damsl.cis.udel.edu/projects/phoebus/phoebus_tech_report.pdf.
[7]
S. F. E. Kohler, M. Handley. Datagram congestion control protocol (DCCP). RFC 4340, March 2006.
[8]
B. Ford and J. Iyengar. Breaking up the transport logjam. In Proceedings of ACM HotNets, 2008.
[9]
I. Foster and C. Kesselman. Globus: A metacomputing infrastructure toolkit. International Journal of Supercomputer Applications, 11(2):115--128, 1997.
[10]
GridFTP. http://www.globus.org/datagrid/gridftp.html.
[11]
Y. Gu and R. Grossman. UDT: UDP-based data transfer for high-speed wide area networks. Computer Networks (Elsevier) Volume 51, Issue 7., 2007.
[12]
T. J. Hacker, B. D. Athey, and B. Noble. The end-to-end performance effects of parallel TCP sockets on a lossy wide-area network. In IPDPS '02: Proceedings of the 16th International Parallel and Distributed Processing Symposium, page 314, Washington, DC, USA, 2002. IEEE Computer Society.
[13]
E. He, J. Leigh, O. Yu, and T. A. DeFanti. Reliable blast UDP: predictable high performance bulk data transfer. In Proc. of theIEEE Cluster Computing 2002, pages 317--324, 2002.
[14]
K. Kaneko and J. Katto. TCP-fusion: A hybrid congestion control algorithm for high-speed networks. In International Workshop on Protocols for Fast Long-Distance Networks (PFLDNet), pages 31--36, 2007.
[15]
M. Mathis, J. Semke, J. Mahdavi, and T. Ott. The macroscopic behavior of the TCP congestion avoidance algorithm. Computer Communications Review, 27(3), July 1997.
[16]
A. P. Mudambi, X. Zheng, and M. Veeraraghavan. A transport protocol for dedicated end-to-end circuits. In Communications, 2006. ICC '06. IEEE International Conference on Communications, pages 18--23, 2006.
[17]
L. Ong and J. Yoakum. An introduction to the stream control transmission protocol (SCTP). RFC 3286, May 2002.
[18]
J. H. Saltzer, D. P. Reed, and D. D. Clark. End-to-end arguments in system design. ACM Transactions on Computer Systems, 2(4):277--288, 1984.
[19]
M. Swany. Improving Throughput for Grid Applications with Network Logistics. In Supercomputing 2004, November 2004.
[20]
K. Tan, J. Song, Q. Zhang, and M. Sridharan. Compound TCP: A scalable and TCP-friendly congestion control for high-speed networks. In International Workshop on Protocols for Fast Long-Distance Networks (PFLDNet), 2006.
[21]
F. Vacirca, A. Baiocchi, and A. Castellani. Yeah-TCP: yet another highspeed TCP. In International Workshop on Protocols for Fast Long-Distance Networks (PFLDNet), pages 37--42, 2007.
[22]
Web100. http://www.web100.org.
[23]
D. Wei, C. Jin, S. Low, and S. Hegde. FAST TCP: Motivation, architecture, algorithms, performance. In EEE/ACM Transactions on Networking (TON) Volume 14, Issue 6, pages 1246--1259, 2006.
[24]
Z. Zhang, G. Hasegawa, and M. Murata. Reasons not to parallelize TCP connections for long fat networks. In Proceedings of SPECTS 2006, 2006.
[25]
X. Zheng, A. P. Mudambi, and M. Veeraraghavan. FRTP: Fixed rate transport protocol -- a modified version of SABUL for end-to-end circuits. In Proceedings of the 1st International Workshop on Provisioning and Transport for Hybrid Networks (PATHNETS), 2004.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SC '09: Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
November 2009
778 pages
ISBN:9781605587448
DOI:10.1145/1654059
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2009

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Conference

SC '09
Sponsor:

Acceptance Rates

SC '09 Paper Acceptance Rate 59 of 261 submissions, 23%;
Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 04 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media