Article

A network-failure-tolerant message-passing system for terascale clusters

Authors:

Richard L. Graham,

David J. Daniel,

Nehal N. Desai,

Ronald G. Minnich,

Craig E. Rasmussen,

L. Dean Risinger,

Mitchel W. SukalskiAuthors Info & Claims

ICS '02: Proceedings of the 16th international conference on Supercomputing

Pages 77 - 83

https://doi.org/10.1145/514191.514205

Published: 22 June 2002 Publication History

Abstract

The Los Alamos Message Passing Interface (LA-MPI) is an end-to-end network-failure-tolerant message-passing system designed for terascale clusters. LA-MPI is a standard-compliant implementation of MPI designed to tolerate network-related failures including I/O bus errors, network card errors, and wire-transmission errors. This paper details the distinguishing features of LA-MPI, including support for concurrent use of multiple types of network interface, and reliable message transmission utilizing multiple network paths and routes between a given source and destination. In addition, performance measurements on production-grade platforms are presented.

References

[1]

LAM/MPI parallel computing, http://www.lam-mpi.org.]]

[2]

Edinburgh Parallel~Computing Centre, CRI/EPCC T3D/E MPI.]]

[3]

IBM Corporation, IBM Parallel Environment for AIX (PE).]]

[4]

A. Denis, Variable reliability protocol in Globus-Nexus, Tech. report, Information Science Institute (ISI), University of Southern California, 1999.]]

[5]

Jack J. Dongarra and David Walker, MPI: a standard message passing interface, Supercomputer 12 (1996), no. 1, 56--68.]]

[6]

W. Gropp and E. Lusk, Installation guide for mpich, a portable implementation of MPI, Mathematics and Computer Science Division, Argonne National Laboratory, 1996, ANL-96/5.]]

[7]

Erik A. Hendriks, BProc: The Beowulf distributed process space, 16th Annual ACM International Conference on Supercomputing, 2002.]]

Digital Library

[8]

E. C. Hunke and W. H. Lipscomb, CICE: the Los Alamos sea ice model, Tech. Report LA-CC-98-16, Los Alamos National Laboratory, 1999.]]

[9]

Silicon Graphics Inc., SGI message-passing toolkit.]]

[10]

Sun Microsystems, Sun HPC ClusterTools.]]

[11]

Ron Minnich and Karen Reid, Supermon: High performance monitoring for linux clusters, The Fifth Annual Linux Showcase and Conference, November 2001.]]

Digital Library

[12]

J. Postel, Transmission Control Protocol, Internet Engineering Task Force, RFC 793, 1981.]]

[13]

Mitsuhisa Sato, PM: An operating system coordinated high performance communication library, High-Performance Computing and Networking, 1997.]]

Digital Library

[14]

W. R. Stevens, TCP/IP illustrated, volume 2; the implementation, Addison Wesley, Reading, 1995.]]

Digital Library

[15]

Scali: Scalable Linux Systems, Scali MPI, http://www.scali.com.]]

Cited By

Penoff B(2013)High-Performance Computing Using Commodity Hardware and SoftwareMultihomed Communication with SCTP (Stream Control Transmission Protocol)10.1201/b13087-7(147-164)Online publication date: 28-Mar-2013
https://doi.org/10.1201/b13087-7
Kavila SPrasada Raju GSatapathy SMachiraju AKinnera GRasly K(2013)A Survey on Fault Management Techniques in Distributed ComputingProceedings of the International Conference on Frontiers of Intelligent Computing: Theory and Applications (FICTA)10.1007/978-3-642-35314-7_67(593-602)Online publication date: 2013
https://doi.org/10.1007/978-3-642-35314-7_67
Haider SAnsari N(2012)Temperature based fault forecasting in computer clusters2012 15th International Multitopic Conference (INMIC)10.1109/INMIC.2012.6511446(69-77)Online publication date: Dec-2012
https://doi.org/10.1109/INMIC.2012.6511446
Show More Cited By

Index Terms

A network-failure-tolerant message-passing system for terascale clusters

Recommendations

A network-failure-tolerant message-passing system for terascale clusters

The Los Alamos Message Passing Interface (LA-MPI) is an end-to-end network-failure-tolerant message-passing system designed for terascale clusters. LAMPI is a standard-compliant implementation of MPI designed to tolerate network-related failures ...
Shared Memory vs. Message Passing: The COMOPS Benchmark Experiment

This paper presents the comparison of the COMOPS benchmark performance in MPI and shared memory on four different shared memory platforms: the DEC AlphaServer 8400/300, the SGI Power Challenge, the SGI Origin2000, and the HP-Convex Exemplar SPP1600. The ...
Optimization of Message Passing Services on POWER8 InfiniBand Clusters
EuroMPI '16: Proceedings of the 23rd European MPI Users' Group Meeting

We present scalability and performance enhancements to MPI libraries on POWER8 InfiniBand clusters. We explore optimizations in the Parallel Active Messaging Interface (PAMI) libraries. We bypass IB VERBS via low level inline calls resulting in low ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICS '02: Proceedings of the 16th international conference on Supercomputing

June 2002

338 pages

ISBN:1581134835

DOI:10.1145/514191

General Chair:
Kemal Ebcioglu
IBM T.J. Watson Research Center
,
Program Chairs:
Keshav Pingali
Cornell University
,
Alex Nicolau
University of California

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 June 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICS02

Sponsor:

SIGARCH

ICS02: International Conference on Supercomputing

June 22 - 26, 2002

New York, New York, USA

Acceptance Rates

ICS '02 Paper Acceptance Rate 31 of 144 submissions, 22%;

Overall Acceptance Rate 629 of 2,180 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
410
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Penoff B(2013)High-Performance Computing Using Commodity Hardware and SoftwareMultihomed Communication with SCTP (Stream Control Transmission Protocol)10.1201/b13087-7(147-164)Online publication date: 28-Mar-2013
https://doi.org/10.1201/b13087-7
Kavila SPrasada Raju GSatapathy SMachiraju AKinnera GRasly K(2013)A Survey on Fault Management Techniques in Distributed ComputingProceedings of the International Conference on Frontiers of Intelligent Computing: Theory and Applications (FICTA)10.1007/978-3-642-35314-7_67(593-602)Online publication date: 2013
https://doi.org/10.1007/978-3-642-35314-7_67
Haider SAnsari N(2012)Temperature based fault forecasting in computer clusters2012 15th International Multitopic Conference (INMIC)10.1109/INMIC.2012.6511446(69-77)Online publication date: Dec-2012
https://doi.org/10.1109/INMIC.2012.6511446
Rabinovitz IShamis PGraham RBloch NShainer G(2010)Network offloaded hierarchical collectives using ConnectX-2's CORE-Direct capabilitiesProceedings of the 17th European MPI users' group meeting conference on Recent advances in the message passing interface10.5555/1894122.1894136(102-112)Online publication date: 12-Sep-2010
https://dl.acm.org/doi/10.5555/1894122.1894136
Rabinovitz IShamis PGraham RBloch NShainer G(2010)Network Offloaded Hierarchical Collectives Using ConnectX-2’s CORE-Direct CapabilitiesRecent Advances in the Message Passing Interface10.1007/978-3-642-15646-5_11(102-112)Online publication date: 2010
https://doi.org/10.1007/978-3-642-15646-5_11
Ansel JArya KCooperman G(2009)DMTCPProceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing10.1109/IPDPS.2009.5161063(1-12)Online publication date: 23-May-2009
https://dl.acm.org/doi/10.1109/IPDPS.2009.5161063
Shipman GGraham RBosilca G(2007)Network Fault Tolerance in Open MPIEuro-Par 2007 Parallel Processing10.1007/978-3-540-74466-5_93(868-878)Online publication date: 2007
https://doi.org/10.1007/978-3-540-74466-5_93
Sur SJin HChai LPanda DTorrellas JChatterjee S(2006)RDMA read based rendezvous protocol for MPI over InfiniBandProceedings of the eleventh ACM SIGPLAN symposium on Principles and practice of parallel programming10.1145/1122971.1122978(32-39)Online publication date: 29-Mar-2006
https://dl.acm.org/doi/10.1145/1122971.1122978
Beecroft JAddison DHewson DMcLaren MRoweth DPetrini FNieplocha J(2005)QsNetIIIEEE Micro10.1109/MM.2005.7525:4(34-47)Online publication date: 1-Jul-2005
https://dl.acm.org/doi/10.1109/MM.2005.75
Liang YSivasubramaniam AMoreira J(2005)Filtering Failure Logs for a BlueGene/L PrototypeProceedings of the 2005 International Conference on Dependable Systems and Networks10.1109/DSN.2005.50(476-485)Online publication date: 28-Jun-2005
https://dl.acm.org/doi/10.1109/DSN.2005.50
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents