research-article

Runtime MPI collective checking with tree-based overlay networks

Authors:

Tobias Hilbrich,

Bronis R. de Supinski,

Fabian Hänsel,

Matthias S. Müller,

Wolfgang E. NagelAuthors Info & Claims

EuroMPI '13: Proceedings of the 20th European MPI Users' Group Meeting

Pages 129 - 134

https://doi.org/10.1145/2488551.2488570

Published: 15 September 2013 Publication History

Abstract

Runtime error detection tools detect many classes of MPI usage errors, including errors in collective communication calls. However, they often face scalability challenges. We present runtime checks for MPI collective operations that use a Tree-Based Overlay Network (TBON) for scalability and that provide full datatype matching. While we can use transitive correctness properties for most checks, some collective operations impose non-transitive correctness properties, e.g., MPI_Alltoallv, where we use an intralayer communication within the TBON to distribute datatype matching information. An overhead study with stress tests and two benchmark suites demonstrates applicability and scalability at 4,096, 2,048 and 16,384 processes respectively.

References

[1]

D. H. Bailey, L. Dagum, E. Barszcz, and H. D. Simon. NAS Parallel Benchmark Results. Technical report, IEEE Parallel and Distributed Technology, 1992.

[2]

D. Buntinas, G. Bosilca, R. L. Graham, G. Vallée, and G. R. Watson. A Scalable Tools Communications Infrastructure. In Proceedings of the 2008 22nd International Symposium on High Performance Computing Systems and Applications, HPCS '08, pages 33--39, Washington, DC, USA, 2008. IEEE Computer Society.

Digital Library

[3]

C. Falzone, A. Chan, and E. Lusk. Collective error detection for MPI collective operations. In Recent Advances in Parallel Virtual Machine and Message Passing Interface, 12th European PVM/MPI Users' Group Meeting, pages 138--147. Springer, 2005.

Digital Library

[4]

W. Gropp. Runtime Checking of Datatype Signatures in MPI. In Proceedings of the 7th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, pages 160--167, London, UK, 2000. Springer.

Digital Library

[5]

T. Hilbrich, M. S. Müller, B. R. de Supinski, M. Schulz, and W. E. Nagel. GTI: A Generic Tools Infrastructure for Event-Based Tools in Parallel Systems. In Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium, IPDPS '12, pages 1364--1375, Washington, DC, USA, 2012. IEEE Computer Society.

Digital Library

[6]

T. Hilbrich, M. S. Müller, M. Schulz, and B. R. de Supinski. Order Preserving Event Aggregation in TBONs. In Y. Cotronis, A. Danalis, D. Nikolopoulos, and J. Dongarra, editors, Recent Advances in the Message Passing Interface, volume 6960 of Lecture Notes in Computer Science, pages 19--28. Springer Berlin/Heidelberg, 2011.

Digital Library

[7]

T. Hilbrich, J. Protze, M. Schulz, B. R. de Supinski, and M. S. Müller. MPI Runtime Error Detection with MUST: Advances in Deadlock Detection. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC '12, pages 30:1--30:11, Los Alamitos, CA, USA, 2012. IEEE Computer Society.

Digital Library

[8]

G. R. Luecke, Y. Zou, J. Coyle, J. Hoekstra, and M. Kraeva. Deadlock Detection in MPI Programs. Concurrency and Computation: Practice and Experience, 14:911--932, 2002.

[9]

Message Passing Interface Forum. MPI: A Message-Passing Interface Standard, Version 2.2. http://www.mpi-forum.org/docs/mpi22-report.pdf, 2009.

[10]

M. S. Müller, M. van Waveren, R. Lieberman, B. Whitney, H. Saito, K. Kumaran, J. Baron, W. C. Brantley, C. Parrott, T. Elken, H. Feng, and C. Ponder. SPEC MPI2007 -- An Application Benchmark Suite for Parallel Systems using MPI. Concurrency and Computation: Practice and Experience, 22(2):191--205, 2010.

Digital Library

[11]

J. Protze, T. Hilbrich, A. Knüpfer, B. R. de Supinski, and M. S. Müller. Holistic Debugging of MPI Derived Datatypes. In Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium, IPDPS '12, pages 354--365. IEEE Computer Society, Washington, DC, USA, 2012.

Digital Library

[12]

P. C. Roth, D. C. Arnold, and B. P. Miller. MRNet: A Software-Based Multicast/Reduction Network for Scalable Tools. In Proceedings of the 2003 ACM/IEEE conference on Supercomputing, SC '03, New York, NY, USA, 2003. ACM.

Digital Library

[13]

J. L. Träff and J. Worringen. Verifying Collective MPI Calls. In Recent Advances In Parallel Virtual Machine And Message Passing. 11th European PVM/MPI Users' Group Meeting. LNCS 3241, pages 18--27. Springer, 2004.

[14]

S. S. Vakkalanka, S. Sharma, G. Gopalakrishnan, and R. M. Kirby. ISP: A Tool for Model Checking MPI Programs. In Proceedings of the 13th ACM SIGPLAN Symposium on Principles and practice of parallel programming, pages 285--286, New York, NY, USA, 2008. ACM.

Digital Library

[15]

J. S. Vetter and B. R. de Supinski. Dynamic Software Testing of MPI Applications with Umpire. In Proceedings of the 2000 ACM/IEEE conference on Supercomputing, Supercomputing '00, Washington, DC, USA, 2000. IEEE Computer Society.

Digital Library

Cited By

Tronge JPritchard HBrown J(2023)Improving MPI Safety for Modern LanguagesProceedings of the 30th European MPI Users' Group Meeting10.1145/3615318.3615328(1-11)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.1145/3615318.3615328
Sherpa SZhao X(2023)A Hybrid Approach for Detecting Bugs in HPC Workloads2023 IEEE 29th International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS60453.2023.00269(1968-1974)Online publication date: 17-Dec-2023
https://doi.org/10.1109/ICPADS60453.2023.00269
Huchant PSaillard EBarthou DCarribault P(2019)Multi-valued Expression Analysis for Collective CheckingEuro-Par 2019: Parallel Processing10.1007/978-3-030-29400-7_3(29-43)Online publication date: 26-Aug-2019
https://dl.acm.org/doi/10.1007/978-3-030-29400-7_3
Show More Cited By

Recommendations

MPI correctness checking for OpenMP/MPI applications

The MPI interface is the de-facto standard for message passing applications, but it is also complex and defines several usage patterns as erroneous. A current trend is the investigation of hybrid programming techniques that use MPI processes and ...
Model Checking of Workflow Schemas
EDOC '00: Proceedings of the 4th International conference on Enterprise Distributed Object Computing

Practical experience indicates that the definition of real-world workflow applications is a complex and error-prone process. Existing workflow management systems provide the means, in the best case, for very primitive syntactic verification, which is ...
JCWIT: A Correctness-Witness Validator for Java Programs Based on Bounded Model Checking
ISSTA 2024: Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis

Witness validation is a formal verification method to independently verify software verification tool results, with two main categories: violation and correctness witness validators. Validators for violation witnesses in Java include Wit4Java and GWIT, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

EuroMPI '13: Proceedings of the 20th European MPI Users' Group Meeting

September 2013

289 pages

ISBN:9781450319034

DOI:10.1145/2488551

General Chair:
Jack Dongarra
University of Tennessee
,
Program Chairs:
Javier Garcia Blas
University Carlos III, Spain
,
Jesus Carretero
University Carlos III, Spain

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ARCOS: Computer Architecture and Technology Area, Universidad Carlos III de Madrid

In-Cooperation

SIGHPC: ACM Special Interest Group on High Performance Computing, Special Interest Group on High Performance Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

EuroMPI '13

Sponsor:

ARCOS

EuroMPI '13: 20th European MPI Users's Group Meeting

September 15 - 18, 2013

Madrid, Spain

Acceptance Rates

EuroMPI '13 Paper Acceptance Rate 22 of 47 submissions, 47%;

Overall Acceptance Rate 66 of 139 submissions, 47%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
106
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tronge JPritchard HBrown J(2023)Improving MPI Safety for Modern LanguagesProceedings of the 30th European MPI Users' Group Meeting10.1145/3615318.3615328(1-11)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.1145/3615318.3615328
Sherpa SZhao X(2023)A Hybrid Approach for Detecting Bugs in HPC Workloads2023 IEEE 29th International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS60453.2023.00269(1968-1974)Online publication date: 17-Dec-2023
https://doi.org/10.1109/ICPADS60453.2023.00269
Huchant PSaillard EBarthou DCarribault P(2019)Multi-valued Expression Analysis for Collective CheckingEuro-Par 2019: Parallel Processing10.1007/978-3-030-29400-7_3(29-43)Online publication date: 26-Aug-2019
https://dl.acm.org/doi/10.1007/978-3-030-29400-7_3
Cogumbreiro THu RMartins FYoshida N(2018)Dynamic Deadlock Verification for General Barrier SynchronisationACM Transactions on Programming Languages and Systems10.1145/322906041:1(1-38)Online publication date: 11-Dec-2018
https://dl.acm.org/doi/10.1145/3229060
Huchant PSaillard EBarthou DBrunie HCarribault P(2018)PARCOACH Extension for a Full-Interprocedural Collectives Verification2018 IEEE/ACM 2nd International Workshop on Software Correctness for HPC Applications (Correctness)10.1109/Correctness.2018.00013(69-76)Online publication date: Nov-2018
https://doi.org/10.1109/Correctness.2018.00013
Hilbrich TWeber MProtze Jde Supinski BNagel WDongarra JHolmes DCollis ALarsson Träff JSmith L(2016)Runtime Correctness Analysis of MPI-3 Nonblocking CollectivesProceedings of the 23rd European MPI Users' Group Meeting10.1145/2966884.2966906(188-197)Online publication date: 25-Sep-2016
https://dl.acm.org/doi/10.1145/2966884.2966906
Saillard ECarribault PBarthou D(2015)Static/Dynamic validation of MPI collective communications in multi-threaded contextACM SIGPLAN Notices10.1145/2858788.268854850:8(279-280)Online publication date: 24-Jan-2015
https://dl.acm.org/doi/10.1145/2858788.2688548
Saillard ECarribault PBarthou DCohen AGrove D(2015)Static/Dynamic validation of MPI collective communications in multi-threaded contextProceedings of the 20th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming10.1145/2688500.2688548(279-280)Online publication date: 24-Jan-2015
https://dl.acm.org/doi/10.1145/2688500.2688548
Saillard ECarribault PBarthou D(2015)MPI Thread-Level Checking for MPI+OpenMP ApplicationsEuro-Par 2015: Parallel Processing10.1007/978-3-662-48096-0_3(31-42)Online publication date: 25-Jul-2015
https://doi.org/10.1007/978-3-662-48096-0_3
Knüpfer AHilbrich TProtze JSchuchart J(2015)Dynamic Analysis to Support Program Development with the Textually Aligned Property for OpenSHMEM CollectivesRevised Selected Papers of the Second Workshop on OpenSHMEM and Related Technologies. Experiences, Implementations, and Technologies - Volume 939710.1007/978-3-319-26428-8_7(105-118)Online publication date: 4-Aug-2015
https://dl.acm.org/doi/10.1007/978-3-319-26428-8_7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents