research-article

Enabling MPI interoperability through flexible communication endpoints

Authors:

Douglas Miller,

Rajeev ThakurAuthors Info & Claims

EuroMPI '13: Proceedings of the 20th European MPI Users' Group Meeting

Pages 13 - 18

https://doi.org/10.1145/2488551.2488553

Published: 15 September 2013 Publication History

Abstract

The current MPI model defines a one-to-one relationship between MPI processes and MPI ranks. This model captures many use cases effectively, such as one MPI process per core and one MPI process per node. However, this semantic has limited interoperability between MPI and other programming models that use threads within a node. In this paper, we describe an extension to MPI that introduces communication endpoints as a means to relax the one-to-one relationship between processes and threads. Endpoints enable a greater degree interoperability between MPI and other programming models, and we illustrate their potential for additional performance and computation management benefits through the decoupling of ranks from processes.

References

[1]

Berkeley UPC. Berkeley UPC user's guide version 2.16.0. Technical report, U. C. Berkeley and LBNL, 2013.

[2]

Milind Bhandarkar, L. V. Kale, Eric de Sturler, and Jay Hoeflinger. Object-Based Adaptive Load Balancing for MPI Programs. In Proc. Intl. Conf. on Computational Science, volume LNCS 2074, pages 108--117, May 2001.

Digital Library

[3]

James Dinan, Pavan Balaji, Ewing Lusk, P. Sadayappan, and Rajeev Thakur. Hybrid parallel programming with MPI and unified parallel C. In Proc. 7th ACM international conference on Computing frontiers, CF '10, 2010.

Digital Library

[4]

Ulrich Drepper. ELF handling for thread-local storage. Technical report, Red Hat, Inc., December 2005.

[5]

Andrew Friedley, Torsten Hoefler, Greg Bronevetsky, Andrew Lumsdaine, and Ching-Chen Ma. Ownership passing: Efficient distributed memory programming on multi-core systems. In Proc. 18th ACM SIGPLAN Symp. on Principles and Practice of Parallel Programming, 2013.

Digital Library

[6]

David Goodell, William Gropp, Xin Zhao, and Rajeev Thakur. Scalable memory use in MPI. In Proc. Recent Adv. in MPI - 18th European MPI Users' Group Meeting, EuroMPI 2011, September 2011.

[7]

Torsten Hoefler, James Dinan, Darius Buntinas, Pavan Balaji, Brian Barrett, Ron Brightwell, William Gropp, Vivek Kale, and Rajeev Thakur. Leveraging MPI's one-sided communication interface for shared-memory programming. In Proc. Recent Adv. in MPI - 19th European MPI Users' Group Meeting, EuroMPI '12, September 2012.

Digital Library

[8]

Torsten Hoefler, James Dinan, Darius Buntinas, Pavan Balaji, Brian Barrett, Ron Brightwell, William Gropp, Vivek Kale, and Rajeev Thakur. MPI+MPI: A new, hybrid approach to parallel programming with MPI plus shared memory. J. Computing (to appear), 2013.

[9]

Feng Ji, Ashwin M. Aji, James Dinan, Darius Buntinas, Pavan Balaji, Rajeev Thakur, Wu-Chun Feng, and Xiaosong Ma. MPI-ACC: An integrated and extensible approach to data movement in accelerator-based systems. In Proc. 14th IEEE Intl. Conf. on High Performance Computing and Communications, HPCC '12, June 2012.

Digital Library

[10]

Humaira Kamal and Alan Wagner. FG-MPI: Fine-grain MPI for multicore and clusters. In 11th IEEE Intl. Workshop on Parallel and Distributed Scientific and Engineering Computing (PDSEC), pages 1--8, 2010.

[11]

S. Kumar, A. R. Mamidala, D. A. Faraj, B. Smith, M. Blocksome, B. Cernohous, D. Miller, J. Parker, J. Ratterman, P. Heidelberger, Dong Chen, and B. Steinmacher-Burrow. PAMI: A parallel active message interface for the Blue Gene/Q supercomputer. In Proc. 26th Intl. IEEE Parallel & Distributed Processing Symposium (IPDPS), May 2012.

Digital Library

[12]

S. Li, T. Hoefler, and M. Snir. NUMA-Aware shared memory collective communication for MPI. In Proc. 22nd Intl. ACM Symp. on High-Performance Parallel and Distributed Computing (HPDC), Jun. 2013.

Digital Library

[13]

Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Interface, July 1997. http://www.mpi-forum.org/docs/docs.html.

[14]

MPICH -- A portable implementation of MPI. http://www.mpich.org.

[15]

Over 100 Million MPI Processes with MPICH, January 2013. http://www.mpich.org/2013/01/15/over-100-million-processes-with-mpich/.

[16]

Lorna Smith and Mark Bull. Development of mixed mode MPI/OpenMP applications. Scientific Programming, 9(2,3):83--98, 2001.

Digital Library

[17]

Jeff A. Stuart, Pavan Balaji, and John D. Owens. Extending MPI to accelerators. In ASBD 2011: First Workshop on Architectures and Systems for Big Data, October 2011.

Digital Library

[18]

Jesper Larsson Träff. Compact and efficient implementation of the MPI group operations. In Proc. Recent Adv. in MPI - 17th European MPI Users' Group Meeting, EuroMPI 2010, September 2010.

Digital Library

[19]

Hao Wang, Sreeram Potluri, Miao Luo, Ashish Singh, Sayantan Sur, and Dhabaleswar Panda. MVAPICH2-GPU: Optimized GPU to GPU communication for InfiniBand clusters. In Proc. Intl. Supercomputing Conf., ISC, 2011.

Cited By

Nieves-Pírez IMuñoz AAlmeida FBlanco V(2024)Energy efficiency and performance analysis of a legacy atomic scale materials modeling simulator (VASP)The Journal of Supercomputing10.1007/s11227-024-06066-080:11(16679-16702)Online publication date: 16-Apr-2024
https://doi.org/10.1007/s11227-024-06066-0
Marts WDosanjh MSchonbein WLevy SBridges P(2024)Measuring Thread Timing to Assess the Feasibility of Early‐Bird Message Delivery Across Systems and ScalesConcurrency and Computation: Practice and Experience10.1002/cpe.834237:1Online publication date: 12-Dec-2024
https://doi.org/10.1002/cpe.8342
Marts WDosanjh MSchonbein WLevy SBridges P(2023)Measuring Thread Timing to Assess the Feasibility of Early-bird Message DeliveryProceedings of the 52nd International Conference on Parallel Processing Workshops10.1145/3605731.3605884(119-126)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3605731.3605884
Show More Cited By

Index Terms

Enabling MPI interoperability through flexible communication endpoints
1. Computing methodologies
  1. Parallel computing methodologies
    1. Parallel programming languages
2. Software and its engineering
  1. Software notations and tools
    1. General programming languages
      1. Language features
        Concurrent programming structures
      2. Language types
        Parallel programming languages

Recommendations

Enabling efficient multithreaded MPI communication through a library-based implementation of MPI endpoints
SC '14: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis

Modern high-speed interconnection networks are designed with capabilities to support communication from multiple processor cores. The MPI endpoints extension has been proposed to ease process and thread count tradeoffs by enabling multithreaded MPI ...
Enabling communication concurrency through flexible MPI endpoints

MPI defines a one-to-one relationship between MPI processes and ranks. This model captures many use cases effectively; however, it also limits communication concurrency and interoperability between MPI and programming models that utilize threads. This ...
Hybrid parallel programming with MPI and unified parallel C
CF '10: Proceedings of the 7th ACM international conference on Computing frontiers

The Message Passing Interface (MPI) is one of the most widely used programming models for parallel computing. However, the amount of memory available to an MPI process is limited by the amount of local memory within a compute node. Partitioned Global ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

EuroMPI '13: Proceedings of the 20th European MPI Users' Group Meeting

September 2013

289 pages

ISBN:9781450319034

DOI:10.1145/2488551

General Chair:
Jack Dongarra
University of Tennessee
,
Program Chairs:
Javier Garcia Blas
University Carlos III, Spain
,
Jesus Carretero
University Carlos III, Spain

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ARCOS: Computer Architecture and Technology Area, Universidad Carlos III de Madrid

In-Cooperation

SIGHPC: ACM Special Interest Group on High Performance Computing, Special Interest Group on High Performance Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 September 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

U.S. Department of Energy

Conference

EuroMPI '13

Sponsor:

ARCOS

EuroMPI '13: 20th European MPI Users's Group Meeting

September 15 - 18, 2013

Madrid, Spain

Acceptance Rates

EuroMPI '13 Paper Acceptance Rate 22 of 47 submissions, 47%;

Overall Acceptance Rate 66 of 139 submissions, 47%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

43
Total Citations
View Citations
191
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nieves-Pírez IMuñoz AAlmeida FBlanco V(2024)Energy efficiency and performance analysis of a legacy atomic scale materials modeling simulator (VASP)The Journal of Supercomputing10.1007/s11227-024-06066-080:11(16679-16702)Online publication date: 16-Apr-2024
https://doi.org/10.1007/s11227-024-06066-0
Marts WDosanjh MSchonbein WLevy SBridges P(2024)Measuring Thread Timing to Assess the Feasibility of Early‐Bird Message Delivery Across Systems and ScalesConcurrency and Computation: Practice and Experience10.1002/cpe.834237:1Online publication date: 12-Dec-2024
https://doi.org/10.1002/cpe.8342
Marts WDosanjh MSchonbein WLevy SBridges P(2023)Measuring Thread Timing to Assess the Feasibility of Early-bird Message DeliveryProceedings of the 52nd International Conference on Parallel Processing Workshops10.1145/3605731.3605884(119-126)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3605731.3605884
Temuçin YLevy SSchonbein WGrant RAfsahi A(2023)A Dynamic Network-Native MPI Partitioned Aggregation Over InfiniBand Verbs2023 IEEE International Conference on Cluster Computing (CLUSTER)10.1109/CLUSTER52292.2023.00029(259-270)Online publication date: 31-Oct-2023
https://doi.org/10.1109/CLUSTER52292.2023.00029
Zambre RChandramowlishwaran AWolf FShende SCulhane CAlam SJagode H(2022)Lessons learned on MPI+threads communicationProceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis10.5555/3571885.3571987(1-16)Online publication date: 13-Nov-2022
https://dl.acm.org/doi/10.5555/3571885.3571987
Ramos EWhite SBhosale AKale L(2022)Runtime Techniques for Automatic Process VirtualizationWorkshop Proceedings of the 51st International Conference on Parallel Processing10.1145/3547276.3548522(1-10)Online publication date: 29-Aug-2022
https://dl.acm.org/doi/10.1145/3547276.3548522
Zambre RChandramowlishwaran A(2022)Lessons Learned on MPI+Threads CommunicationSC22: International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SC41404.2022.00082(1-16)Online publication date: Nov-2022
https://doi.org/10.1109/SC41404.2022.00082
White SKale L(2022)Improving Communication Asynchrony and Concurrency for Adaptive MPI Endpoints2022 IEEE/ACM International Workshop on Exascale MPI (ExaMPI)10.1109/ExaMPI56604.2022.00007(11-21)Online publication date: Nov-2022
https://doi.org/10.1109/ExaMPI56604.2022.00007
Zambre RSahasrabudhe DZhou HBerzins MChandramowlishwaran ABalaji P(2021)Logically Parallel Communication for Fast MPI+Threads ApplicationsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2021.307515732:12(3038-3052)Online publication date: 1-Dec-2021
https://doi.org/10.1109/TPDS.2021.3075157
Sahasrabudhe DZambre RChandramowlishwaran ABerzins M(2021)Optimizing the hypre solver for manycore and GPU architecturesJournal of Computational Science10.1016/j.jocs.2020.10127949(101279)Online publication date: Feb-2021
https://doi.org/10.1016/j.jocs.2020.101279
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents