research-article

AM++: a generalized active message framework

Authors:

Jeremiah James Willcock,

Torsten Hoefler,

Nicholas Gerard Edmonds,

Andrew LumsdaineAuthors Info & Claims

PACT '10: Proceedings of the 19th international conference on Parallel architectures and compilation techniques

Pages 401 - 410

https://doi.org/10.1145/1854273.1854323

Published: 11 September 2010 Publication History

Abstract

Active messages have proven to be an effective approach for certain communication problems in high performance computing. Many MPI implementations, as well as runtimes for Partitioned Global Address Space languages, use active messages in their low-level transport layers. However, most active message frameworks have low-level programming interfaces that require significant programming effort to use directly in applications and that also prevent optimization opportunities. In this paper we present AM++, a new user-level library for active messages based on generic programming techniques. Our library allows message handlers to be run in an explicit loop that can be optimized and vectorized by the compiler and that can also be executed in parallel on multicore architectures. Runtime optimizations, such as message combining and filtering, are also provided by the library, removing the need to implement that functionality at the application level. Evaluation of AM++ with distributed-memory graph algorithms shows the usability benefits provided by these library features, as well as their performance advantages.

References

[1]

}}Berkeley UPC system internals documentation, version 2.10.0, Nov. 2009. http://upc.lbl.gov/docs/system/index.html

[2]

}}D. Bonachea. GASNet specification, v1.1. Technical report, University of California at Berkeley, Berkeley, CA, USA, 2002. http://gasnet.cs.berkeley.edu/CSD-02-1207.pdf.

Digital Library

[3]

}}K. M. Chandy and J. Misra. How processes learn. Distributed Computing, 1(1):40--52, 1986.

Digital Library

[4]

}}A. Crauser, K. Mehlhorn, U. Meyer, and P. Sanders. A parallelization of Dijkstra's shortest path algorithm. In Mathematical Foundations of Computer Science, volume 1450 of LNCS, pages 722--731. Springer, 1998.

Digital Library

[5]

}}J. Dean and S. Ghemawat. MapReduce: Simplified data processing on large clusters. In Operating Systems Design & Implementation, pages 137--157, Berkeley, CA, USA, 2004.

Digital Library

[6]

}}N. Edmonds, A. Breuer, D. Gregor, and A. Lumsdaine. Single-source shortest paths with the Parallel Boost Graph Library. In The Ninth DIMACS Implementation Challenge: The Shortest Path Problem, Piscataway, NJ, November 2006.

[7]

}}N. Francez. Distributed termination. ACM Trans. Program. Lang. Syst., 2(1):42--55, 1980.

Digital Library

[8]

}}P. Geoffray. Myrinet eXpress (MX): Is your interconnect smart? In High Performance Computing and Grid in Asia Pacific Region, pages 452--452, Washington, DC, USA, 2004. IEEE Computer Society.

Digital Library

[9]

}}D. Gregor and A. Lumsdaine. The Parallel BGL: A generic library for distributed graph computations. In Parallel Object-Oriented Scientific Computing, July 2005.

[10]

}}T. Hoefler, A. Lumsdaine, and W. Rehm. Implementation and performance analysis of non-blocking collective operations for MPI. In IEEE/ACM Supercomputing 2007 (SC'07), Nov. 2007.

Digital Library

[11]

}}T. Hoefler, C. Siebert, and A. Lumsdaine. Scalable communication protocols for dynamic sparse data exchange. In Principles and Practice of Parallel Programming, Jan. 2010.

Digital Library

[12]

}}H. Kaiser, M. Brodowicz, and T. Sterling. ParalleX. International Conference on Parallel Processing Workshops, pages 394--401, 2009.

Digital Library

[13]

}}L. V. Kalé and S. Krishnan. CHARM++: a portable concurrent object oriented system based on C++. SIGPLAN Not., 28(10):91--108, 1993.

Digital Library

[14]

}}S. Kumar, G. Dozsa, G. Almasi, P. Heidelberger, D. Chen, M. E. Giampapa, M. Blocksome, A. Faraj, J. Parker, J. Ratterman, B. Smith, and C. J. Archer. The Deep Computing Messaging Framework: Generalized scalable message passing on the Blue Gene/P supercomputer. In International Conference on Supercomputing, pages 94--103, New York, NY, USA, 2008. ACM.

Digital Library

[15]

}}A. Lumsdaine, D. Gregor, B. Hendrickson, and J. Berry. Challenges in parallel graph processing. Parallel Processing Letters, 17(1):5--20, 2007 2007.

[16]

}}F. Mattern. Algorithms for distributed termination detection. Distributed Computing, 2(3):161--175, Sept. 1987.

Digital Library

[17]

}}U. Meyer and P. Sanders. Δ-stepping: A parallelizable shortest path algorithm. J. Algorithms, 49(1):114--152, 2003.

Digital Library

[18]

}}MPI Forum. MPI: A Message-Passing Interface Standard. Version 2.2, September 4th 2009.

[19]

}}R. W. Numrich and J. Reid. Co-arrays in the next Fortran standard. SIGPLAN Fortran Forum, 24(2):4--17, 2005.

Digital Library

[20]

}}Object Management Group. CORBA 3.1, Jan. 2008. http://www.omg.org/spec/CORBA/3.1/.

[21]

}}G. Shah and C. Bender. Performance and experience with LAPI--a new high-performance communication library for the IBM RS/6000 SP. In International Parallel Processing Symposium, page 260, Washington, DC, USA, 1998. IEEE Computer Society.

Digital Library

[22]

}}W. Shu and L. V. Kalé. Chare kernel--a runtime support system for parallel computations. J. Parallel Distrib. Comput., 11(3):198--211, 1991.

Digital Library

[23]

}}A. B. Sinha, L. V. Kalé, and B. Ramkumar. A dynamic and adaptive quiescence detection algorithm. Technical Report 93-11, Parallel Programming Laboratory, UIUC, 1993.

[24]

}}B. Stroustrup. Design and Evolution of C++. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, 1994.

Digital Library

[25]

}}N. Thomas, S. Saunders, T. G. Smith, G. Tanase, and L. Rauchwerger. ARMI: a high level communication library for STAPL. Parallel Processing Letters, 16(2):261--280, 2006.

[26]

}}R. Thurlow. RPC: Remote Procedure Call Protocol Specification Version 2. Sun Microsystems, May 2009. http://tools.ietf.org/html/rfc5531.

[27]

}}UPC Consortium. UPC Language Specification, v1.2, May 2005. http://upc.lbl.gov/docs/user/upc_spec_1.2.pdf.

[28]

}}Object-Oriented Scientific Computing, July 2005.

[29]

}}T. von Eicken, D. E. Culler, S. C. Goldstein, and K. E. Schauser. Active messages: a mechanism for integrated communication and computation. In International Symposium on Computer Architecture, pages 256--266, New York, NY, USA, 1992. ACM.

Digital Library

[30]

}}J. Waldo. Remote procedure calls and Java Remote Method Invocation. IEEE Concurrency, 6:5--7, 1998.

Digital Library

[31]

}}D. A. Wallach, W. C. Hsieh, K. L. Johnson, M. F. Kaashoek, and W. E. Weihl. Optimistic Active Messages: a mechanism for scheduling communication with computation. In Principles and Practice of Parallel Programming, pages 217--226, New York, NY, USA, 1995. ACM.

Digital Library

Cited By

Thomadakis PTsolakis CChrisochoides N(2022)Multithreaded runtime framework for parallel and adaptive applicationsEngineering with Computers10.1007/s00366-022-01713-738:5(4675-4695)Online publication date: 31-Jul-2022
https://doi.org/10.1007/s00366-022-01713-7
Ranganath KFiroz JSuetterlein JManzano JMarquez ARaugas MWong D(2022)LC-MEMENTO: A Memory Model for Accelerated ArchitecturesLanguages and Compilers for Parallel Computing10.1007/978-3-030-99372-6_5(67-82)Online publication date: 24-Mar-2022
https://doi.org/10.1007/978-3-030-99372-6_5
Castellana VDrocco MFeo JFiroz JKanewala TLumsdaine AManzano JMarquez AMinutoli MSuetterlein JTumeo AZalewski M(2019)A Parallel Graph Environment for Real-World Data Analytics Workflows2019 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE.2019.8715196(1313-1318)Online publication date: Mar-2019
https://doi.org/10.23919/DATE.2019.8715196
Show More Cited By

Index Terms

AM++: a generalized active message framework
1. Computing methodologies
  1. Parallel computing methodologies
    1. Parallel programming languages
2. Software and its engineering
  1. Software notations and tools
    1. General programming languages
      1. Language types
        Parallel programming languages

Recommendations

The deep computing messaging framework: generalized scalable message passing on the blue gene/P supercomputer
ICS '08: Proceedings of the 22nd annual international conference on Supercomputing

We present the architecture of the Deep Computing Messaging Framework (DCMF), a message passing runtime designed for the Blue Gene/P machine and other HPC architectures. DCMF has been designed to easily support several programming paradigms such as the ...
Expressing graph algorithms using generalized active messages
PPoPP '13: Proceedings of the 18th ACM SIGPLAN symposium on Principles and practice of parallel programming

Recently, graph computation has emerged as an important class of high-performance computing application whose characteristics differ markedly from those of traditional, compute-bound, kernels. Libraries such as BLAS, LAPACK, and others have been ...
Evaluating the Benefits of Communication Coprocessors

Communication coprocessors (CCPs) have become commonplace in modern MPPs and networks of workstations. These coprocessors provide dedicated hardware support for fast communication. In this paper we study how to exploit the capabilities of CCPs for ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

PACT '10: Proceedings of the 19th international conference on Parallel architectures and compilation techniques

September 2010

596 pages

ISBN:9781450301787

DOI:10.1145/1854273

General Chair:
Valentina Salapura
IBM TJ Watson Research Center
,
Program Chairs:
Michael Gschwind
IBM Systems & Technology Group
,
Jens Knoop
Technische Universität Wien

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

IFIP WG 10.3: IFIP working group 10.3 on concurrent systems
IEEE CS TCPP: IEEE-CS technical committee on parallel processing
SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE CS TCAA: IEEE CS technical committee on architectural acoustics

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

PACT '10

Sponsor:

IFIP WG 10.3
IEEE CS TCPP
SIGARCH
IEEE CS TCAA

PACT '10: International Conference on Parallel Architectures and Compilation Techniques

September 11 - 15, 2010

Vienna, Austria

Acceptance Rates

Overall Acceptance Rate 121 of 471 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

55
Total Citations
View Citations
417
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Thomadakis PTsolakis CChrisochoides N(2022)Multithreaded runtime framework for parallel and adaptive applicationsEngineering with Computers10.1007/s00366-022-01713-738:5(4675-4695)Online publication date: 31-Jul-2022
https://doi.org/10.1007/s00366-022-01713-7
Ranganath KFiroz JSuetterlein JManzano JMarquez ARaugas MWong D(2022)LC-MEMENTO: A Memory Model for Accelerated ArchitecturesLanguages and Compilers for Parallel Computing10.1007/978-3-030-99372-6_5(67-82)Online publication date: 24-Mar-2022
https://doi.org/10.1007/978-3-030-99372-6_5
Castellana VDrocco MFeo JFiroz JKanewala TLumsdaine AManzano JMarquez AMinutoli MSuetterlein JTumeo AZalewski M(2019)A Parallel Graph Environment for Real-World Data Analytics Workflows2019 Design, Automation & Test in Europe Conference & Exhibition (DATE)10.23919/DATE.2019.8715196(1313-1318)Online publication date: Mar-2019
https://doi.org/10.23919/DATE.2019.8715196
Besnard JJaeger JMalony AShende STaboada HPérache MCarribault P(2019)Mixing ranks, tasks, progress and nonblocking collectivesProceedings of the 26th European MPI Users' Group Meeting10.1145/3343211.3343221(1-10)Online publication date: 11-Sep-2019
https://dl.acm.org/doi/10.1145/3343211.3343221
Firoz JZalewski MLumsdaine A(2019)A Synchronization-Avoiding Distance-1 Grundy Coloring Algorithm for Power-Law GraphsProceedings of the International Conference on Parallel Architectures and Compilation Techniques10.1109/PACT.2019.00040(420-431)Online publication date: 23-Sep-2019
https://dl.acm.org/doi/10.1109/PACT.2019.00040
Priest BSteil TSanders GPearce R(2019)You've Got Mail (YGM): Building Missing Asynchronous Communication Primitives2019 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW)10.1109/IPDPSW.2019.00045(221-230)Online publication date: May-2019
https://doi.org/10.1109/IPDPSW.2019.00045
Brock BChen YYan JOwens JBuluc AYelick K(2019)RDMA vs. RPC for Implementing Distributed Data Structures2019 IEEE/ACM 9th Workshop on Irregular Applications: Architectures and Algorithms (IA3)10.1109/IA349570.2019.00009(17-22)Online publication date: Nov-2019
https://doi.org/10.1109/IA349570.2019.00009
Liu XFiroz JZalewski MHalappanavar MBarker KLumsdaine AGebremedhin A(2019)Distributed Direction-Optimizing Label Propagation for Community Detection2019 IEEE High Performance Extreme Computing Conference (HPEC)10.1109/HPEC.2019.8916215(1-6)Online publication date: Sep-2019
https://doi.org/10.1109/HPEC.2019.8916215
Ojika DGordon-Ross ALam HYoo SCui YDong ZVan Dam KLee SKurth T(2019)PCS: A Productive Computational Science Platform2019 International Conference on High Performance Computing & Simulation (HPCS)10.1109/HPCS48598.2019.9188108(636-641)Online publication date: Jul-2019
https://doi.org/10.1109/HPCS48598.2019.9188108
Jenkins LZalewski MFerguson M(2018)Chapel Aggregation Library (CAL)2018 IEEE/ACM Parallel Applications Workshop, Alternatives To MPI (PAW-ATM)10.1109/PAW-ATM.2018.00009(34-43)Online publication date: Nov-2018
https://doi.org/10.1109/PAW-ATM.2018.00009
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents