research-article

Unveiling eurora - thermal and power characterization of the most energy-efficient supercomputer in the world

Authors:

Andrea Bartolini,

Matteo Cacciari,

Carlo Cavazzoni,

Giampietro Tecchiolli,

Luca BeniniAuthors Info & Claims

DATE '14: Proceedings of the conference on Design, Automation & Test in Europe

Article No.: 277, Pages 1 - 6

Published: 24 March 2014 Publication History

Abstract

Eurora (EURopean many integrated cORe Architecture) is today the most energy efficient supercomputer in the world. Ranked 1st in the Green500 in July 2013, is a prototype built from Eurotech and Cineca toward next-generation Tier-0 systems in the PRACE 2IP EU project. Eurora's outstanding energy-efficiency is achieved by adopting a direct liquid cooling solution and a heterogeneous architecture with best-in-class general purpose HW components (Intel Xeon E5, Intel Xeon Phi and NVIDIA Kepler K20). In this paper we present a novel, low-overhead monitoring infrastructure capable to track in detail and in real-time the thermal and power characteristics of Eurora's components with fine-grained resolution. Our experiments give insights on Eurora's thermal/power trade-offs and highlight opportunities for run-time power/thermal management and optimization.

References

[1]

Zabbix: An enterprise-class open source distributed monitoring, May 2013.

[2]

A. Bartolini, M. Cacciari, A. Tilli, and L. Benini. Thermal and energy management of high-performance multicores: Distributed and self-calibrating model-predictive controller. IEEE Transactions on Parallel and Distributed Systems, 24(1):170--183, 2013.

Digital Library

[3]

K. Bergman, S. Borkar, D. Campbell, W. Carlson, W. Dally, M. Denneau, P. Franzon, W. Harrod, K. Hill, J. Hiller, S. Karp, S. Keckler, D. Klein, R. Lucas, M. Richards, A. Scarpelli, S. Scott, A. Snavely, T. Sterling, and R. S. W. K. Yelick. Exascale computing study: Technology challenges in achieving exascale systems. Technical report, 09 2008.

[4]

C. Cavazzoni. Eurora: a european architecture toward exascale. In Proceedings of the Future HPC Systems: the Challenges of Power-Constrained Performance, page 1. ACM, 2012.

Digital Library

[5]

W. chun Feng and K. Cameron. The green500 list: Encouraging sustainable supercomputing. Computer, 40(12):50--55, 2007.

Digital Library

[6]

J. Dongarra. Visit to the National University for Defense Technology Changsha, China. Technical report, University of Tennessee, 06 2013.

[7]

J. J. Dongarra, H. W. Meuer, E. Strohmaier, et al. Top500 supercomputer sites. Supercomputer, 13:89--111, 1997.

[8]

Intel Corporation. Intel^® 64 and IA-32 Architectures Software Developers Manual. Number 325462-046. March 2013.

[9]

J. Kim, M. Ruggiero, and D. Atienza. Free cooling-aware dynamic power management for green datacenters. In High Performance Computing and Simulation (HPCS), 2012 International Conference on, pages 140--146, 2012.

[10]

J. Kim, M. Ruggiero, D. Atienza, and M. Lederberger. Correlation-aware virtual machine allocation for energy-efficient datacenters. In Proceedings of the Conference on Design, Automation and Test in Europe, DATE '13, pages 1345--1350, San Jose, CA, USA, 2013. EDA Consortium.

Digital Library

[11]

D. Kudithipudi, Q. Qu, and A. Coskun. Thermal management in many core systems. In S. U. Khan, J. Koodziej, J. Li, and A. Y. Zomaya, editors, Evolutionary Based Solutions for Green Computing, volume 432 of Studies in Computational Intelligence, pages 161--185. Springer Berlin Heidelberg, 2013.

[12]

M. L. Massie, B. N. Chun, and D. E. Culler. The ganglia distributed monitoring system: design, implementation, and experience. Parallel Computing, 30(7):817--840, 2004.

[13]

MATLAB. version 7.10.0 (R2010a). The MathWorks Inc., Natick, Massachusetts, 2010.

[14]

Nvidia Corporation. NVML API REFERENCE MANUAL. Number 5.319.43. August 2013.

[15]

V. Pallipadi and A. Starikovskiy. The ondemand governor. In Proceedings of the Linux Symposium, volume 2, pages 215--230. sn, 2006.

[16]

PRACE. Partnership for Advance Computing in Europe.

[17]

M. Sabry, A. Sridhar, J. Meng, A. Coskun, and D. Atienza. Greencool: An energy-efficient liquid cooling design technique for 3-d mpsocs via channel width modulation. Computer-Aided Design of Integrated Circuits and Systems, IEEE Transactions on, 32(4):524--537, 2013.

Digital Library

[18]

H. You and H. Zhang. Comprehensive workload analysis and modeling of a petascale supercomputer. In Job Scheduling Strategies for Parallel Processing, pages 253--271. Springer, 2013.

Cited By

Silvano CAgosta GBartolini ABeccari ABenini LBispo JCmar RCardoso JCavazzoni CMartinovič JPalermo GPalkovič MPinto PRohou ESanna NSlaninová KFanucci LTeich J(2016)Autotuning and adaptivity approach for energy efficient exascale HPC systemsProceedings of the 2016 Conference on Design, Automation & Test in Europe10.5555/2971808.2971971(708-713)Online publication date: 14-Mar-2016
https://dl.acm.org/doi/10.5555/2971808.2971971
Sîrbu ABabaoglu O(2016)Power Consumption Modeling and Prediction in a Hybrid CPU-GPU-MIC SupercomputerProceedings of the 22nd International Conference on Euro-Par 2016: Parallel Processing - Volume 983310.1007/978-3-319-43659-3_9(117-130)Online publication date: 24-Aug-2016
https://dl.acm.org/doi/10.1007/978-3-319-43659-3_9
Conficoni CBartolini ATilli ATecchiolli GBenini LNebel WAtienza D(2015)Energy-aware cooling for hot-water cooled supercomputersProceedings of the 2015 Design, Automation & Test in Europe Conference & Exhibition10.5555/2755753.2757127(1353-1358)Online publication date: 9-Mar-2015
https://dl.acm.org/doi/10.5555/2755753.2757127
Show More Cited By

Index Terms

Recommendations

An Energy-Efficient Multi-GPU Supercomputer
HPCC '14: Proceedings of the 2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS)

During recent years, heterogeneous HPC systems, which combine commodity processors with GPUs have proven to deliver superior energy efficiency. In this paper an international collaboration of research groups from Germany and Saudi Arabia presents SANAM, ...
Energy and Power Characterization of Parallel Programs Running on Intel Xeon Phi
ICPPW '14: Proceedings of the 2014 43rd International Conference on Parallel Processing Workshops

Intel's Xeon Phi coprocessor has successfully proved its capability by being used in Tianhe-2 and Stampede, two of the top ten most powerful supercomputers today. It is almost certain that the popularity of Xeon Phi in heterogeneous computing will grow ...
Revealing power, energy and thermal dynamics of a 200PF pre-exascale supercomputer
SC '21: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis

As we approach the exascale computing era, the focused understanding of power consumption and its overall constraint on HPC architectures and applications are becoming increasingly paramount. Summit, located at the Oak Ridge Leadership Computing Facility ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

DATE '14: Proceedings of the conference on Design, Automation & Test in Europe

March 2014

1959 pages

ISBN:9783981537024

General Chairs:
Gerhard Fettweis
TU Dresden, DE
,
Wolfgang Nebel
OFFIS, DE

Sponsors

EDAA: European Design Automation Association
ECSI
EDAC: Electronic Design Automation Consortium
IEEE Council on Electronic Design Automation (CEDA)
The Russian Academy of Sciences: The Russian Academy of Sciences

In-Cooperation

SIGDA: ACM Special Interest Group on Design Automation

Publisher

European Design and Automation Association

Leuven, Belgium

Publication History

Published: 24 March 2014

Check for updates

Qualifiers

Research-article

Conference

DATE '14

Sponsor:

EDAA
EDAC
The Russian Academy of Sciences

DATE '14: Design, Automation and Test in Europe

March 24 - 28, 2014

Dresden, Germany

Acceptance Rates

Overall Acceptance Rate 518 of 1,794 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
134
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Silvano CAgosta GBartolini ABeccari ABenini LBispo JCmar RCardoso JCavazzoni CMartinovič JPalermo GPalkovič MPinto PRohou ESanna NSlaninová KFanucci LTeich J(2016)Autotuning and adaptivity approach for energy efficient exascale HPC systemsProceedings of the 2016 Conference on Design, Automation & Test in Europe10.5555/2971808.2971971(708-713)Online publication date: 14-Mar-2016
https://dl.acm.org/doi/10.5555/2971808.2971971
Sîrbu ABabaoglu O(2016)Power Consumption Modeling and Prediction in a Hybrid CPU-GPU-MIC SupercomputerProceedings of the 22nd International Conference on Euro-Par 2016: Parallel Processing - Volume 983310.1007/978-3-319-43659-3_9(117-130)Online publication date: 24-Aug-2016
https://dl.acm.org/doi/10.1007/978-3-319-43659-3_9
Conficoni CBartolini ATilli ATecchiolli GBenini LNebel WAtienza D(2015)Energy-aware cooling for hot-water cooled supercomputersProceedings of the 2015 Design, Automation & Test in Europe Conference & Exhibition10.5555/2755753.2757127(1353-1358)Online publication date: 9-Mar-2015
https://dl.acm.org/doi/10.5555/2755753.2757127
Fraternali FBartolini ACavazzoni CTecchiolli GBenini LXie YKarnik TKhellah MMehra R(2014)Quantifying the impact of variability on the energy efficiency for a next-generation ultra-green supercomputerProceedings of the 2014 international symposium on Low power electronics and design10.1145/2627369.2627659(295-298)Online publication date: 11-Aug-2014
https://dl.acm.org/doi/10.1145/2627369.2627659

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents