skip to main content
10.1145/1065944.1065967acmconferencesArticle/Chapter ViewAbstractPublication PagesppoppConference Proceedingsconference-collections
Article

Using multiple energy gears in MPI programs on a power-scalable cluster

Published: 15 June 2005 Publication History

Abstract

Recently, system architects have built low-power, high-performance clusters, such as Green Destiny. The idea behind these clusters is to improve the energy efficiency of nodes. However, these clusters save power at the expense of performance. Our approach is instead to use high-performance cluster nodes that are frequency- and voltage-scalable; energy can than be saved by scaling down the CPU. Our prior work has examined the costs and benefits of executing an entire application at a single reduced frequency.This paper presents a framework for executing a single application in several frequency-voltage settings. The basic idea is to first divide programs into phases and then execute a series of experiments, with each phase assigned a prescribed frequency. During each experiment, we measure energy consumption and time and then use a heuristic to choose the assignment of frequency to phase for the next experiment.Our results show that significant energy can be saved without an undue performance penalty; particularly, our heuristic finds assignments of frequency to phase that is superior to any fixed-frequency solution. Specifically, this paper shows that more than half of the NAS benchmarks exhibit a better energy-time tradeoff using multiple gears than using a single gear. For example, IS using multiple gears uses 9% less energy and executes in 1% less time than the closest single-gear solution. Compared to no frequency scaling, multiple gear IS uses 16% less energy while executing only 1% longer.

References

[1]
N.D. Adiga et al. An overview of the BlueGene/L supercomputer. In Supercomputing 2002, November 2002.]]
[2]
Manish Anand, Edmund Nightingale, and Jason Flinn. Self-tuning wireless network power management. In Mobicom, September 2003.]]
[3]
M. Baker, S. Asami, E. Deprit, J. Ousterhout, and M. Seltzer. Non-volatile memory for fast, reliable file systems. In Proceedings of the 5th ASPLOS, 1992.]]
[4]
Pat Bohrer, Elmootazbellah Elnozahy, Tom Keller, Michael Kistler, Charles Lefurgy, Chandler McDowell, and Ram Rajamony. The case of power management in web servers. In Robert Graybill and Rami Melham, editors, Power Aware Computing. Kluwer/Plenum, 2002.]]
[5]
Kirk W. Cameron, Rong Ge, Xizhou Feng, Drew Varner, and Chris Jones. High-performance, power-aware distributed computing framework (poster). In Supercomputing 2004, November 2004.]]
[6]
Enrique V. Carrera, Eduardo Pinheiro, and Ricardo Bianchini. Conserving disk energy in network servers. In Proceedings of International Conference on Supercomputing, pages 86--97, San Fransisco, CA, 2003.]]
[7]
S. Chandra and A. Vahdat. Application-specific network management for energy-aware streaming of popular multimedia formats. In USENIX Annual Technical Conference, 2002.]]
[8]
Surendar Chandra. Wireless network interface energy consumption implications of popular streaming formats. In Multimedia Computing and Networking (MMCN '02), Jan 2002.]]
[9]
Jeffrey S. Chase, Darrell C. Anderson, Prachi N. Thakar, Amin Vahdat, and Ronald P. Doyle. Managing energy and server resources in hosting centres. In Symposium on Operating Systems Principles, pages 103--116, 2001.]]
[10]
IEEE Computer Society LAN/MAN Standards Committee. IEEE Std 802.11: Wireless LAN medium access control and physical layer specification. Technical report, August 1999.]]
[11]
Compaq Computer Corporation, Intel Corporation, Microsoft Corporation, Phoenix Technologies Ltd., and Toshiba Corporation. Advanced configuration and power interface specification, revision 2.0. July 2000.]]
[12]
A. Datta, A. Celik, J. G. Kim, D. E. VanderMeer, and V. Kumar. Adaptive broadcast protocols to support power conservant retrieval by mobile users. In ICDE, pages 124--133, 1997.]]
[13]
V. Delaluz, A. Sivasubramanian, M. Kandemir, N. Vijaykrishnan, and M. J. Irwin. Scheduler-based DRAM energy management. In Proc. Design Automation Conf. (DAC '02), Jun 2002.]]
[14]
A. Dhodapkar and J. Smith. Comparing phase detection techniques. In International Symposium on Microarchitecture, pages 217--227, December 2003.]]
[15]
F. Douglis, P. Krishnan, and B. Bershad. Adaptive disk spin-down policies for mobile computers. In Proc. 2nd USENIX Symp. on Mobile and Location-Independent Computing, 1995.]]
[16]
C.S. Ellis. The case for higher-level power management. In Proceedings of the 7th Workshop on Hot Topics in Operating Systems, March 1999.]]
[17]
Elmootazbellah Elnozahy, Michael Kistler, and Ramakrishnan Rajamony. Energy conservation policies for web servers. In USITS '03, 2003.]]
[18]
E.N. (Mootaz) Elnozahy, Michael Kistler, and Ramakrishnan Rajamony. Energy-efficient server clusters. In Workshop on Mobile Computing Systems and Applications, Feb 2002.]]
[19]
K. Flautner, S. Reinhardt, and T. Mudge. Automatic performance-setting for dynamic voltage scaling. In Proceedings of the 7th Conference on Mobile Computing and Networking MOBICOM '01, July 2001.]]
[20]
J. Flinn and M. Satyanarayanan. Energy-aware adaptation for mobile applications. In Symposium on Operating Systems Principles, pages 48--63, 1999.]]
[21]
J. Flinn and M. Satyanarayanan. Powerscope: A tool for profiling the energy usage of mobile applications. In Proceedings of the Second IEEE Workshop on Mobile Computing Systems and Applications, February 1999.]]
[22]
Vincent W. Freeh, David K. Lowenthal, Rob Springer, Feng Pan, and Nandani Kappiah. Exploring the energy-time tradeoff in mpi programs on a power-scalable cluster. In IPDPS 2005, Denver, CO, April 2005.]]
[23]
Chris Gniady, Y. Charlie Hu, and Yung-Hsiang Lu. Program counter based techniques for dynamic power management. In Proceedings of the 10th International Symposium on High-Performance Computer Architecture, February 2004.]]
[24]
R. Gonzalez and M. Horowitz. Energy dissipation in general purpose microprocessors. In IEEE International Symposium on Low Power Electronics, October 1995.]]
[25]
K. Govil, E. Chan, and H. Wasserman. Comparing algorithm for dynamic speed-setting of a low-power CPU. In Mobile Computing and Networking, pages 13--25, 1995.]]
[26]
F. Gruian. Hard real-time scheduling for low-energy using stochastic data and DVS processors. In Proceedings of the International Symposium on Low-Power Electronics and Design ISPLED '01, August 2001.]]
[27]
D. Grunwald, P. Levis, K. Farkas, C. Morrey, and M. Neufeld. Policies for dynamic clock scheduling. In Proceedings of 4th Symposium on Operating System Design and Implementation, October 2000.]]
[28]
S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke. Dynamic speed control for power management in server class disks. In Proceedings of International Symposium on Computer Architecture, pages 169--179, June 2003.]]
[29]
Sudhanva Gurumurthi, Anand Sivasubramaniam, Mahmut Kandemir, and Hubertus Franke. Reducing disk power consumption in servers with DRPM. IEEE Computer, pages 41--48, December 2003.]]
[30]
Taliver Heath, Eduardo Pinheiro, Jerry Hom, Ulrich Kremer, and Ricardo Bianchini. Application transformations for energy and performance-aware device management. In Proceedings of the 11th International Conference on Parallel Architectures and Compilation Techniques, September 2002.]]
[31]
D. P. Helmbold, D. D. E. Long, and B. Sherrod. A dynamic disk spin-down technique for mobile computing. In Mobile Computing and Networking, pages 130--142, 1996.]]
[32]
C-H. Hsu and U. Kremer. The design, implementation, and evaluation of a compiler algorithm for cpu energy reduction. In ACM SIGPLAN Conference on Programming Languages, Design, and Implementation, June 2003.]]
[33]
M. Huang, J. Renau, and J. Torellas. Positional adaptation of processors: Application to energy reduction. In International Symposium on Computer Architecture, pages 157--168, June 2003.]]
[34]
C. Im, H. Kim, and S. Ha. Dynamic voltage scheduling technique for low-power multimedia applications using buffers. In Proceedings of the International Symposium on Low-Power Electronics and Design ISPLED '01, August 2001.]]
[35]
Ken Kennedy and Ulrich Kremer. Automatic data layout for distributed-memory machines. ACM Transactions on Programming Languages and Systems, 20(4):869--916, 1998.]]
[36]
Ronny Krashinsky and Hari Balakrishnan. Minimizing energy for wireless web access with bounded slowdown. In Mobicom 2002, Atlanta, GA, September 2002.]]
[37]
R. Kravets and P. Krishnan. Power management techniques for mobile communication. In Proceedings of the 4th International Conference on Multimedia Computing and Networking, pages 157--168, Oct 1998.]]
[38]
R. Kravets, K. Schwan, and K. Calvert. Power-aware communication for mobile computers. In Proc. 6th International Workshop on Mobile Multimedia Communications, Nov 1999.]]
[39]
C. M. Krishna and Y. H. Lee. Voltage-clock-scaling techniques for low power in hard real-time systems. In Proceedings of the IEEE Real-Time Technology and Applications Symposium, pages 156--165, May 2000.]]
[40]
A. R. Lebeck, X. Fan, H. Zeng, and C. S. Ellis. Power aware page allocation. In Architectural Support for Programming Languages and Operating Systems, pages 105--116, 2000.]]
[41]
Charles Lefurgy, Karthick Rajamani, Freeman Rawson, Wes Felter, Michael Kistler, and Tom W. Keller. Energy management for commerical servers. IEEE Computer, pages 39--48, December 2003.]]
[42]
K. Li, R. Kumpf, P. Horton, and T. E. Anderson. A quantitative analysis of disk drive power management in portable computers. In USENIX Winter, pages 279--291, 1994.]]
[43]
J. Lorch and A. Smith. Software strategies for portable computer energy management. IEEE Personal Communications Magazine, 5(3):60--73, June 1998.]]
[44]
J. Lorch and A. J. Smith. Improving dynamic voltage scaling algorithms with pace. In Proceedings of the ACM SIGMETRICS 2001 Conference, pages 50--61, June 2001.]]
[45]
Margaret Martonosi, David Brooks, and Pradip Bose. Modeling and analyzing CPU power and performance: Metrics, methods, and abstractions. In SIGMETRICS, 2001.]]
[46]
Robert J. Minerick, Vincent W. Freeh, and Peter M. Kogge. Dynamic power management using feedback. In Workshop on Compilers and Operating Systems for Low Power, pages 6--1--6--10, Charlottesville, Va, September 2002.]]
[47]
Donald G. Morris and David K. Lowenthal. Accurate data redistribution cost estimation in software distributed shared memory systems. In Principles and Practice of Parallel Programming, pages 62--71, June 2001.]]
[48]
Orion Multisystems. http://www.orionmulti.com/.]]
[49]
B. D. Noble, M. Satyanarayanan, D. Narayanan, J. E. Tilton, J. Flinn, and K. R. Walker. Application-aware adaptation for mobility. In Proceedings of the 16th ACM Symposium on Operating Systems and Principles, pages 276--287, October 1997.]]
[50]
Athanasios E. Papathanasiou and Michael L. Scott. Energy efficiency through burstiness. In WMCSA, October 2003.]]
[51]
T. Pering and R. Brodersen. Energy efficient voltage scheduling for real-time operating systems. In Proceedings of the 4th IEEE Real-Time Technology and Applications Symposium RTAS '98, June 1998.]]
[52]
T. Pering, T. Burd, and R. Brodersen. The simulation and evaluation of dynamic voltage scaling algorithms. In Proceedings of the International Symposium on Low-Power Electronics and Design ISPLED '98, pages 76--81, August 1998.]]
[53]
P. Pillai and K. Shin. Real-time dynamic voltage scaling for low-power embedded operating systems. In Proceedings of the 18th ACM Symposium on Operating Systems Principles, 2001.]]
[54]
E. Pinheiro, R. Bianchini, E. V. Carrera, and T. Heath. Dynamic cluster reconfiguration for power and performance. In Compilers and Operating Systems for Low Power, September 2001.]]
[55]
Eduardo Pinheiro, Ricardo Bianchini, Enrique V. Carrera, and Taliver Heath. Load balancing and unbalancing for power and performance in cluster-based systems. In Workshop on Compilers and Operating Systems for Low Power, September 2001.]]
[56]
J. Pouwelse, K. Langendoen, and H. Sips. Dynamic voltage scaling on a low-power microprocessor. In Proceedings of the 7th Conference on Mobile Computing and Networking MOBICOM '01, July 2001.]]
[57]
J. Pouwelse, K. LangenDoen, and H. Sips. Energy priority scheduling for variable voltage processors. In Proceedings of the International Symposium on Low-Power Electronics and Design ISPLED '01, August 2001.]]
[58]
Gang Quan and Xiaobo Hu. Energy efficient fixed priority scheduling for real-time systems on variable voltage processors. In ACM/IEEE Design Automation Conference, pages 828--833, June 2001.]]
[59]
Rolf Rabenseifner. Automatic profiling of MPI applications with hardware performance counters. In PVM/MPI, pages 35--42, 1999.]]
[60]
Umit Rencuzogullari and Sandhya Dwarkadas. Dynamic adaptation to available resources for parallel computing in an autonomous network of workstations. In Eighth Conference on Principles and Practice of Parallel Programming, pages 72--81, June 2001.]]
[61]
Vivek Sharma, Arun Thomas, Tarek Abdelzaher, and Kevin Skadron. Power-aware QoS management in web servers. In 24th Annual IEEE Real-Time Systems Symposium, Cancun, Mexico, December 2003.]]
[62]
M. Stemm, P. Gauthier, D. Harada, and R. H. Katz. Reducing power consumption of network interfaces in hand-held devices. In Proc. 3rd Intl. Workshop on Mobile Multimedia Comm., September 1996.]]
[63]
A. Vahdat, A. Lebeck, and C. Ellis. Every joule is precious: The case for revisiting operating system design for energy efficiency. SIGOPS European Workshop, 2000.]]
[64]
M. Warren, E. Weigle, and W. Feng. High-density computing: A 240-node beowulf in one cubic meter. In Supercomputing 2002, November 2002.]]
[65]
M. Weiser, B. Welch, A. J. Demers, and S. Shenker. Scheduling for reduced CPU energy. In Operating Systems Design and Implementation (OSDI '94), pages 13--23, 1994.]]
[66]
John Wilkes. Predictive power consumption. Technical Report HPL-CSP-92-5, Hewlett-Packard Labs, Feb 1992.]]
[67]
F. C. Wong, R. P. Martin, R. H. Arpaci-Dusseau, and D. E. Culler. Architectural requirements and scalability of the NAS parallel benchmarks. In Proceedings of Supercomputing '99, Portland, OR, November 1999.]]
[68]
Haijin Yan, Rupa Krishnan, Scott A. Watterson, and David K. Lowenthal. Client-centered energy savings for concurrent HTTP connections. In Proceedings of the 14th ACM Workshop on Networks and Operating System Support for Digital Audio and Video, June 2004.]]
[69]
Haijin Yan, Rupa Krishnan, Scott A. Watterson, David K. Lowenthal, Kang Li, and Larry L. Peterson. Client-centered energy and delay analysis for TCP downloads. In Proceedings of the 14th IEEE International Workshop on Quality of Service, June 2004.]]
[70]
Giovanni De Micheli Yung-Hsiang Lu, Luca Benini. Operating-system directed power reduction. In International Symposium on Low Power Electronics and Design, pages 37--42. Stanford University, July 2000.]]
[71]
H. Zeng, C. S. Ellis, A. R. Lebeck, and A. Vahdat. ECOSystem: Managing energy as a first class operating system resource. In ASPLOS X, October 2002.]]
[72]
Heng Zeng, Carla S. Ellis, Alvin R. Lebeck, and Amin Vahdat. Currentcy: Unifying policies for resource management. In USENIX 2003 Annual Technical Conference, June 2003.]]
[73]
Qingbo Zhu, Francis M. David, Christo Devaraj, Zhenmin Li, Yuanyuan Zhou, and Pei Cao. Reducing energy consumption of disk storage using power-aware cache management. In Proceedings of the 10th International Symposium on High-Performance Computer Architecture (HPCA-10), February 2004.]]

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
PPoPP '05: Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming
June 2005
310 pages
ISBN:1595930809
DOI:10.1145/1065944
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2005

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. high-performance computing
  2. power-aware computing

Qualifiers

  • Article

Conference

PPoPP05
Sponsor:

Acceptance Rates

Overall Acceptance Rate 230 of 1,014 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media