article

On energy consumption of switch-centric data center networks

Authors:

Olusogo Popoola,

Bernardi PranggonoAuthors Info & Claims

The Journal of Supercomputing, Volume 74, Issue 1

Pages 334 - 369

https://doi.org/10.1007/s11227-017-2132-5

Published: 01 January 2018 Publication History

Abstract

Data center network (DCN) is the core of cloud computing and accounts for 40% energy spend when compared to cooling system, power distribution and conversion of the whole data center (DC) facility. It is essential to reduce the energy consumption of DCN to ensure energy-efficient (green) data center can be achieved. An analysis of DC performance and efficiency emphasizing the effect of bandwidth provisioning and throughput on energy proportionality of two most common switch-centric DCN topologies: three-tier (3T) and fat tree (FT) based on the amount of actual energy that is turned into computing power are presented. Energy consumption of switch-centric DCNs by realistic simulations is analyzed using GreenCloud simulator. Power-related metrics were derived and adapted for the information technology equipment processes within the DCN. These metrics are acknowledged as subset of the major metrics of power usage effectiveness and data center infrastructure efficiency, known to DCs. This study suggests that although in overall FT consumes more energy, it spends less energy for transmission of a single bit of information, outperforming 3T.

References

[1]

Pranggono B, Tianfield H (2014) Green data center. In: Green technology applications for enterprise and academic innovation. IGI-Global, pp 179---199

[2]

Bilal K, Khan SU, Manzano M, Calle E, Madani SA, Hayat K et al (2015) Modeling and simulation of data center. In: Handbook on data centers, pp 945---958. Springer, New York

[3]

Pranggono B, Alboaneen D, Tianfield H (2015) Simulation tools for cloud computing. In: Simulation technologies in networking and communications: selecting the best tool for the test, pp 311---335. CRC Press

[4]

Bilal K, Malik SUR, Khalid O, Hameed A, Alvarez E, Wijaysekara V et al (2014) A taxonomy and survey on green data center networks. Future Gener Comput Syst 36:189---208

[5]

Al-Fares M, Loukissas A, Vahdat A (2008) A scalable, commodity data center network architecture. ACM SIGCOMM Comput Commun Rev 38:63---74

Digital Library

[6]

Rouse M (2010) Green data center. TechTarget Network

[7]

Song Y, Wang H, Li Y, Feng B, Sun Y (2009) Multi-tiered on-demand resource scheduling for VM-based data center. In: The 9th IEEE/ACM International Symposium on Cluster Computing and the Grid

Digital Library

[8]

Kliazovich D, Bouvry P, Khan SU (2012) GreenCloud: a packet-level simulator of energy-aware cloud computing data centers. J Supercomput 62:1263---1283

[9]

Zafar S, Bashir A, Chaudhry SA (2016) On implementation of DCTCP on three-tier and fat-tree data center network topologies. SpringerPlus 5:766

[10]

Fiandrino C, Kliazovich D, Bouvry P, Zomaya AY (2015) Performance and energy efficiency metrics for communication systems of cloud computing data centers. In: IEEE International Conference on Cloud Computing (CLOUD), New York, USA

[11]

Kliazovich D, Bouvry P, Khan SU (2013) DENS: data center energy-efficient network-aware scheduling. Clust Comput 16:65---75

Digital Library

[12]

Bilal K, Khan SU, Zhang L, Li H, Hayat K, Madani SA et al (2013) Quantitative comparisons of the stateoftheart data center architectures. Concurr Comput Pract Exp 25:1771---1783

[13]

Pepeljugoski PK, Kash JA, Doany F, Kuchta DM, Schares L, Schow C et al (2010) Low power and high density optical interconnects for future supercomputers. In: Optical fiber communication, San Diego, p OThX2

[14]

Mahadevan P, Sharma P, Banerjee S, Ranganathan P (2009) A power benchmarking framework for network devices. In: Proceedings of the 8th International IFIP-TC 6 Networking Conference, Aachen

Digital Library

[15]

Chen G, He W, Liu J, Nath S, Rigas L, Xiao L et al (2008) Energy-aware server provisioning and load dispatching for connection-intensive internet services. In: 5th USENIX symposium on networked systems design and implementation, San Francisco, pp 337---350

Digital Library

[16]

Gmach D, Rolia J, Cherkasova L, Kemper A (2009) Resource pool management: reactive versus proactive or let's be friends. Comput Netw 53:2905---2922

Digital Library

[17]

Gandhi A, Harchol-Balter M, Kozuch MA (2012) Are sleep states effective in data centers? In: Green Computing Conference (IGCC), CA, San Jose, pp 1---10

Digital Library

[18]

Bilal K, Manzano M, Khan SU, Calle E, Li K, Zomaya AY (2013) On the characterization of the structural robustness of data center networks. IEEE Trans Cloud Comput 1:64---77

[19]

Benson T, Akella A, Maltz DA (2010) Network traffic characteristics of data centers in the wild. In: 10th ACM SIGCOMM Conference on Internet Measurement, pp 267---280

Digital Library

[20]

Alizadeh M, Greenberg A, Maltz DA, Padhye J, Patel P, Prabhakar B et al (2010) Data center tcp (dctcp). ACM SIGCOMM Comput Commun Rev 40:63---74

Digital Library

[21]

Kusic D, Kephart J, Hanson J, Kandasamy N, Jiang G (2009) Power and performance management of virtualized computing environments via lookahead control. Clust Comput 12:1---15

Digital Library

[22]

Cisco (2012) Cisco's massively scalable data center framework: network fabric for warehouse scale computer. http://www.cisco.com/c/dam/en/us/td/docs/solutions/Enterprise/Data_Center/MSDC/1-0/MSDC_Framework_1.pdf

[23]

Torres J, Carrera D, Beltran V, Poggi N, Hogan K, Berral JL et al (2008) Tailoring resources: the energy efficient consolidation strategy goes beyond virtualization. In: International Conference on Autonomic Computing (ICAC)

Digital Library

[24]

Modius (2016) Green data center initiatives. http://www.modius.com/green_data_center_solution

[25]

Kliazovich D, Bouvry P, Khan SU (2013) Simulation and performance analysis of data intensive and workload intensive cloud computing data centers. In: In optical interconnects for future data center networks, Springer, New York, pp 47---63

[26]

Guo Z, Yang Y (2015) On non blocking multicast fat tree data centre networks with server redundancy. IEEE Trans Comput 64:1058---1073

[27]

Cao J, Xia R, Yang P, Guo C, Lu G, Yuan L et al (2013) Per-packet load-balanced, low-latency routing for clos-based data center networks. In: Proceedings of the Ninth ACM Conference on Emerging Networking Experiments and Technologies, ACM, California, pp 49---60

Digital Library

[28]

Greenberg A, Hamilton JR, Jain N, Kandula S, Kim C, Lahiri P et al (2011) VL2: a scalable and flexible data center network. Commun ACM 54:95---104

Digital Library

[29]

Al-Fares M, Radhakrishnan S, Raghavan B, Huang N, Vahdat A (2010) Hedera: dynamic flow scheduling for data center networks. NSDI 10:19---19

Digital Library

[30]

Carrega A, Singh S, Bruschi R, Bolla R (2012) Traffic merging for energy efficient datacenter network. In: Traffic merging for energy efficient datacenter network, Genoa, Italy

[31]

Chen G, He W, Liu J, Nath S, Rigas L, Xiao L, Zhao F (2008) Energy-aware server provisioning and load dispatching for connection-intensive internet services. In: 5th USENIX symposium on networked systems design and implementation, San Francisco, pp 337---350

Digital Library

[32]

Liu J, Zhao F, Liu X, He W (2009) Challenges towards elastic power management in internet data centers. In: Proceedings of the 2nd international workshop on cyber-physical systems (WCPS) in conjunction with ICDCS, Montreal, Quebec, Canada

Digital Library

[33]

NREL (2014) Trends in data centre design-ASHRAE leads the way to large energy savings. In: ASHRAE Conference, NREL/PR-6A40-58902, Denver, June 24, 2014

[34]

Ahmed A, Sabyasachi AS (2014) Cloud computing simulators: a detailed survey and future direction. In: IEEE International Advance Computing Conference (IACC), pp 866---872

[35]

Fan X, Weber WD, Barroso LA (2007) Power provisioning for a warehouse-sized computer. ACM SIGARCH Comput Archit News 25:13---23

Digital Library

[36]

Kephart N (2015, October 14) Visualizing traffic over ECMP and LAG paths. https://blog.thousandeyes.com/visualizing-traffic-over-ecmp-and-lag-paths/

[37]

Hopps C (2000) Analysis of an equal-cost multi-path algorithm. In: RFC 2992, Internet engineering task force, USA. The ACM Digital Library

Digital Library

[38]

Feng MZ, Hinton K, Ayre R, Tucker RS (2010) Reducing NGN energy consumption with IP/SDH/WDM, New York

[39]

Chernicoff D (2009) The shortcut guide to data center energy efficiency. Realtime Publisher, New York

[40]

Chen Y, Griffith R, Zats D, Joseph AD, Katz R (2012) Understanding TCP incast and its implications for big data workloads. USENIX;login: magazine, vol 37, pp 24---38

[41]

Solnushkin KS (2013, April 3) Fat-tree design: teach yourself fat-tree design in 60 minutes. http://clusterdesign.org/fat-trees/

[42]

Jain R (2013) Data centre network topologies. http://www.cse.wustl.edu/~jain/cse570-13/

[43]

Christensen K, Reviriego P, Nordman B, Bennett M, Mostowfi M, Maestro JA (2010) IEEE 802.3 az: the road to energy efficient ethernet. IEEE Commun Mag 48:50---56

Digital Library

[44]

Werner J, Geronimo G, Westphall C, Koch F, Freitas R (2011) Simulator improvements to validate the green cloud computing approach, vol 1---8, p 2011, Network operations and management symposium (LANOMS), 7th Latin American. IEEE

[45]

Chube P (2011, October) CRAC unit sizing: dos and don'ts. http://www.computerweekly.com/tip/CRAC-unit-sizing-Dos-and-donts

[46]

Cisco (2016, January 14) Cisco Nexus 7000 F-series modules. http://www.cisco.com/c/en/us/products/collateral/switches/nexus-7000-series-switches/data_sheet_c78-605622.html

[47]

itprice (2016) CISCO GPL 2016: the best CISCO global price list checking too. CISCO GPL

[48]

HPE. HP ProLiant DL385p Gen8 server--Specifications. http://h20564.www2.hpe.com/hpsc/doc/public/display?docId=emr_na-c03376977

[49]

PC-development. Computer systems. PC Development Ltd

[50]

GlobalCTI. Power over Ethernet (PoE) vs. power over Ethernet+(PoE+). GLOBALCTI

[51]

NCO. Cat6A 10G molded UTP Ethernet network patch cable. Network Cables Online

[52]

Cablematic. Spool UTP Cat6 cable 24AWG CCA solid green (100 m). Cablematic.com

[53]

Cisco (2016) Cisco Nexus 3064-X, 3064-T, and 3064-32T switches data sheet. Cisco

[54]

Pries R, Jarschel M, Schlosser D, Klopf M, Tran-Gia P (2011) Power consumption of data center architectures. In: International Conference on Green Communications and Networking, Springer, Berlin, pp 114---124

[55]

Lebiednik B, Mangal A, Tiwari N (2016) A survey and evaluation of data center network topologies. ArXiv preprint arXiv:1605.01701

[56]

Andreyev A (2014, November 14) Introducting data centric fabric, the next-generation Facebook data center network. http://tech.ccmbg.com/blog/introducing-data-center-fabric-the-next-generation-facebook-data-center-network-engineering-blog-facebook-code-facebook/

[57]

GoogleDC (2015) Efficiency: How we do it. https://www.google.co.uk/about/datacenters/efficiency/internal/

[58]

Chen T, Gao X, Chen G (2016) The features, hardware, and architectures of data center networks: a survey. J Parallel Distrib Comput 96:45---74

Digital Library

[59]

Singh A, Ong J, Agarwal A, Anderson G, Armistead A, Bannon R et al (2015) Juniper rising: a decade of clos topologies abd centralised control in google's datacenter network. ACM SIGCOMM Comput Commun Rev 45:183---197

Digital Library

[60]

Ray (2015, November 10) Facebook down to 1.08 PUE and counting for cold storage. http://silvertonconsulting.com/blog/2015/11/10/facebook-down-to-1-08-pue-and-counting-for-cold-storage/#sthash.W8S1gf6I.dpbs

[61]

Joshi Y, Kumar P (2012) Energy efficient thermal management of data centers. Springer, Atlanta

[62]

Farrington N, Andreyev A (2013) Facebook's data center network architecture. In: IEEE optical interconnects conference

Cited By

Feng YMa K(2024)Switch-Less Dragonfly on Wafers: A Scalable Interconnection Architecture based on Wafer-Scale IntegrationProceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis10.1109/SC41406.2024.00102(1-17)Online publication date: 17-Nov-2024
https://dl.acm.org/doi/10.1109/SC41406.2024.00102
Zeng ZShen H(2022)Light-BCube:A Scalable and High Performance Network Structure for Modular Data CenterProceedings of the 7th International Conference on Big Data and Computing10.1145/3545801.3545805(20-28)Online publication date: 27-May-2022
https://dl.acm.org/doi/10.1145/3545801.3545805
Vengadachalam NKarthigaivel RSubha Seethalakshmi V(2020)Intrinsic Power Management Strategy based improvement of power stability in a single-phase AC–DC converter systemMicroprocessors & Microsystems10.1016/j.micpro.2020.10299573:COnline publication date: 1-Mar-2020
https://dl.acm.org/doi/10.1016/j.micpro.2020.102995

On energy consumption of switch-centric data center networks

Recommendations

Energy Consumption of IT System in Cloud Data Center: Architecture, Factors and Prediction
Network and Parallel Computing
Abstract
In recent years, as cloud data center has grown constantly in size and quantity, the energy consumption of cloud data center has increased dramatically. Therefore, it is of great significance to study the energy-saving issues of cloud data centers ...
Energy-aware routing in data center network
Green Networking '10: Proceedings of the first ACM SIGCOMM workshop on Green networking

The goal of data center network is to interconnect the massive number of data center servers, and provide efficient and fault-tolerant routing service to upper-layer applications. To overcome the problem of tree architecture in current practice, many ...
Energy Consumption of Content Distribution from Nano Data Centers versus Centralized Data Centers

Energy consumption of nano data centers has recently been a topic of interest as they emerge as a novel computing and storage platform. We present end-to-end energy consumption models for nano data centers and its centralized counterpart. To assess the ...

Comments

Information & Contributors

Information

Published In

cover image The Journal of Supercomputing

The Journal of Supercomputing Volume 74, Issue 1

January 2018

525 pages

ISSN:0920-8542

Issue’s Table of Contents

Copyright © Copyright © 2018 Springer Science+Business Media, LLC, part of Springer Nature.

Publisher

Kluwer Academic Publishers

United States

Publication History

Published: 01 January 2018

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Feng YMa K(2024)Switch-Less Dragonfly on Wafers: A Scalable Interconnection Architecture based on Wafer-Scale IntegrationProceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis10.1109/SC41406.2024.00102(1-17)Online publication date: 17-Nov-2024
https://dl.acm.org/doi/10.1109/SC41406.2024.00102
Zeng ZShen H(2022)Light-BCube:A Scalable and High Performance Network Structure for Modular Data CenterProceedings of the 7th International Conference on Big Data and Computing10.1145/3545801.3545805(20-28)Online publication date: 27-May-2022
https://dl.acm.org/doi/10.1145/3545801.3545805
Vengadachalam NKarthigaivel RSubha Seethalakshmi V(2020)Intrinsic Power Management Strategy based improvement of power stability in a single-phase AC–DC converter systemMicroprocessors & Microsystems10.1016/j.micpro.2020.10299573:COnline publication date: 1-Mar-2020
https://dl.acm.org/doi/10.1016/j.micpro.2020.102995

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents