research-article

Reconfigurable network testbed for evaluation of datacenter topologies

Authors:

William Clay Moody,

Jason Anderson,

Kuang-Ching Wange,

Amy AponAuthors Info & Claims

DIDC '14: Proceedings of the sixth international workshop on Data intensive distributed computing

Pages 11 - 20

https://doi.org/10.1145/2608020.2608023

Published: 23 June 2014 Publication History

Abstract

Software-defined networking combined with distributed and parallel applications has the potential to deliver optimized application performance at runtime. In order to investigate this enhancement and design future implementation, a datacenter with a programmable topology integrated with application state is needed. Towards this goal, we introduce the Flow Optimized Route Configuration Engine (FORCE). The FORCE is an emulated datacenter testbed with a programmable interconnection controlled by an SDN controller. We also utilize Hadoop as a case study of distributed and parallel applications along with a simulated Hadoop shuffle traffic generator. The testbed provides initial experimental evidence of support to our hypothesis for future SDN research. Our experiments on the testbed show a difference in application runtime a factor of over 2.5 times on shuffle traffic for Hadoop MapReduce jobs and the potential for significant speedup in warehouse scale data centers.

References

[1]

NetworkX - High-productivity software for complex networks. http://networkx.github.io/.

[2]

Project Floodlight. http://www.projectfloodlight.org/.

[3]

The OpenStack Project. http://www.openstack.org.

[4]

Understanding ECMP Flow-Based Forwarding. http://www.juniper.net/techpubs/en US/junos13.3/topics/concept/routing-policy-security-ecmp-flow-based-forwarding-understanding.html.

[5]

M. Al-Fares, A. Loukissas, and A. Vahdat. A scalable, commodity data center network architecture. In ACM SIGCOMM Computer Communication Review, volume 38, pages 63--74, 2008.

Digital Library

[6]

M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, and A. Vahdat. Hedera: Dynamic flow scheduling for data center networks. In NSDI, volume 10, pages 19--19, 2010.

Digital Library

[7]

T. Benson, A. Akella, and D. A. Maltz. Network traffic characteristics of data centers in the wild. In Proceedings of the 10th ACM SIGCOMM conference on Internet measurement, IMC '10, pages 267--280, New York, NY, USA, 2010. ACM.

Digital Library

[8]

T. Benson, A. Akella, S. Sahu, and A. Shaikh. Epic: Platform-as-a- service model for cloud networking. Technical Report 1686, CS Department, University of Wisconsin, Madison, 2011.

[9]

T. Benson, A. Anand, A. Akella, and M. Zhang. Understanding data center traffic characteristics. SIGCOMM Comput. Commun. Rev., 40(1):92--99, Jan. 2010.

Digital Library

[10]

CERN. The grid: A system of tiers. http://home.web.cern.ch/about/computing/grid-system-tiers.

[11]

J. Dean and S. Ghemawat. MapReduce: simplified data processing on large clusters. Communications of the ACM, 51(1):107--113, 2008.

Digital Library

[12]

R. J. O. Figueiredo, P. A. Dinda, and J. A. B. Fortes. A case for grid computing on virtual machine. In Proceedings of the International Conference on Distributed Computing SYstems, 2003.

Digital Library

[13]

C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. BCube: a high performance, server-centric network architecture for modular data centers. ACM SIGCOMM Computer Communication Review, 39(4):63--74, 2009.

Digital Library

[14]

M. Hammoud, M. Rehman, and M. Sakr. Center-of-gravity reduce task scheduling to lower MapReduce network traffic. In 2012 IEEE 5th International Conference on Cloud Computing (CLOUD), pages 49--58, 2012.

Digital Library

[15]

M. Hammoud and M. Sakr. Locality-aware reduce task scheduling for MapReduce. In 2011 IEEE Third International Conference on Cloud Computing Technology and Science (CloudCom), pages 570--576, 2011.

Digital Library

[16]

B. Heller, C. Scott, N. McKeown, S. Shenker, A. Wundsam, H. Zeng, S. Whitlock, V. Jeyakumar, N. Handigol, J. McCauley, K. Zarifis, and P. Kazemian. Leveraging sdn layering to systematically troubleshoot networks. In Proceedings of ACM Workshop on Hot Topics in Software Defined Network, 2013.

Digital Library

[17]

B. Heller, S. Seetharaman, P. Mahadevan, Y. Yiakoumis, P. Sharma, S. Banerjee, and N. McKeown. Elastictree: saving energy in data center networks. In Proceedings of the 7th USENIX conference on Networked systems design and implementation, NSDI'10, pages 17--17, Berkeley, CA, USA, 2010. USENIX Association.

Digital Library

[18]

M. Hillenbrand. Towards virtual infiniband clusters with network and performance isolation, 2011.

[19]

S. Ibrahim, H. Jin, L. Lu, S. Wu, B. He, and L. Qi. LEEN: Locality/Fairness-Aware key partitioning for MapReduce in the cloud. In 2010 IEEE Second International Conference on Cloud Computing Technology and Science (CloudCom), pages 17--24, 2010.

Digital Library

[20]

J. W. Lee, R. Francescangeli, J. Janak, S. Srinivasan, S. A. Baset, H. Schulzrinne, Z. Despotovic, and W. Kellerer. Netserv: Active networking 2.0, 2011.

[21]

Z. Li, Y. Shen, B. Yao, and M. Guo. OFScheduler: a dynamic network optimizer for MapReduce in heterogeneous cluster. International Journal of Parallel Programming, pages 1--17.

[22]

N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner. Open flow: enabling innovation in campus networks. ACM SIGCOMM Computer Communication Review, 38, 2008.

Digital Library

[23]

J. Mudigonda, P. Yalagandula, M. Al-Fares, and J. C. Mogul. SPAIN: COTS data-center ethernet for multipathing over arbitrary topologies. In NSDI, pages 265--280, 2010.

Digital Library

[24]

S. Narayan, S. Bailey, and A. Daga. Hadoop acceleration in an OpenFlow-Based cluster. In High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion:, pages 535--538, 2012.

Digital Library

[25]

A. Rosen and K.-C. Wang. Steroid open flow service: Seamless network service delivery in software defined networks. In Proceedings of the First GENI Research and Educational Experiment Workshop, 2012.

[26]

R. B. Ross and R. Thakur. PVFS: a parallel file system for linux clusters. In Proceedings of the 4th Annual Linux Showcase and Conference, pages 391--430, 2000.

Digital Library

[27]

R. Sherwood, G. Gibb, K. Yap, G. Appenzeller, M. Casado, N. McKeown, and G. Parulkar. Flowvisor: A network virtualization layer. OpenFlow Switch Consortium Technical Report, 2009.

[28]

S. Sur, H. Wang, J. Huang, X. Ouyang, and D. K. Panda. Can high-performance interconnects benefit hadoop distributed file system. In Workshop on Micro Architectural Support for Virtualization, Data Center Computing, and Clouds (MASVDC). Held in Conjunction with MICRO, 2010.

[29]

G. Wang, T. E. Ng, and A. Shaikh. Programming your network at run-time for big data applications. In Proceedings of the first workshop on Hot topics in software defined networks, HotSDN '12, pages 103--108, New York, NY, USA, 2012. ACM.

Digital Library

[30]

R. Wang, D. Butnariu, and J. Rexford. Open flow-based server load balancing gone wild. In Proceedings of the 11th USENIX conference on Hot topics in management of internet, cloud, and enterprise networks and services, Hot-ICE'11, pages 12--12, Berkeley, CA, USA, 2011. USENIX Association.

Digital Library

[31]

Y. Wang, X. Que, W. Yu, D. Goldenberg, and D. Sehgal. Hadoop acceleration through network levitated merge. In Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, page 57, 2011.

Digital Library

[32]

K. C. Webb, A. C. Snoeren, and K. Yocum. Topology switching for data center networks. In Hot-ICE Workshop, 2011.

Digital Library

Cited By

Beigi-Mohammadi NLitoiu M(2017)Engineering Self-Adaptive Applications on Cloud with Software Defined Networks2017 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E.2017.43(9-12)Online publication date: May-2017
https://doi.org/10.1109/IC2E.2017.43
Ben Yoo SProietti RGrani P(2017)Photonics in Data CentersOptical Switching in Next Generation Data Centers10.1007/978-3-319-61052-8_1(3-21)Online publication date: 30-Aug-2017
https://doi.org/10.1007/978-3-319-61052-8_1
Beigi-Mohammadi NKhazaei HShtern MBarna CLitoiu M(2016)On Efficiency and Scalability of Software-Defined Infrastructure for Adaptive Applications2016 IEEE International Conference on Autonomic Computing (ICAC)10.1109/ICAC.2016.39(25-34)Online publication date: Jul-2016
https://doi.org/10.1109/ICAC.2016.39
Show More Cited By

Index Terms

Reconfigurable network testbed for evaluation of datacenter topologies
1. Networks
  1. Network properties
    1. Network structure
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles
        Organizing principles for web applications

Recommendations

Performance Analysis of POX and Ryu with Different SDN Topologies
ICISS '18: Proceedings of the 1st International Conference on Information Science and Systems

This paper deals with the performance comparison of two python-based Software Defined Network (SDN) controllers i.e. POX and Ryu under different network topologies such as Single, Linear, Tree, Dumbbell, Data Center Networks (DCN) and Software-Defined ...
Towards predictable datacenter networks
SIGCOMM '11

The shared nature of the network in today's multi-tenant datacenters implies that network performance for tenants can vary significantly. This applies to both production datacenters and cloud environments. Network performance variability hurts ...
Live Migration Impact on Virtual Datacenter Performance: Vmware vMotion Based Study
FICLOUD '14: Proceedings of the 2014 International Conference on Future Internet of Things and Cloud

Cloud computing is the future wave of information technology that provides infrastructure, platform and application as on demand services with low cost and rapid scalability. Infrastructure resources virtualization is the backbone of cloud computing to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIDC '14: Proceedings of the sixth international workshop on Data intensive distributed computing

June 2014

62 pages

ISBN:9781450329132

DOI:10.1145/2608020

General Chairs:
Esma Yildirim
Fatih University, Turkey
,
Mehmet Balman
VMware Inc. & Lawrence Berkeley National Lab., USA
,
Program Chair:
Esma Yildirim
Fatih University, Turkey

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Arizona: University of Arizona
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 June 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HPDC'14

Sponsor:

University of Arizona
SIGARCH

HPDC'14: The 23rd International Symposium on High-Performance Parallel and Distributed Computing

June 23 - 27, 2014

BC, Vancouver, Canada

Acceptance Rates

DIDC '14 Paper Acceptance Rate 7 of 12 submissions, 58%;

Overall Acceptance Rate 7 of 12 submissions, 58%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
211
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Beigi-Mohammadi NLitoiu M(2017)Engineering Self-Adaptive Applications on Cloud with Software Defined Networks2017 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E.2017.43(9-12)Online publication date: May-2017
https://doi.org/10.1109/IC2E.2017.43
Ben Yoo SProietti RGrani P(2017)Photonics in Data CentersOptical Switching in Next Generation Data Centers10.1007/978-3-319-61052-8_1(3-21)Online publication date: 30-Aug-2017
https://doi.org/10.1007/978-3-319-61052-8_1
Beigi-Mohammadi NKhazaei HShtern MBarna CLitoiu M(2016)On Efficiency and Scalability of Software-Defined Infrastructure for Adaptive Applications2016 IEEE International Conference on Autonomic Computing (ICAC)10.1109/ICAC.2016.39(25-34)Online publication date: Jul-2016
https://doi.org/10.1109/ICAC.2016.39
Alsmadi IZarour M(2016)Empirical Evidences in Software-Defined Network Security: A Systematic Literature ReviewInformation Fusion for Cyber-Security Analytics10.1007/978-3-319-44257-0_11(253-295)Online publication date: 22-Oct-2016
https://doi.org/10.1007/978-3-319-44257-0_11
Kumar ARao SGoswami D(2014)Greening 4-4, 1-4 Data Center NetworkProceedings of the 2014 IEEE 6th International Conference on Cloud Computing Technology and Science10.1109/CloudCom.2014.139(869-874)Online publication date: 15-Dec-2014
https://dl.acm.org/doi/10.1109/CloudCom.2014.139

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents