Performance-Aware Orchestration of P4-Based Heterogeneous Cloud Environments
Authors: 
Hasanin Harkous, Bassel Aboul Hosn, Mu He, Michael Jarschel, Rastin Pries, Wolfgang KellererAuthors Info & Claims
Hasanin Harkous, Bassel Aboul Hosn, Mu He, Michael Jarschel, Rastin Pries, Wolfgang KellererAuthors Info & ClaimsPages 4765 - 4778
Abstract
The recent trend to deploy programmable packet processors in cloud environaxsxsments enhances the packet processing capability without losing the flexibility to adapt the functions at runtime. In particular, distributed edge clouds can have a heterogeneous programmable processing substrate made up of different classes of devices: CPUs, NPUs, FPGAs, etc. However, managing the allocation of workloads in such a heterogeneous programmable processing substrate, in particular deciding where to instantiate a certain function, is a non-trivial task with many decisive functional and QoS-related factors. In this paper, we propose a mathematical model for optimizing the embedding of Service Function Chains implemented in P4, while considering the functional and QoS requirements associated with embedding requests, and the various types of processing devices that have different properties in terms of processing delay and supported features. To satisfy delay requirements, the problem formulation utilizes performance models to predict the forwarding latency associated with different candidate embedding options. Furthermore, a greedy solution is proposed to solve the problem in an efficient manner. Finally, a detailed numerical evaluation is conducted to evaluate the formulated model when different workload and infrastructure characteristics are varied and to evaluate the effectiveness of the proposed greedy solution.
References
[1]
W. Zhang, S. Li, L. Liu, Z. Jia, Y. Zhang, and D. Raychaudhuri, “Hetero-edge: Orchestration of real-time vision applications on heterogeneous edge clouds,” in Proc. IEEE INFOCOM Conf. Comput. Commun., 2019, pp. 1270–1278.
[2]
M. He, A. Basta, A. Blenk, N. Deric, and W. Kellerer, “P4NFV: An NFV architecture with flexible data plane reconfiguration,” in Proc. IEEE Int. Conf. Netw. Service Manag. (CNSM), 2018, pp. 90–98.
[3]
P. Bosshartet al., “P4: Programming protocol-independent packet processors,” ACM SIGCOMM Comput. Commun. Rev., vol. 44, no. 3, pp. 87–95, 2014.
[4]
H. Harkous, M. Jarschel, M. He, R. Priest, and W. Kellerer, “Towards understanding the performance of P4 programmable hardware,” in Proc. ACM/IEEE Symp. Archit. Netw. Commun. Syst. (ANCS), 2019, pp. 1–6.
[5]
H. Harkous, M. Jarschel, M. He, R. Pries, and W. Kellerer, “P8: P4 with predictable packet processing performance,” IEEE Trans. Netw. Service Manag., vol. 18, no. 3, pp. 2846–2859, Sep. 2021.
[6]
H. Harkous, B. A. Hosn, M. He, M. Jarschel, R. Pries, and W. Kellerer, “Towards performance-aware management of P4-based cloud environments,” in Proc. IEEE Conf. Netw. Function Virtual. Softw. Defined Netw. (NFV-SDN), 2021, pp. 87–90.
[7]
R. Mijumbi, J. Serrat, J.-L. Gorricho, N. Bouten, F. De Turck, and R. Boutaba, “Network function virtualization: State-of-the-art and research challenges,” IEEE Commun. Surveys Tuts., vol. 18, no. 1, pp. 236–262, 1st Quart., 2016.
[8]
W. Chen, X. Yin, Z. Wang, and X. Shi, “Placement and routing optimization problem for service function chain: State of art and future opportunities,” 2019, arxiv.abs/1910.02613.
[9]
F. Bari, S. R. Chowdhury, R. Ahmed, R. Boutaba, and O. C. M. B. Duarte, “Orchestrating virtualized network functions,” IEEE Trans. Netw. Service Manag., vol. 13, no. 4, pp. 725–739, Dec. 2016.
[10]
G. P. Sharma, W. Tavernier, D. Colle, and M. Pickavet “VNF-AAPC: Accelerator-Aware VNF Placement and Chaining.” Mar. 2020. [Online]. Available: https://hal.archives-ouvertes.fr/hal-02517141
[11]
A. Mohammadkhan, S. Panda, S. G. Kulkarni, K. K. Ramakrishnan, and L. N. Bhuyan, “P4NFV: P4 enabled NFV systems with smartNICs,” in Proc. IEEE Conf. Netw. Function Virtual. Softw. Defined Netw. (NFV-SDN), 2019, pp. 1–7.
[12]
S. Wanget al., “SmartChain: Enabling high-performance service chain partition between SmartNIC and CPU,” in Proc. IEEE Int. Conf. Commun. (ICC), 2020, pp. 1–7.
[13]
S. Niket al., “Flightplan: Dataplane disaggregation and placement for P4 programs,” in Proc. 18th USENIX Symp. Netw. Syst. Design Implement. (NSDI), Apr. 2021, pp. 571–592.
[14]
X. Chenet al., “LightNF: Simplifying network function offloading in programmable networks,” in Proc. IEEE/ACM 29th Int. Symp. Qual. Service (IWQOS), 2021, pp. 1–10.
[15]
D. Moro, G. Verticale, and A. Capone, “A framework for network function decomposition and deployment,” in Proc. IEEE 16th Int. Conf. Design Rel. Commun. Netw. (DRCN), 2020, pp. 1–6.
[16]
J. Yen, J. Wang, S. Supittayapornpong, M. A. Vieira, R. Govindan, and B. Raghavan, “Meeting SLOS in cross-platform NFV,” in Proc. 16th Int. Conf. Emerg. Netw. Exp. Technol., 2020, pp. 509–523.
[17]
H. Soni, M. Rifai, P. Kumar, R. Doenges, and N. Foster, “Composing dataplane programs with μP4,” in Proc. Annu. Conf. ACM Special Interest Group Data Commun. Appl. Technol. Archit. Protocols Comput. Commun. (SIGCOMM), 2020, pp. 329–343.
[18]
D. Scholz, H. Stubbe, S. Gallenmüller, and G. Carle, “Key properties of programmable data plane targets,” in Proc. 32nd Int. Teletraffic Congr. (ITC), Osaka, Japan, 2020, pp. 114–122.
[19]
D. Scholzet al., “Cryptographic hashing in P4 data planes,” in Proc. ACM/IEEE Symp. Archit. Netw. Commun. Syst. (ANCS), 2019, pp. 1–6.
[20]
H. Harkous, M. He, M. Jarschel, R. Pries, E. Mansour, and W. Kellerer, “Performance study of P4 programmable devices: Flow scalability and rule update responsiveness,” in Proc. IFIP Netw. Conf. (IFIP Netw.), 2021, pp. 1–6.
[21]
“NFE-3240 Appliance Adapters.” 2016. [Online]. Available: https://www.netronome.com/media/redactor_files/PB_NFE-3240_App_Adapter.pdf
[22]
“Intel® Xeon® Platinum 8156 Processor.” Accessed: Jan. 10, 2023. [Online]. Available: https://ark.intel.com/content/www/us/en/ark/products/120499/intel-xeon-platinum-8156-processor-16-5m-cache-3-60-ghz.html
[23]
P. Bressana, N. Zilberman, D. Vucinic, and R. Soulé, “Trading latency for compute in the network,” in Proc. Workshop Netw. Appl. Integr. CoDesign (NAI), 2020, pp. 35–40. [Online]. Available: https://doi.org/10.1145/3405672.3405807
[24]
“NetFPGA-SUMETMReference Manual.” 2016. [Online]. Available: https://digilent.com/reference/_media/sume:netfpga-sume_rm.pdf
[25]
“Moses, Spider_Plot.” Accessed: Jun. 2, 2022. [Online]. Available: https://github.com/NewGuy012/spider_plot/releases/tag/17.8
[26]
Gurobi Optimization, LLC. “Gurobi Optimizer Reference Manual.” 2021. [Online]. Available: https://www.gurobi.com
[27]
W. S. Liuet al., “Service function chaining (SFC) use cases,” Internet Eng. Task Force, Fremont, CA, USA, Internet-Draft draft-liu-sfc-use-cases-06, 2014. [Online]. Available: https://datatracker.ietf.org/doc/html/draft-liu-sfc-use-cases-06
[28]
W. Haeffner, J. Napper, M. Stiemerling, D. Lopez, and J. Uttaro, “Service function chaining use cases in mobile networks,” Internet Eng. Task Force, Fremont, CA, USA, Internet-Draft draft-ietf-sfc-use-case-mobility-09, Jan. 2019. [Online]. Available: https://datatracker.ietf.org/doc/html/draft-ietf-sfc-use-case-mobility-09
[29]
D. A. Joseph, A. Tavakoli, and I. Stoica, “A policy-aware switching layer for data Centers,” SIGCOMM Comput. Commun. Rev., vol. 38, no. 4, pp. 51–62, Aug. 2008. [Online]. Available: https://doi.org/10.1145/1402946.1402966
Index Terms
- Performance-Aware Orchestration of P4-Based Heterogeneous Cloud Environments
Index terms have been assigned to the content through auto-classification.
Recommendations
GPU-aware resource management in heterogeneous cloud data centers
AbstractThe power of rapid scalability and easy maintainability of cloud services is driving many high-performance computing applications from company server racks into cloud data centers. With the evolution of Graphics Processing Units, composing of an ...
Engaging Heterogeneous FPGAs in the Cloud
FPGA '19: Proceedings of the 2019 ACM/SIGDA International Symposium on Field-Programmable Gate ArraysFPGA has become an essential infrastructural component in commercial cloud and datacenter for improving system performance and efficiency. Meanwhile, a heterogeneous FPGA chip (Hetero-FPGA) in which a multi-core System-on-Chip (SoC) is tightly ...
Towards Secure Cloud Orchestration for Multi-Cloud Deployments
CrossCloud'18: Proceedings of the 5th Workshop on CrossCloud Infrastructures & PlatformsCloud orchestration frameworks are commonly used to deploy and operate cloud infrastructure. Their role spans both vertically (deployment on infrastructure, platform, application and microservice levels) and horizontally (deployments from many distinct ...
Comments
Information & Contributors
Information
Published In
1932-4537 © 2023 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information.
Publisher
IEEE Press
Publication History
Published: 18 April 2023
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 15 Jan 2025