research-article

A Runtime Resource Management and Provisioning Middleware for Fog Computing Infrastructures

Authors:

Cristiana Bolchini,

Jorge E. OrtizAuthors Info & Claims

ACM Transactions on Internet of Things, Volume 3, Issue 3

Article No.: 17, Pages 1 - 29

https://doi.org/10.1145/3506718

Published: 11 April 2022 Publication History

Abstract

The pervasiveness and growing processing capabilities of mobile and embedded systems have enabled the widespread diffusion of the Fog Computing paradigm in the Internet of Things scenario, where computing is directly performed at the edges of the networked infrastructure in distributed cyber-physical systems. This scenario is characterized by a highly dynamic workload and architecture in which applications enter and leave the system, as well as nodes and connections. This article proposes a runtime resource management and provisioning middleware for the dynamic distribution of the applications on the processing resources. The proposed middleware consists of a two-level hierarchy: (i) a global Fog Orchestrator monitoring the architecture status and (ii) a Local Agent on each node, performing a fine-grain tuning of its resources. The co-operation between these components allows one to dynamically adapt and exploit the fine-grain nodes view for fulfilling the defined system-level goals, for example, minimizing power consumption while meeting Quality of Service requirements such as application throughput. This hierarchical architecture and the adopted policies offer a unified optimization strategy that is unique with regard to existing approaches that typically focus on a single aspect of resource management at runtime. A middleware prototype is presented and experimentally evaluated in a Smart Building case study.

References

[1]

ABB. 2020. Industrial IoT Applications. Retrieved May 4, 2020 from https://new.abb.com/control-systems/features/industrial-IoT-services-people-use-cases.

[2]

S. Ahn, M. Gorlatova, P. Naghizadeh, and M. Chiang. 2019. Personalized augmented reality via fog-based imitation learning. In Proceedings of ACM Workshop on Fog Computing and the IoT, Montreal, Quebec, Canada. ACM, 11–15.

Digital Library

[3]

Amazon. 2021. Amazon Web Services IoT. Retrieved December 3, 2021 from https://aws.amazon.com/en/iot/.

[4]

D. Angioletti, F. Bertani, C. Bolchini, F. Cerizzi, and A. Miele. 2019. A runtime resource management policy for OpenCL workloads on heterogeneous multicores. In Proceedings of Design, Automation Test in Europe Conference Exhibition, Florence, Italy. IEEE, 1385–1390.

[5]

M. S. Ardekani, R. P. Singh, N. Agrawal, D. B. Terry, and R. O. Suminto. 2017. Rivulet: A fault-tolerant platform for smart-home applications. In Proceedings of 18th ACM/IFIP/USENIX Middleware Conference, Las Vegas, NV, US. ACM, 41–54.

[6]

A. Baldassari, C. Bolchini, and A. Miele. 2017. A dynamic reliability management framework for heterogeneous multicore systems. In Proceedings of the International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems, Grenoble, France. IEEE, 1–6.

[7]

S. K. Battula, S. Garg, J. Montgomery, and B. Kang. 2020. An efficient resource monitoring service for fog computing environments. IEEE Transactions on Services Computing 13, 4 (2020), 709–722.

[8]

C. Bolchini, G. C. Durelli, A. Miele, G. Pallotta, and M. D. Santambrogio. 2015. An orchestrated approach to efficiently manage resources in heterogeneous system architectures. In Proceedings of IEEE International Conference on Computer Design, New York City, NY, USA. IEEE, 200–207.

[9]

F. Bonomi, R. Milito, P. Natarajan, and J. Zhu. 2014. Fog computing: A platform for Internet of Things and analytics. In Big Data and Internet of Things: A Roadmap for Smart Environments, N. Bessis and C. Dobre (Eds.). Springer, 169–186.

[10]

F. Bonomi, R. Milito, J. Zhu, and S. Addepalli. 2012. Fog computing and its role in the Internet of Things. In Proceedings of Workshop Mobile Cloud Computing, Helsinki, Finland. ACM, 13–16.

[11]

A. Brogi, S. Forti, and A. Ibrahim. 2017. How to best deploy your Fog applications, probably. In Proceedings of International Conference on Fog and Edge Computing, Madrid, Spain. IEEE, 105–114.

[12]

D. Chae, J. Kim, G. Lee, H. Kim, K.-A. Chang, H. Lee, and J. Kim. 2018. DynaMix: Dynamic mobile device integration for efficient cross-device resource sharing. In Proceedings of USENIX Annual Technical Conference, Boston, MA, US. USENIX Association, 71–84.

[13]

J. Chen and X. Ran. 2019. Deep learning with edge computing: A review. Proceedings of the IEEE 107, 8 (2019), 1655–1674.

[14]

A. V. Dastjerdi, H. Gupta, R. N. Calheiros, S. K. Ghosh, and R. Buyya. 2016. Fog computing: Principles, architectures, and applications. In Internet of Things: Principles and Paradigms, R. Buyya and A. V. Dastjerdi (Eds.). Elsevier, 61–75.

[15]

E. Del Sozzo, G. C. Durelli, E. Trainiti, A. Miele, M. D. Santambrogio, and C. Bolchini. 2016. Workload-aware power optimization strategy for asymmetric multiprocessors. In Proceedings of Conference on Design, Automation & Test in Europe, Dresden, Germany. IEEE, 531–534.

[16]

R. Deng, R. Lu, C. Lai, T. H. Luan, and H. Liang. 2016. Optimal workload allocation in fog-cloud computing toward balanced delay and power consumption. IEEE Internet of Things Journal 3, 6 (2016), 1171–1181.

[17]

FIWARE Foundation. 2021. FIWARE. Retrieved December 3, 2021 from https://www.fiware.org/.

[18]

E. Fraccaroli, F. Stefanni, R. Rizzi, D. Quaglia, and F. Fummi. 2018. Network synthesis for distributed embedded systems. IEEE Transactions on Computers 67, 9 (2018), 1315–1330.

Digital Library

[19]

D. Gadioli, E. Vitali, G. Palermo, and C. Silvano. 2019. mARGOt: A dynamic autotuning framework for self-aware approximate computing. IEEE Transactions on Computers 68, 5 (2019), 713–728.

[20]

J. Gascon-Samson, M. Rafiuzzaman, and K. Pattabiraman. 2017. ThingsJS: Towards a flexible and self-adaptable middleware for dynamic and heterogeneous IoT environments. In Proceedings of Workshop on Middleware and Applications for the Internet of Things, Las Vegas, NV, US. ACM, 11–16.

[21]

J. Guth, U. Breitenbücher, M. Falkenthal, P. Fremantle, O. Kopp, F. Leymann, and L. Reinfurt. 2018. A detailed analysis of IoT platform architectures: Concepts, similarities, and differences. In Internet of Everything - Technology, Communications and Computing, B. Di Martino, K.-C. Li, L. T. Yang, and A. Esposito (Eds.). Springer, 81–101.

[22]

Hardkernel co.2015. ODROID. Retrieved May 4, 2020 from http://www.hardkernel.com.

[23]

H. Hoffmann, J. Eastep, M. D. Santambrogio, J. E. Miller, and A. Agarwal. 2010. Application heartbeats for software performance and health. ACM Sigplan Notices 45, 5 (2010), 347–348.

Digital Library

[24]

C.-H. Hong and B. Varghese. 2019. Resource management in fog/edge computing: A survey on architectures, infrastructure, and algorithms. ACM Computing Surveys 52, 5 (2019), 1–37.

[25]

HSA Foundation. 2015. Retrieved May 5, 2020 from http://www.hsafoundation.com/.

[26]

A. J. Hussain, D. M. Marcinonyte, F. I. Iqbal, H. Tawfik, T. Baker, and D. Al-Jumeily. 2018. Smart home systems security. In Proceedings of IEEE International Conference on High Performance Computing and Communications; IEEE International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems, Exeter, UK. IEEE, 1422–1428.

[27]

K. Jung, J. Gascon-Samson, and K. Pattabiraman. 2019. OneOS: IoT platform based on POSIX and actors. In Proceedings of USENIX Workshop on Hot Topics in Edge Computing, Renton, WA, US. USENIX Association, 1–8.

[28]

A. Kanduri, A. Miele, A. M. Rahmani, P. Liljeberg, C. Bolchini, and N. Dutt. 2018. Approximation-aware coordinated power/performance management for heterogeneous multicores. In Proceedings of Design Automation Conference, San Francisco, CA, US. ACM, 68:1–68:6.

[29]

K. Kaur, T. Dhand, N. Kumar, and S. Zeadally. 2017. Container-as-a-service at the edge: Trade-off between energy efficiency and service availability at fog nano data centers. IEEE Wireless Communications 24, 3 (2017), 48–56.

Digital Library

[30]

Microsoft. 2021. Azure IoT Hub. Retrieved December 3, 2021 from https://azure.microsoft.com/en-us/services/iot-hub/.

[31]

I. Miell and A. H. Sayers. 2016. Docker in Practice. Manning Publications Co.

Digital Library

[32]

T. S. Muthukaruppan, M. Pricopi, V. Venkataramani, T. Mitra, and S. Vishin. 2013. Hierarchical power management for asymmetric multi-core in dark silicon era. In Proceedings of Design Automation Conference, Austin, TX, US. ACM, 174:1–174:9.

[33]

Ranesh Kumar Naha and Saurabh Garg. 2021. Multi-criteria–based dynamic user behaviour–aware resource allocation in fog computing. ACM Transactions on Internet of Things 2, 1 (2021), 1–31.

[34]

R. K. Naha, S. Garg, A. Chan, and S. K. Battula. 2020. Deadline-based dynamic resource allocation and provisioning algorithms in Fog-Cloud environment. Elsevier Future Generation Computer Systems 104 (2020), 131–141.

[35]

R. K. Naha, S. Garg, D. Georgakopoulos, P. P. Jayaraman, L. Gao, Y. Xiang, and R. Ranjan. 2018. Fog computing: Survey of trends, architectures, requirements, and research directions. IEEE Access 6 (2018), 47980–48009.

[36]

NVIDIA. 2017. NVIDIA Jetson TX2 Developer Board. Retrieved May 4, 2020 from https://developer.nvidia.com/embedded/buy/jetson-tx2-devkit.

[37]

OpenFog Consortium. 2020. OpenFog Consortium. Retrieved May 4 2020 from https://www.openfogconsortium.org. Accessed: 2020-04-05.

[38]

C. Perera, Y. Qin, J. C. Estrella, S. Reiff-Marganiec, and A. V. Vasilakos. 2017. Fog computing for sustainable smart cities: A survey. ACM Computing Surveys 50, 3, Article 32 (2017), 1–43.

[39]

Raspberry Pi Foundation. 2016. Raspberry Pi. Retrieved May 4, 2020 from https://www.raspberrypi.org.

[40]

Samsung Inc.2021. SmartThings. Retrieved December 3, 2021 from http://www.smartthings.com/.

[41]

S. Sarkar, S. Chatterjee, and S. Misra. 2018. Assessment of the suitability of fog computing in the context of Internet of Things. IEEE Transactions on Cloud Computing 6, 1 (2018), 46–59.

[42]

C. Shen, R. P. Singh, A. Phanishayee, A. Kansal, and R. Mahajan. 2016. Beam: Ending monolithic applications for connected devices. In Proceedings of USENIX Annual Technical Conference, Denver, CO, US. USENIX Association, 143–157.

[43]

A. K. Singh, A. Prakash, K. R. Basireddy, G. V. Merrett, and B. M. Al-Hashimi. 2017. Energy-efficient run-time mapping and thread partitioning of concurrent OpenCL applications on CPU-GPU MPSoCs. ACM Transactions on Embedded Computing Systems 16, 5s (2017), 147:1–147:22.

[44]

O. Skarlat, M. Nardelli, S. Schulte, M. Borkowski, and P. Leitner. 2017. Optimized IoT service placement in the fog. Springer Service Oriented Computing and Applications 11, 4 (2017), 427–443.

[45]

E. Sturzinger, M. Tornatore, and B. Mukherjee. 2017. Application-aware resource provisioning in a heterogeneous Internet of Things. In Proceedings of International Conference on Optical Network Design and Modeling, Budapest, Hungary. IEEE, 1–6.

[46]

M. Taneja and A. Davy. 2017. Resource aware placement of IoT application modules in fog-cloud computing paradigm. In Proceedings of Symposium on Integrated Network and Service Management, Lisbon, Portugal. IEEE, 1222–1228.

[47]

G. Tanganelli, L. Cassano, A. Miele, and C. Vallati. 2020. A methodology for the design and deployment of distributed cyber-physical systems for smart environments. Elsevier Future Generation Computer Systems 109 (2020), 420–430.

[48]

S. Tomovic, K. Yoshigoe, I. Maljevic, and I. Radusinovic. 2017. Software-defined fog network architecture for IoT. Springer Wireless Personal Communications 92 (2017), 181–196.

[49]

N. Wang, B. Varghese, M. Matthaiou, and D. S. Nikolopoulos. 2020. ENORM: A framework for edge node resource management. IEEE Transactions on Services Computing 13, 6 (2020), 1086–1099.

[50]

S. Yi, Z. Hao, Q. Zhang, Q. Zhang, W. Shi, and Q. Li. 2017. LAVEA: Latency-aware video analytics on edge computing platform. In Proceedings of ACM/IEEE Symposium on Edge Computing, San Jose, CA. ACM/IEEE, 2573–2574.

Cited By

Shahsavari SHaghbayan HMiele AImmonen EPlosila J(2025)A Coordinated Approach to Control Mechanical and Computing Resources in Mobile RobotsIEEE Transactions on Robotics10.1109/TRO.2024.349234541(347-363)Online publication date: 2025
https://doi.org/10.1109/TRO.2024.3492345
Sochovsky JKaragiannis VEdinger JKaaser DSchulte S(2024)A Framework for Dynamic Dependency-based Service Placement in the Cloud-Edge Continuum2024 IEEE 44th International Conference on Distributed Computing Systems Workshops (ICDCSW)10.1109/ICDCSW63686.2024.00021(102-112)Online publication date: 23-Jul-2024
https://doi.org/10.1109/ICDCSW63686.2024.00021
Shahinifar SKheirabadi MBroumandnia ARahbar K(2024)Fog-Marketing: auction-based multi-tier decentralized markets for fog resource provisioningThe Journal of Supercomputing10.1007/s11227-024-06081-180:11(15917-15939)Online publication date: 8-Apr-2024
https://dl.acm.org/doi/10.1007/s11227-024-06081-1

Index Terms

A Runtime Resource Management and Provisioning Middleware for Fog Computing Infrastructures
1. Computer systems organization
  1. Architectures
    1. Distributed architectures
  2. Embedded and cyber-physical systems
    1. Embedded systems

Recommendations

A Pattern for Fog Computing
VikingPLoP '16: Proceedings of the 10th Travelling Conference on Pattern Languages of Programs

Fog Computing is a new variety of the cloud computing paradigm that brings virtualized cloud services to the edge of the network to control the devices in the IoT. We present a pattern for fog computing which describes its architecture, including its ...
Fog Computing: Issues and Challenges in Security and Forensics
COMPSAC '15: Proceedings of the 2015 IEEE 39th Annual Computer Software and Applications Conference - Volume 03

Although Fog Computing is defined as the extension of the Cloud Computing paradigm, its distinctive characteristics in the location sensitivity, wireless connectivity, and geographical accessibility create new security and forensics issues and ...
Fog Computing Qos Review and Open Challenges

Internet of Things (IoT) enables inters connectivity among devices and platforms. IoT devices such as sensors, or embedded systems offer computational, storage, and networking resources and the existence of these resources permits to move the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Internet of Things

ACM Transactions on Internet of Things Volume 3, Issue 3

August 2022

251 pages

EISSN:2577-6207

DOI:10.1145/3514184

Editors:
Schahram Dustdar
TU Wien, Austria
,
Gian Pietro Picco
University of Trento, Italy

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 11 April 2022

Accepted: 01 December 2021

Revised: 01 November 2021

Received: 01 July 2020

Published in TIOT Volume 3, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
555
Total Downloads

Downloads (Last 12 months)103
Downloads (Last 6 weeks)14

Reflects downloads up to 26 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shahsavari SHaghbayan HMiele AImmonen EPlosila J(2025)A Coordinated Approach to Control Mechanical and Computing Resources in Mobile RobotsIEEE Transactions on Robotics10.1109/TRO.2024.349234541(347-363)Online publication date: 2025
https://doi.org/10.1109/TRO.2024.3492345
Sochovsky JKaragiannis VEdinger JKaaser DSchulte S(2024)A Framework for Dynamic Dependency-based Service Placement in the Cloud-Edge Continuum2024 IEEE 44th International Conference on Distributed Computing Systems Workshops (ICDCSW)10.1109/ICDCSW63686.2024.00021(102-112)Online publication date: 23-Jul-2024
https://doi.org/10.1109/ICDCSW63686.2024.00021
Shahinifar SKheirabadi MBroumandnia ARahbar K(2024)Fog-Marketing: auction-based multi-tier decentralized markets for fog resource provisioningThe Journal of Supercomputing10.1007/s11227-024-06081-180:11(15917-15939)Online publication date: 8-Apr-2024
https://dl.acm.org/doi/10.1007/s11227-024-06081-1

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents