Cited By
View all- Jamaludin MTsai YLin HHuang CChoi WChen JSean W(2024)Modeling and Control Strategies for Energy Management in a Wastewater Center: A Review on AerationEnergies10.3390/en1713316217:13(3162)Online publication date: 27-Jun-2024
A Stochastic Online Forecast-and-Optimize Framework for Real-Time Energy Dispatch in Virtual Power Plants under Uncertainty
Authors: 
Wei Jiang, Zhongkai Yi, Li Wang, Hanwei Zhang, Jihai Zhang, Fangquan Lin, Cheng YangAuthors Info & Claims
Wei Jiang, Zhongkai Yi, Li Wang, Hanwei Zhang, Jihai Zhang, Fangquan Lin, Cheng YangAuthors Info & ClaimsPages 4646 - 4652
Abstract
Aggregating distributed energy resources in power systems significantly increases uncertainties, in particular caused by the fluctuation of renewable energy generation. This issue has driven the necessity of widely exploiting advanced predictive control techniques under uncertainty to ensure long-term economics and decarbonization. In this paper, we propose a real-time uncertainty-aware energy dispatch framework, which is composed of two key elements: (i) A hybrid forecast-and-optimize sequential task, integrating deep learning-based forecasting and stochastic optimization, where these two stages are connected by the uncertainty estimation at multiple temporal resolutions; (ii) An efficient online data augmentation scheme, jointly involving model pre-training and online fine-tuning stages. In this way, the proposed framework is capable to rapidly adapt to the real-time data distribution, as well as to target on uncertainties caused by data drift, model discrepancy and environment perturbations in the control process, and finally to realize an optimal and robust dispatch solution. The proposed framework won the championship in CityLearn Challenge 2022, which provided an influential opportunity to investigate the potential of AI application in the energy domain. In addition, comprehensive experiments are conducted to interpret its effectiveness in the real-life scenario of smart building energy management.
Supplementary Material
Presentation video
- Download
- 325.51 MB
References
[1]
Paul D Arendt, Daniel W Apley, and Wei Chen. 2012. Quantification of Model Uncertainty: Calibration, Model Discrepancy, and Identifiability. Journal of mechanical design, Vol. 134, 10 (2012).
[2]
Javier Arroyo, Carlo Manna, Fred Spiessens, and Lieve Helsen. 2022. Reinforced model predictive control (RL-MPC) for building energy management. Applied Energy, Vol. 309 (2022), 118346.
[3]
Karl J Åström and Björn Wittenmark. 2013. Adaptive control. Courier Corporation.
[4]
Ben Athiwaratkun and Jack W Stokes. 2017. Malware classification with LSTM and GRU language models and a character-level CNN. In 2017 IEEE international conference on acoustics, speech and signal processing (ICASSP). IEEE, 2482--2486.
[5]
Julian Berberich, Johannes Köhler, Matthias A Müller, and Frank Allgöwer. 2020. Data-driven model predictive control with stability and robustness guarantees. IEEE Trans. Automat. Control, Vol. 66, 4 (2020), 1702--1717.
[6]
Eric Bradford, Lars Imsland, Dongda Zhang, and Ehecatl Antonio del Rio Chanona. 2020. Stochastic data-driven model predictive control using gaussian processes. Computers & Chemical Engineering, Vol. 139 (2020), 106844.
[7]
Monimoy Bujarbaruah, Xiaojing Zhang, Ugo Rosolia, and Francesco Borrelli. 2018. Adaptive MPC for iterative tasks. In 2018 IEEE Conference on Decision and Control (CDC). IEEE, 6322--6327.
[8]
Eduardo F Camacho and Carlos Bordons Alba. 2013. Model predictive control. Springer science & business media.
[9]
Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, and Yoshua Bengio. 2014. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555 (2014).
[10]
Ján Drgovn a, Javier Arroyo, Iago Cupeiro Figueroa, David Blum, Krzysztof Arendt, Donghun Kim, Enric Perarnau Ollé, Juraj Oravec, Michael Wetter, Draguna L Vrabie, et al. 2020. All you need to know about model predictive control for buildings. Annual Reviews in Control, Vol. 50 (2020), 190--232.
[11]
Adam N Elmachtoub and Paul Grigas. 2022. Smart ?predict, then optimize". Management Science, Vol. 68, 1 (2022), 9--26.
[12]
Damien Ernst, Mevludin Glavic, Florin Capitanescu, and Louis Wehenkel. 2008. Reinforcement learning versus model predictive control: a comparison on a power system problem. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), Vol. 39, 2 (2008), 517--529.
[13]
Jo ao Gama, Indr.e vZ liobait.e, Albert Bifet, Mykola Pechenizkiy, and Abdelhamid Bouchachia. 2014. A survey on concept drift adaptation. ACM computing surveys (CSUR), Vol. 46, 4 (2014), 1--37.
[14]
Saleh Sadeghi Gougheri, Hamidreza Jahangir, Mahsa A Golkar, Ali Ahmadian, and Masoud Aliakbar Golkar. 2021. Optimal participation of a virtual power plant in electricity market considering renewable energy: A deep learning-based approach. Sustainable Energy, Grids and Networks, Vol. 26 (2021), 100448.
[15]
Tor Aksel N Heirung, Joel A Paulson, Jared O'Leary, and Ali Mesbah. 2018. Stochastic model predictive control-how does it work? Computers & Chemical Engineering, Vol. 114 (2018), 158--170.
[16]
Luis Hernández, Carlos Baladron, Javier M Aguiar, Belen Carro, Antonio Sanchez-Esguevillas, Jaime Lloret, David Chinarro, Jorge J Gomez-Sanz, and Diane Cook. 2013. A multi-agent system architecture for smart grid management and forecasting of energy demand in virtual power plants. IEEE Communications Magazine, Vol. 51, 1 (2013), 106--113.
[17]
Lukas Hewing, Kim P Wabersich, Marcel Menner, and Melanie N Zeilinger. 2020. Learning-based model predictive control: Toward safe learning in control. Annual Review of Control, Robotics, and Autonomous Systems, Vol. 3 (2020), 269--296.
[18]
Petros A Ioannou and Jing Sun. 2012. Robust adaptive control. Courier Corporation.
[19]
Achin Jain, Francesco Smarra, and Rahul Mangharam. 2017. Data predictive control using regression trees and ensemble learning. In 2017 IEEE 56th annual conference on decision and control (CDC). IEEE, 4446--4451.
[20]
Anjukan Kathirgamanathan, Kacper Twardowski, Eleni Mangina, and Donal P. Finn. 2020. A Centralised Soft Actor Critic Deep Reinforcement Learning Approach to District Demand Side Management through CityLearn. In Proceedings of the 1st International Workshop on Reinforcement Learning for Energy Management in Buildings & Cities (Virtual Event, Japan) (RLEM'20). Association for Computing Machinery, New York, NY, USA, 11--14. https://doi.org/10.1145/3427773.3427869
[21]
Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In Proceedings of the 31st International Conference on Neural Information Processing Systems (Long Beach, California, USA) (NIPS'17). Curran Associates Inc., Red Hook, NY, USA, 3149--3157.
[22]
Xiangyu Kong, Jie Xiao, Dehong Liu, Jianzhong Wu, Chengshan Wang, and Yu Shen. 2020. Robust stochastic optimal dispatching method of multi-energy virtual power plant considering multiple uncertainties. Applied Energy, Vol. 279 (2020), 115707.
[23]
Samir Kouro, Patricio Cortés, René Vargas, Ulrich Ammann, and José Rodr'iguez. 2008. Model predictive control-A simple and powerful method to control power converters. IEEE Transactions on industrial electronics, Vol. 56, 6 (2008), 1826--1838.
[24]
Fiorella Lauro, Luca Longobardi, and Stefano Panzieri. 2014. An adaptive distributed predictive control strategy for temperature regulation in a multizone office building. In 2014 IEEE international workshop on intelligent energy systems (IWIES). IEEE, 32--37.
[25]
Xiaoqi Liu, Parth Paritosh, Nimish M Awalgaonkar, Ilias Bilionis, and Panagiota Karava. 2018. Model predictive control under forecast uncertainty for optimal operation of buildings with integrated solar systems. Solar energy, Vol. 171 (2018), 953--970.
[26]
Pamela MacDougall, Anna Magdalena Kosek, Hendrik Bindner, and Geert Deconinck. 2016. Applying machine learning techniques for forecasting flexibility of virtual power plants. In 2016 IEEE electrical power and energy conference (EPEC). IEEE, 1--6.
[27]
MindOpt. 2022. MindOpt Studio. https://opt.aliyun.com
[28]
K Muralitharan, Rathinasamy Sakthivel, and R Vishnuvarthan. 2018. Neural network based optimization approach for energy demand prediction in smart grid. Neurocomputing, Vol. 273 (2018), 199--208.
[29]
Seyyed Mostafa Nosratabadi, Rahmat-Allah Hooshmand, and Eskandar Gholipour. 2017. A comprehensive review on microgrid and virtual power plant concepts employed for distributed energy resources scheduling in power systems. Renewable and Sustainable Energy Reviews, Vol. 67 (2017), 341--363.
[30]
Kingsley Nweye, Sankaranarayanan Siva, and Gyorgy Zoltan Nagy. 2023. The CityLearn Challenge 2022. https://doi.org/10.18738/T8/0YLJ6Q
[31]
Daniel E Olivares, Ali Mehrizi-Sani, Amir H Etemadi, Claudio A Ca nizares, Reza Iravani, Mehrdad Kazerani, Amir H Hajimiragha, Oriol Gomis-Bellmunt, Maryam Saeedifard, Rodrigo Palma-Behnke, et al. 2014. Trends in microgrid control. IEEE Transactions on smart grid, Vol. 5, 4 (2014), 1905--1919.
[32]
Joel A Paulson, Edward A Buehler, Richard D Braatz, and Ali Mesbah. 2020. Stochastic model predictive control with joint chance constraints. Internat. J. Control, Vol. 93, 1 (2020), 126--139.
[33]
James B Rawlings. 2000. Tutorial overview of model predictive control. IEEE control systems magazine, Vol. 20, 3 (2000), 38--52.
[34]
Chao Shang and Fengqi You. 2019. A data-driven robust optimization approach to scenario-based stochastic model predictive control. Journal of Process Control, Vol. 75 (2019), 24--39.
[35]
Francesco Smarra, Achin Jain, Tullio De Rubeis, Dario Ambrosini, Alessandro D'Innocenzo, and Rahul Mangharam. 2018. Data-driven model predictive control using random forests for building energy optimization and climate control. Applied energy, Vol. 226 (2018), 1252--1272.
[36]
Yuanhang Su and C.-C. Jay Kuo. 2019. On Extended Long Short-Term Memory and Dependent Bidirectional Recurrent Neural Network. Neurocomput., Vol. 356, C (sep 2019), 151--161. https://doi.org/10.1016/j.neucom.2019.04.044
[37]
W Razia Sultana, Sarat Kumar Sahoo, Sukruedee Sukchai, S Yamuna, and D Venkatesh. 2017. A review on state of art development of model predictive control for renewable energy applications. Renewable and sustainable energy reviews, Vol. 76 (2017), 391--406.
[38]
Akin Tascikaraoglu, Ozan Erdinc, Mehmet Uzunoglu, and Arif Karakas. 2014. An adaptive load dispatching and forecasting strategy for a virtual power plant including renewable energy conversion units. Applied energy, Vol. 119 (2014), 445--453.
[39]
Konstantinos Varelas, Anne Auger, Dimo Brockhoff, Nikolaus Hansen, Ouassim Ait ElHara, Yann Semet, Rami Kassab, and Frédéric Barbaresco. 2018. A comparative study of large-scale variants of CMA-ES. In Parallel Problem Solving from Nature--PPSN XV: 15th International Conference, Coimbra, Portugal, September 8--12, 2018, Proceedings, Part I 15. Springer, 3--15.
[40]
José R Vázquez-Canteli, Jérôme K"ampf, Gregor Henze, and Zoltan Nagy. 2019. CityLearn v1.0: An OpenAI gym environment for demand response with deep reinforcement learning. In Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation. 356--357.
[41]
Cheng Wang, Hongting Hua, He Peng, and Ze Wang. 2021. Adaptive Control for Parallel-Connected Energy Storage Converters with Line Parameter Mismatch. Frontiers in Energy Research (2021), 599.
[42]
Yang Wang and Stephen Boyd. 2009. Fast model predictive control using online optimization. IEEE Transactions on control systems technology, Vol. 18, 2 (2009), 267--278.
[43]
Shuhao Yan, Paul Goulart, and Mark Cannon. 2018. Stochastic model predictive control with discounted probabilistic constraints. In 2018 European Control Conference (ECC). IEEE, 1003--1008.
[44]
Chao Yu, Akash Velu, Eugene Vinitsky, Jiaxuan Gao, Yu Wang, Alexandre Bayen, and Yi Wu. 2021. The Surprising Effectiveness of PPO in Cooperative Multi-Agent Games. (2021).
[45]
Songyuan Yu, Fang Fang, Yajuan Liu, and Jizhen Liu. 2019. Uncertainties of virtual power plant: Problems and countermeasures. Applied energy, Vol. 239 (2019), 454--470.
Index Terms
- A Stochastic Online Forecast-and-Optimize Framework for Real-Time Energy Dispatch in Virtual Power Plants under Uncertainty
Recommendations
Real-time Electric Vehicle Load Forecast to Meet Timely Energy Dispatch
2018 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI)Electric vehicles are more eco-friendly and energy efficient than the conventional internal combustion engine vehicles. This technology adds new challenge to the existing energy distribution network. Specifically, electric vehicles are allowed to start ...
Decentralized energy management system of distributed energy resources as virtual power plant: Economic risk analysis via downside risk constraints technique
Highlights- Renewable generation-based virtual power plant (VPP) in electricity market is studied.
AbstractA virtual power plant (VPP), as a decentralized energy management system (EMS), can be a handy application to aggregate and schedule distributed energy resources (DER). The DERs can be dispatchable and non-dispatchable energy resources ...
Coordination Dispatch of Electric Vehicles Charging/Discharging and Renewable Energy Resources Power in Microgrid
A large number of distributed powers access to the distribution network have a multifaceted impact on the power grid, while microgrid is an effective way to solve the impact of distributed generation on the power grid. In microgrid, the proportion of ...
Comments
Information & Contributors
Information
Published In
October 2023
5508 pages
ISBN:9798400701245
DOI:10.1145/3583780
- General Chairs:
- Ingo Frommholz,
- Frank Hopfgartner,
- Mark Lee,
- Michael Oakes,
- Program Chairs:
- Mounia Lalmas,
- Min Zhang,
- Rodrygo Santos
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 21 October 2023
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
CIKM '23: The 32nd ACM International Conference on Information and Knowledge Management
October 21 - 25, 2023
Birmingham, United Kingdom
Acceptance Rates
Overall Acceptance Rate 1,861 of 8,427 submissions, 22%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 183Total Downloads
- Downloads (Last 12 months)152
- Downloads (Last 6 weeks)5
Reflects downloads up to 13 Jan 2025
Other Metrics
Citations
Cited By
View all- Jamaludin MTsai YLin HHuang CChoi WChen JSean W(2024)Modeling and Control Strategies for Energy Management in a Wastewater Center: A Review on AerationEnergies10.3390/en1713316217:13(3162)Online publication date: 27-Jun-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in