Numerical Solution of an Optimal Control Problem with Probabilistic and Almost Sure State Constraints
Abstract
We consider the optimal control of a PDE with random source term subject to probabilistic or almost sure state constraints. In the main theoretical result, we provide an exact formula for the Clarke subdifferential of the probability function without a restrictive assumption made in an earlier paper. The focus of the paper is on numerical solution algorithms. As for probabilistic constraints, we apply the method of spherical radial decomposition. Almost sure constraints are dealt with a Moreau–Yosida smoothing of the constraint function accompanied by Monte Carlo sampling of the given distribution or its support or even just the boundary of its support. Moreover, one can understand the almost sure constraint as a probabilistic constraint with safety level one which offers yet another perspective. Finally, robust optimization can be applied efficiently when the support is sufficiently simple. A comparative study of these five different methodologies is carried out and illustrated.
References
[1]
Alexanderian A, Petra N, Stadler G, and Ghattas O Mean-variance risk-averse optimal control of systems governed by PDEs with random parameter fields using quadratic approximations SIAM/ASA J. Uncertain. Quantif. 2017 5 1 1166-1192
[2]
Ali AA, Ullmann E, and Hinze M Multilevel Monte Carlo analysis for optimal control of elliptic PDEs with random coefficients SIAM/ASA J. Uncertain. Quantif. 2017 5 1 466-492
[3]
Alla A, Hinze M, Kolvenbach P, Lass O, and Ulbrich S A certified model reduction approach for robust parameter optimization with PDE constraints Adv. Comput. Math. 2019 45 3 1221-1250
[4]
Alnæs MS, Blechta J, Hake J, Johansson A, Kehlet B, Logg A, Richardson C, Ring J, Rognes ME, and Wells GN The FEniCS project version 1.5 Arch. Numer. Softw. 2015 3 100 9-23
[5]
Alphonse, A., Geiersbach, C., Hintermüller, M., Surowiec, T. M.: Risk-averse optimal control of random elliptic variational inequalities. arXiv preprint arXiv:2210.03425 (2022)
[6]
Antil, H., Dolgov, S., Onwunta, A.: State-constrained optimization problems under uncertainty: a tensor train approach. arXiv preprint arXiv:2301.08684 (2023)
[7]
Benner P, Onwunta A, and Stoll M Block-diagonal preconditioning for optimal control problems constrained by PDEs with uncertain inputs SIAM J. Matrix Anal. Appl. 2016 37 2 491-518
[8]
Bonnans JF and Shapiro A Perturbation Analysis of Optimization Problems 2013 New York Springer Science & Business Media
[9]
Caillau J-B, Cerf M, Sassi A, Trélat E, and Zidani H Solving chance constrained optimal control problems in aerospace via kernel density estimation Optim. Control Appl. Methods 2018 39 5 1833-1858
[10]
Charnes A, Cooper WW, and Symonds GH Cost horizons and certainty equivalents: An approach to stochastic programming of heating oil Manage. Sci. 1958 4 3 235-263
[11]
Chen P and Ghattas O Taylor approximation for chance constrained optimization problems governed by partial differential equations with high-dimensional random parameters SIAM/ASA J. Uncertain. Quantif. 2021 9 4 1381-1410
[12]
Chen P and Quarteroni A Weighted reduced basis method for stochastic optimal control problems with elliptic PDE constraint SIAM/ASA J. Uncertain. Quantif. 2014 2 1 364-396
[13]
Chen P, Quarteroni A, and Rozza G Multilevel and weighted reduced basis method for stochastic optimal control problems constrained by Stokes equations Numer. Math. 2016 133 1 67-102
[14]
Clarke FH Optimization and Nonsmooth Analysis 1983 New York Wiley
[15]
Conti S, Held H, Pach M, Rumpf M, and Schultz R Shape optimization under uncertainty-a stochastic programming perspective SIAM J. Optim. 2009 19 4 1610-1632
[16]
Conti S, Held H, Pach M, Rumpf M, and Schultz R Risk averse shape optimization SIAM J. Optim. 2011 49 3 927-947
[17]
Fang K and Kotz S Symmetric multivariate and related distributions 1990 London Chapman and Hall
[18]
Farshbaf-Shaker MH, Henrion R, and Hömberg D Properties of chance constraints in infinite dimensions with an application to PDE constrained optimization Set-Valued Var. Anal 2018 26 821-841
[19]
Farshbaf-Shaker MH, Gugat M, Heitsch H, and Henrion R Optimal Neumann boundary control of a vibrating string with uncertain initial data and probabilistic terminal constraints SIAM J. Optim. 2020 58 4 2288-2311
[20]
Gahururu DB, Hintermüller M, and Surowiec TM Risk-neutral PDE-constrained generalized Nash equilibrium problems Math. Program. 2023 198 2 1287-1337
[21]
Garreis S and Ulbrich M Constrained optimization with low-rank tensors and applications to parametric problems with PDEs SIAM J. Sci. Comput. 2017 39 1 A25-A54
[22]
Geiersbach C and Henrion R Optimality conditions in control problems with random state constraints in probabilistic or almost sure form Math. Oper. Res. 2024
[23]
Geiersbach, C., Hintermüller, M.: Optimality conditions and Moreau–Yosida regularization for almost sure state constraints. ESAIM: COCV, 28, 80 (2022)
[24]
Geiersbach Caroline and Pflug Georg Ch Projected stochastic gradients for convex constrained problems in Hilbert spaces SIAM J. Optim. 2019 29 3 2079-2099
[25]
Geiersbach C and Scarinci T A stochastic gradient method for a class of nonlinear PDE-constrained optimal control problems under uncertainty J. Diff. Eq. 2023 364 635-666
[26]
Geiersbach C and Wollner W Optimality conditions for convex stochastic optimization problems in Banach spaces with almost sure state constraints SIAM J. Optim. 2021 4 31 2455-2480
[27]
Geletu A, Hoffmann A, Schmidt P, and Li P Chance constrained optimization of elliptic PDE systems with a smoothing convex approximation ESAIM Control Optim. Calc. Var. 2020 26 70
[28]
Genz A and Bretz F Computation of Multivariate Normal and t Probabilities 2009 New York, NY Springer-Verlag 195
[29]
Göttlich S, Kolb O, and Lux K Chance-constrained optimal inflow control in hyperbolic supply systems with uncertain demand Optim. Control Appl. Methods 2021 42 566-589
[30]
Guth PA, Kaarnioja V, Kuo FY, Schillings C, and Sloan IH A quasi-Monte Carlo method for optimal control under uncertainty SIAM/ASA J. Uncertain. Quantif. 2021 9 2 354-383
[31]
Haber E, Chung M, and Herrmann F An effective method for parameter estimation with PDE constraints with multiple right-hand sides SIAM J. Optim. 2012 22 3 739-757
[32]
Hantoute A, Henrion R, and Pérez-Aros P Subdifferential characterization of probability functions under Gaussian distribution Math. Program. 2019 174 1–2 167-194
[33]
Kinderlehrer, D., Stampacchia, G.: An Introduction to Variational Inequalities and Their Applications, vol. 88 of Pure and Applied Mathematics. Academic Press, Inc. [Harcourt Brace Jovanovich, Publishers], New York-London, (1980)
[34]
Kolvenbach P, Lass O, and Ulbrich S An approach for robust PDE-constrained optimization with application to shape optimization of electrical engines and of dynamic elastic structures under uncertainty Optim. Eng. 2018 19 3 697-731
[35]
Kouri DP, Heinkenschloss M, Ridzal D, and Van Bloemen Waanders BG A trust-region algorithm with adaptive stochastic collocation for PDE optimization under uncertainty SIAM J. Sci. Comput. 2013 35 4 A1847-A1879
[36]
Kouri DP and Surowiec TM Risk-Averse PDE-constrained optimization using the conditional value-at-risk SIAM J. Optim. 2016 26 1 365-396
[37]
Kouri D and Surowiec T Risk-averse optimal control of semilinear elliptic PDEs ESAIM Control Optim. Calc. Var. 2019 26 53
[38]
Kouri DP, Staudigl M, and Surowiec TM A relaxation-based probabilistic approach for PDE-constrained optimization under uncertainty with pointwise state constraints Comput. Optim. Appl. 2023 85 2 441-478
[39]
Kouri D and Surowiec TM Existence and optimality conditions for risk-averse PDE-constrained optimization SIAM-ASA J. Uncertain. Quantif. 2018 6 2 787-815
[40]
Martin, M., Krumscheid, S., Nobile, F.: Complexity analysis of stochastic gradient methods for PDE-constrained optimal control problems with uncertain parameters. ESAIM: Math. Modell. Numer. Anal., 55(4), 1599–1633 (2021)
[41]
Matthieu M and Fabio N PDE-constrained optimal control problems with uncertain parameters using SAGA SIAM/ASA J. Uncertain. Quantifi. 2021 9 3 979-1012
[42]
Milz J Consistency of Monte Carlo estimators for risk-neutral PDE-constrained optimization Appl. Math. Optim. 2023 87 3 57
[43]
Ouanes, N., González Grandón, T., Heitsch, H., Henrion, R.: Optimizing the economic dispatch of weakly-connected mini-grids under uncertainty using joint chance constraints. Preprint No. 3069 (2023) Weierstrass Institute Berlin
[44]
Pérez-Aros P, Quiñinao C, and Tejo M Control in probability for SDE models of growth population Appl. Math. Optim. 2022 86 3 44
[45]
Prékopa A Stochastic Programming 1995 Dordrecht Kluwer Academic Publishers
[46]
Rockafellar RT and Royset JO Engineering decisions under risk averseness ASCE-ASME J. Risk Uncertain. Eng. Syst., Part A: Civ. Eng. 2015 1 2 04015003
[47]
Schuster M, Strauch E, Gugat M, and Lang J Probabilistic constrained optimization on flow networks Optim. Eng. 2022 23 2 1-50
[48]
Shapiro, A., Dentcheva, D., Ruszczyński, A.: Lectures on Stochastic Programming—Modeling and Theory, volume 28 of MOS-SIAM Series on Optimization. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA; Mathematical Optimization Society, Philadelphia, PA, (2021). Third edition
[49]
Teka K, Geletu A, and Li P Yang B and Stipanovic D Structural properties and convergence approach for chance-constrained optimization of boundary-value elliptic partial differential equation systems Nonlinear Systems, chapter 7 2023 Rijeka IntechOpen
[50]
van Ackooij W and Henrion R Gradient formulae for nonlinear probabilistic constraints with Gaussian and Gaussian-like distributions SIAM J. Optim. 2014 24 4 1864-1889
[51]
van Ackooij W and Pérez-Aros P Generalized differentiation of probability functions: parameter dependent sets given by intersections of convex sets and complements of convex sets Appl. Math. Optim. 2022 85 1 2
[52]
van Ackooij W A discussion of probability functions and constraints from a variational perspective Set-Valued Var. Anal 2020 28 4 585-609
[53]
van Ackooij W and Henrion R (Sub-)gradient formulae for probability functions of random inequality systems under Gaussian distribution SIAM/ASA J. Uncertain. Quantif. 2017 5 1 63-87
[54]
van Ackooij W, Henrion R, and Pérez-Aros P Generalized gradients for probabilistic/robust (probust) constraints Optimization 2020 69 1451-1479
[55]
van Ackooij W, Henrion R, and Zidani H Pontryagin’s principle for some probabilistic control problems Appl. Math. Optim. 2024 90 5 1-36
[56]
van Ackooij W and Pérez-Aros P Generalized differentiation of probability functions acting on an infinite system of constraints SIAM J. Optim. 2019 29 3 2179-2210
[57]
Van Barel A and Vandewalle S Robust Optimization of PDEs with random coefficients using a multilevel monte Carlo method SIAM/ASA J. Uncertain. Quantif. 2019 7 1 174-202
[58]
Zahr MJ, Carlberg KT, and Kouri DP An efficient, globally convergent Method for optimization under uncertainty using adaptive model reduction and sparse grids SIAM/ASA J. Uncertain. Quantif. 2019 7 3 877-912
Index Terms
- Numerical Solution of an Optimal Control Problem with Probabilistic and Almost Sure State Constraints
Index terms have been assigned to the content through auto-classification.
Recommendations
An Interior-Point Approach for Solving Risk-Averse PDE-Constrained Optimization Problems with Coherent Risk Measures
The prevalence of uncertainty in models of engineering and the natural sciences necessitates the inclusion of random parameters in the underlying partial differential equations (PDEs). The resulting decision problems governed by the solution of such random ...
Hölder and Lipschitz stability of solution sets in programs with probabilistic constraints
We study perturbations of a stochastic program with a probabilistic constraint and r-concave original probability distribution. First we improve our earlier results substantially and provide conditions implying Hölder continuity properties of the ...
A Sequential Algorithm for Solving Nonlinear Optimization Problems with Chance Constraints
An algorithm is presented for solving nonlinear optimization problems with chance constraints, i.e., those in which a constraint involving an uncertain parameter must be satisfied with at least a minimum probability. In particular, the algorithm is ...
Comments
Information & Contributors
Information
Published In
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2024.
Publisher
Plenum Press
United States
Publication History
Published: 27 December 2024
Accepted: 30 October 2024
Received: 24 November 2023
Author Tags
Author Tags
Qualifiers
- Research-article
Funding Sources
- Deutsche Forschungsgemeinschaft
- FMJH Program Gaspard Monge in optimization and operations re- search including support to this program by EDF.
- Centro de Modelamiento Matemático
- Agencia Nacional de Investigación y Desarrollo
- Agencia Nacional de Investigación y Desarrollo
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 06 Jan 2025