In this paper, we investigate the relaxed and strict near-optimality conditions for mean-field singular FBSDEs, where the coefficients depend on the state of the solution process as well as of its expected value. Moreover, the cost functional is also of mean-field type. This makes the control problem time inconsistent in the sense that the Bellman’s optimality principle does not hold. The purpose of this paper is to establish necessary and sufficient conditions of near-optimality for relaxed and strict mean-field singular controls. For strict mean-field singular FBSDEs, whose wellposedness is ensured under the twice continuously differentiable assumptions of coefficients. Then, the moment estimations of variational processes as well as first- order and second-order adjoint processes are presented by using Burkholder-Davis-Gundy inequality. Further, by introducing Hamiltonian function via Ekeland’s variational principle, the necessary near-optimality conditions are established. For relaxed mean-field singular FBSDEs, we first give the definition of admissible set of relaxed singular controls, then use the mapping defined by Dirac measure, we prove that the near-optimal problem of strict singular controls is a particular case of the near- optimal problem of relaxed singular ones. Further, a well known chattering lemma is introduced. By virtue of this famous lemma addition with the stability of trajectories with respect to the control variable and dominated convergence theorem, necessary as well as sufficient near-optimality conditions for relaxed controls are established.
Published in | Control Science and Engineering (Volume 8, Issue 1) |
DOI | 10.11648/j.cse.20240801.12 |
Page(s) | 13-28 |
Creative Commons |
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited. |
Copyright |
Copyright © The Author(s), 2024. Published by Science Publishing Group |
Near-optimal Singular Control, Mean-field SDE, Relaxed and Strict Control, Adjoint Equation, Ekeland’s Variational Principle
[1] | N. U. Ahmed,Stochastic neutral evolution equations on Hilbert spaces with partially observed relaxed control and their necessary conditions of optimality,Nonlinear Analysis, 101 (2014) 66-79. |
[2] | S. Bahlali, A general necessary and sufficient optimality conditions for singular control problems, http://arxiv.org/abs/0801.4285 (2008). |
[3] | K. Bahlali, F. Chighoub, B. Djehiche, B. Mezerdi, Optimality necessary conditions in singular stochastic control problems with nonsmooth data, J. Math. Anal. Appl. 355 (2009), 479-494. |
[4] | S. Bahlali, B. Djehiche, B. Mezerdi, The relaxed stochastic maximum principle in singular optimal control of diffusions, SIAM J, Control Optim., 46 (2007), 427- 444. |
[5] | S. Bahlali, B. Mezerdi, A general stochastic maximum principle for singular control problems, Electron. J. Probab., 10 (2005), 988-1004. |
[6] | A. Bensoussan, Lectures on stochastic control, in NonlinearFilteringandStochasticControl, LectureNotes in Math. 972, Springer-Verlag, Berlin, 1982. |
[7] | R. Buckdahn, B. Djehiche, J. Li, A general stochastic maximum principle for SDEs of mean-field type, Appl. Math. Optim., 64 (2011), 197-216. |
[8] | R. Buckdahn, J. Li, S. G. Peng, Mean-field backward stochastic differential equations and related partial differential equations, Stoch. Process Appl., 119 (2009), 3133-3154. |
[9] | A. Cadenillas, U. G. Haussmann, The stochastic maximum principle for a singular control problem, Stochastics and Stoch. Reports, 49 (1994), 211-237. |
[10] | A. Chala, The relaxed optimal control problem for Mean- Field SDEs systems and application, Automatica, 50, (2014), 924-930. |
[11] | Y. G. Chen, T. Y. Nie, Z. Wu, The stochastic maximum principle for relaxed control problem with regime- switching, Systems & Control Letters, 169, (2022), 105391. |
[12] | F. H. Clarke, Optimization and Nonsmooth Analysis, SIAM, Philadelphia, 1990. |
[13] | R. Deepa, P. Muthukumar,Infinite horizon mean-field type relaxed optimal control with Levy processes, IFAC PapersOnLine 51-1 (2018) 136-141. |
[14] | I. Ekeland, Non convex minimization problems, Bull. Amer. Math. Soc., NS 1 (1979), 324-353. |
[15] | W. H. Fleming, Generalized solutions in optimal stochastic control, in Differential Games and Control Theory 2, Lecture Notes in pure and Appl. Math., 30 (1977), 147-165. |
[16] | M. Hafayed, S. Abbas, P. Veverka, On necessary and sufficient conditions for near-optimal singular stochastic controls, Optim. Lett., doi:10.1007/s 11590-012-0484-6, (2012). |
[17] | U. G. Haussmann, W. Suo, Singular optimal stochastic controls, I: Existence, SIAM J. Control and Optim., 33 (1995), 916-936. |
[18] | C. C. Hua, Z. H. Chen, Z. H. Sun, X. Luo, Type- B Nussbaum function-based fault-tolerant control for a class of strict-feedback nonlinear systems, Journal of the Franklin Institute 360 (2023) 2421-2435. |
[19] | N. E. Karoui, N. H. Nguyen, M. J. Piqué, Compactification methods in the control of degenerate diffusions, Stochastics, 20 (1987), 169-219. |
[20] | J. M. Lasry, P. L. Lions, Mean field games, Jpn. J. Math., 2 (2007), 229-260. |
[21] | T. Meyer-Brandis, B. ∅ksendal, X. Y. Zhou, A mean-field stochastic maximum principle via Malliavin calculus, Stochastics: An International Journal of Probab. and Stoch. Process, (2012), 1-24. |
[22] | S. G. Peng, A general stochastic maximum principle for optimal control problems, SIAM J. Control Optim., 28 (1990), 966-979. |
[23] | A. Roubi, M. A. Mezerdi,Necessary and sufficient conditions in optimal control of mean-field stochastic differential equations with infinite horizon, Random Operators and Stochastic Equations, 30 (2022), 183-195. |
[24] | M. Sun, G. M. Zhuang, Q. Ma, Y. Q. Wang, Dynamic PDC and HMM-based asynchronous output feedback strict dissipative control for nonlinear singular incomplete jumping systems with actuator saturation, Chaos, Solitons & Fractals, 178, (2024), 114399. |
[25] | B. N. Thanh, H. K. Sung, Relaxed dissipative control of nonhomogeneous Markovian jump fuzzy systems via stochastic nonquadratic stabilization approach, Nonlinear Analysis: Hybrid Systems 38 (2020) 100915. |
[26] | J. M. Yong, X. Y. Zhou, Stochastic Controls, Hamiltonian Systems and HJB Equations, Springer Verlag, 1999. |
[27] | L. Q. Zhang, The relaxed stochastic maximum principle in the mean-field singular controls, Mathematics, http://arxiv.org/abs/1202.4129 (2012). |
[28] | X. Y. Zhou, Stochastic near-optimal controls: necessary and sufficient conditions for near-optimality, SIAM J. Control Optim., 36 (1998), 929-947. |
APA Style
Li, R. (2024). Near-optimality Conditions for Relaxed and Strict Mean-field Singular FBSDEs. Control Science and Engineering, 8(1), 13-28. https://doi.org/10.11648/j.cse.20240801.12
ACS Style
Li, R. Near-optimality Conditions for Relaxed and Strict Mean-field Singular FBSDEs. Control Sci. Eng. 2024, 8(1), 13-28. doi: 10.11648/j.cse.20240801.12
AMA Style
Li R. Near-optimality Conditions for Relaxed and Strict Mean-field Singular FBSDEs. Control Sci Eng. 2024;8(1):13-28. doi: 10.11648/j.cse.20240801.12
@article{10.11648/j.cse.20240801.12, author = {Ruijing Li}, title = {Near-optimality Conditions for Relaxed and Strict Mean-field Singular FBSDEs}, journal = {Control Science and Engineering}, volume = {8}, number = {1}, pages = {13-28}, doi = {10.11648/j.cse.20240801.12}, url = {https://doi.org/10.11648/j.cse.20240801.12}, eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.cse.20240801.12}, abstract = {In this paper, we investigate the relaxed and strict near-optimality conditions for mean-field singular FBSDEs, where the coefficients depend on the state of the solution process as well as of its expected value. Moreover, the cost functional is also of mean-field type. This makes the control problem time inconsistent in the sense that the Bellman’s optimality principle does not hold. The purpose of this paper is to establish necessary and sufficient conditions of near-optimality for relaxed and strict mean-field singular controls. For strict mean-field singular FBSDEs, whose wellposedness is ensured under the twice continuously differentiable assumptions of coefficients. Then, the moment estimations of variational processes as well as first- order and second-order adjoint processes are presented by using Burkholder-Davis-Gundy inequality. Further, by introducing Hamiltonian function via Ekeland’s variational principle, the necessary near-optimality conditions are established. For relaxed mean-field singular FBSDEs, we first give the definition of admissible set of relaxed singular controls, then use the mapping defined by Dirac measure, we prove that the near-optimal problem of strict singular controls is a particular case of the near- optimal problem of relaxed singular ones. Further, a well known chattering lemma is introduced. By virtue of this famous lemma addition with the stability of trajectories with respect to the control variable and dominated convergence theorem, necessary as well as sufficient near-optimality conditions for relaxed controls are established.}, year = {2024} }
TY - JOUR T1 - Near-optimality Conditions for Relaxed and Strict Mean-field Singular FBSDEs AU - Ruijing Li Y1 - 2024/01/24 PY - 2024 N1 - https://doi.org/10.11648/j.cse.20240801.12 DO - 10.11648/j.cse.20240801.12 T2 - Control Science and Engineering JF - Control Science and Engineering JO - Control Science and Engineering SP - 13 EP - 28 PB - Science Publishing Group SN - 2994-7421 UR - https://doi.org/10.11648/j.cse.20240801.12 AB - In this paper, we investigate the relaxed and strict near-optimality conditions for mean-field singular FBSDEs, where the coefficients depend on the state of the solution process as well as of its expected value. Moreover, the cost functional is also of mean-field type. This makes the control problem time inconsistent in the sense that the Bellman’s optimality principle does not hold. The purpose of this paper is to establish necessary and sufficient conditions of near-optimality for relaxed and strict mean-field singular controls. For strict mean-field singular FBSDEs, whose wellposedness is ensured under the twice continuously differentiable assumptions of coefficients. Then, the moment estimations of variational processes as well as first- order and second-order adjoint processes are presented by using Burkholder-Davis-Gundy inequality. Further, by introducing Hamiltonian function via Ekeland’s variational principle, the necessary near-optimality conditions are established. For relaxed mean-field singular FBSDEs, we first give the definition of admissible set of relaxed singular controls, then use the mapping defined by Dirac measure, we prove that the near-optimal problem of strict singular controls is a particular case of the near- optimal problem of relaxed singular ones. Further, a well known chattering lemma is introduced. By virtue of this famous lemma addition with the stability of trajectories with respect to the control variable and dominated convergence theorem, necessary as well as sufficient near-optimality conditions for relaxed controls are established. VL - 8 IS - 1 ER -