拉格朗日形式在连续时间随机最优控制中的适应性:拉格朗日-周方法再探

On the adaptation of the Lagrange formalism to continuous time stochastic optimal control: A Lagrange-Chow redux

Journal of Economic Dynamics and Control · 2024
被引 4
ABS 3

中文导读

本文扩展经典拉格朗日方法以求解连续时间随机最优控制问题,与HJB方程和随机最大值原理建立联系,并给出数值应用示例,对从事随机控制理论及应用的研究者有参考价值。

Abstract

We show how the classical Lagrangian approach to solving constrained optimization problems from standard calculus can be extended to solve continuous time stochastic optimal control problems. Connections to mainstream approaches such as the Hamilton-Jacobi-Bellman equation and the stochastic maximum principle are drawn. Our approach is linked to the stochastic maximum principle, but more direct and tied to the classical Lagrangian principle, avoiding the use of backward stochastic differential equations in its formulation. Using infinite dimensional functional analysis, we formalize and extend the approach first outlined in Chow (1992) within a rigorous mathematical setting using infinite dimensional functional analysis. We provide examples that demonstrate the usefulness and effectiveness of our approach in practice. Further, we demonstrate the potential for numerical applications facilitating some of our key equations in combination with Monte Carlo backward simulation and linear regression, therefore illustrating a completely different and new avenue for the numerical application of Chow's methods.

随机最优控制拉格朗日乘子法随机最大值原理无穷维泛函分析数值方法