准双曲贴现动态决策模型中的马尔可夫完美均衡

Markov perfect equilibria in a dynamic decision model with quasi-hyperbolic discounting

Annals of Operations Research · 2018
被引 16
ABS 3

中文导读

研究了决策者偏好随时间变化的离散时间非平稳决策模型,其中偏好由准双曲贴现描述,通过广义策略迭代算法构造马尔可夫完美均衡,并得到新存在性结果。

Abstract

We study a discrete-time non-stationary decision model in which the preferences of the decision maker change over time and are described by quasi-hyperbolic discounting. A time-consistent optimal solution in this model corresponds with a Markov perfect equilibrium in a stochastic game with uncountable state space played by countably many short-lived players. We show that Markov perfect equilibria may be constructed using a generalized policy iteration algorithm. This method is in part inspired by the fundamental works of Mertens and Parthasarathy (in: Raghavan, Ferguson, Parthasarathy, Vrieze (eds) Stochastic games and related topics, Kluwer Academic Publishers, Dordrecht, 1991 ; in: Neyman, Sorin (eds) Stochastic games and applications, Academic Publishers, Dordrecht, 2003 ) devoted to subgame perfect equilibria in standard n -person discounted stochastic games. If the one-period utilities and transition probabilities are independent of time, we obtain on new existence results on stationary Markov perfect equilibria in the models with unbounded from above utilities.

动态决策准双曲贴现马尔可夫完美均衡随机博弈广义策略迭代算法