分布有利优化:一种应对内生异常值的数据驱动决策框架

Distributionally Favorable Optimization: A Framework for Data-Driven Decision-Making with Endogenous Outliers

SIAM Journal on Optimization · 2024
被引 11 · 同刊同年前 6%
ABS 3

中文导读

提出分布有利优化(DFO)框架,通过考虑最有利分布下的期望补偿函数,减轻内生异常值对决策的影响,并与分布鲁棒优化(DRO)结合,提升数据驱动决策的鲁棒性。

Abstract

A typical data-driven stochastic program seeks the best decision that minimizes the sum of a deterministic cost function and an expected recourse function under a given distribution. Recently, much success has been witnessed in the development of distributionally robust optimization (DRO), which considers the worst-case expected recourse function under the least favorable probability distribution from a distributional family. However, in the presence of endogenous outliers such that their corresponding recourse function values are very large or even infinite, the commonly used DRO framework alone tends to overemphasize these endogenous outliers and cause undesirable or even infeasible decisions. On the contrary, distributionally favorable optimization (DFO), concerning the best-case expected recourse function under the most favorable distribution from the distributional family, can serve as a proper measure of the stochastic recourse function and mitigate the effect of endogenous outliers. We show that DFO recovers many robust statistics, suggesting that the DFO framework might be appropriate for the stochastic recourse function in the presence of endogenous outliers. A notion of decision outlier robustness is proposed for selecting a DFO framework for data-driven optimization with outliers. We also provide a unified way to integrate DRO with DFO, where DRO addresses the out-of-sample performance, and DFO properly handles the stochastic recourse function under endogenous outliers. We further extend the proposed DFO framework to solve two-stage stochastic programs without relatively complete recourse. The numerical study demonstrates that the framework is promising.

数据驱动决策随机优化鲁棒优化异常值处理计量经济学