随机占优约束优化的原始对偶算法

Primal-Dual Algorithms for Optimization with Stochastic Dominance

SIAM Journal on Optimization · 2017
被引 13
ABS 3

中文导读

针对随机占优约束的优化问题,开发了离线与在线原始对偶算法,给出最优性间隙的界,并扩展到部分反馈的多臂老虎机问题。

Abstract

Stochastic dominance, a pairwise comparison between random variables, is an effective tool for expressing risk aversion in stochastic optimization. In this paper, we develop a family of primal-dual algorithms for optimization problems with stochastic dominance-constraints. First, we develop an offline primal-dual algorithm and bound its optimality gap as a function of the number of iterations. Then, we extend this algorithm to the online setting where only one random sample is given in each decision epoch. We give probabilistic bounds on the optimality gap in this setting. This technique also yields an online algorithm for the stochastic dominance-constrained multiarmed bandit with partial feedback. The paper concludes by discussing a dual approach for a batch learning problem with robust stochastic dominance constraints.

随机优化风险规避原始对偶算法在线学习多臂老虎机