径向次梯度方法

Radial Subgradient Method

SIAM Journal on Optimization · 2018
被引 9
ABS 3

中文导读

提出一种针对非光滑非Lipschitz凸优化问题的次梯度方法,仅需已知一个严格可行点,通过径向线搜索避免正交投影,收敛速度优于现有方法。

Abstract

We present a subgradient method for minimizing nonsmooth, non-Lipschitz convex optimization problems. The only structure assumed is that a strictly feasible point is known. We extend the work of Renegar [SIAM J. Optim., 26 (2016), pp. 2649--2676] by taking a different perspective, leading to an algorithm which is conceptually more natural, has notably improved convergence rates, and for which the analysis is surprisingly simple. At each iteration, the algorithm takes a subgradient step and then performs a line search to move radially towards (or away from) the known feasible point. Our convergence results have striking similarities to those of traditional methods that require Lipschitz continuity. Costly orthogonal projections typical of subgradient methods are entirely avoided.

凸优化非光滑优化次梯度方法线搜索