ε-次梯度方法的缩放技术

Scaling Techniques for $\epsilon$-Subgradient Methods

SIAM Journal on Optimization · 2016
被引 18
ABS 3

中文导读

针对非光滑凸优化问题,在ε-次梯度方法中引入可变度量,结合两种步长选择策略,理论分析收敛性并在图像恢复中验证效果。

Abstract

The recent literature on first order methods for smooth optimization shows that significant improvements on the practical convergence behavior can be achieved with variable step size and scaling for the gradient, making this class of algorithms attractive for a variety of relevant applications. In this paper we introduce a variable metric in the context of the $\epsilon$-subgradient methods for nonsmooth, convex problems, in combination with two different step size selection strategies. We develop the theoretical convergence analysis of the proposed approach in the general framework of forward-backward $\epsilon$-subgradient splitting methods and we also discuss practical implementation issues. In order to illustrate the effectiveness of the method, we consider a specific problem in the image restoration framework and we numerically evaluate the effects of a variable scaling and of the step length selection strategy on the convergence behavior.

数学优化非光滑优化图像恢复收敛分析