具有预定义步长的原始次梯度方法

Primal Subgradient Methods with Predefined Step Sizes

Journal of Optimization Theory and Applications · 2024
被引 0
ABS 3

中文导读

本文提出分析非光滑凸优化原始次梯度方法的新框架,修正了经典步长规则在约束问题中的不足,并利用目标函数的平滑性和强凸性加速算法,还可近似最优拉格朗日乘子。

Abstract

In this paper, we suggest a new framework for analyzing primal subgradient methods for nonsmooth convex optimization problems. We show that the classical step-size rules, based on normalization of subgradient, or on knowledge of the optimal value of the objective function, need corrections when they are applied to optimization problems with constraints. Their proper modifications allow a significant acceleration of these schemes when the objective function has favorable properties (smoothness, strong convexity). We show how the new methods can be used for solving optimization problems with functional constraints with a possibility to approximate the optimal Lagrange multipliers. One of our primal-dual methods works also for unbounded feasible set.

非光滑凸优化次梯度方法约束优化原始对偶方法