无全局Lipschitz假设下具有Kurdyka–Łojasiewicz性质的近端梯度法的收敛性分析

Convergence Analysis of the Proximal Gradient Method in the Presence of the Kurdyka–Łojasiewicz Property Without Global Lipschitz Assumptions

SIAM Journal on Optimization · 2023
被引 11
ABS 3

中文导读

研究了在目标函数光滑部分仅满足局部Lipschitz连续且整体满足Kurdyka–Łojasiewicz性质时,近端梯度法仍能保证全局收敛和局部收敛速率,去掉了传统所需的全局Lipschitz假设。

Abstract

.We consider a composite optimization problem where the sum of a continuously differentiable and a merely lower semicontinuous function has to be minimized. The proximal gradient algorithm is the classical method for solving such a problem numerically. The corresponding global convergence and local rate-of-convergence theory typically assumes, besides some technical conditions, that the smooth function has a globally Lipschitz continuous gradient and that the objective function satisfies the Kurdyka–Łojasiewicz property. Though this global Lipschitz assumption is satisfied in several applications where the objective function is, e.g., quadratic, this requirement is very restrictive in the nonquadratic case. Some recent contributions therefore try to overcome this global Lipschitz condition by replacing it with a local one, but, to the best of our knowledge, they still require some extra condition in order to obtain the desired global and rate-of-convergence results. The aim of this paper is to show that the local Lipschitz assumption together with the Kurdyka–Łojasiewicz property is sufficient to recover these convergence results.Keywordsnon-Lipschitzian optimizationnonsmooth optimizationproximal gradient methodKurdyka–Łojasiewicz propertyrate-of-convergenceMSC codes49J5290C30

优化理论非光滑优化收敛性分析近端梯度法