用于正则化凸优化的嵌套原始对偶迭代Tikhonov方法

A nested primal–dual iterated Tikhonov method for regularized convex optimization

Computational Optimization and Applications · 2024
被引 2
ABS 3

中文导读

提出一种嵌套原始对偶方法,通过固定次数的内迭代近似变度量近端梯度步,并配合回溯调整步长,高效求解正则化凸优化问题,在图像处理等应用中可降低计算成本。

Abstract

Abstract Proximal–gradient methods are widely employed tools in imaging that can be accelerated by adopting variable metrics and/or extrapolation steps. One crucial issue is the inexact computation of the proximal operator, often implemented through a nested primal–dual solver, which represents the main computational bottleneck whenever an increasing accuracy in the computation is required. In this paper, we propose a nested primal–dual method for the efficient solution of regularized convex optimization problems. Our proposed method approximates a variable metric proximal–gradient step with extrapolation by performing a prefixed number of primal–dual iterates, while adjusting the steplength parameter through an appropriate backtracking procedure. Choosing a prefixed number of inner iterations allows the algorithm to keep the computational cost per iteration low. We prove the convergence of the iterates sequence towards a solution of the problem, under a relaxed monotonicity assumption on the scaling matrices and a shrinking condition on the extrapolation parameters. Furthermore, we investigate the numerical performance of our proposed method by equipping it with a scaling matrix inspired by the Iterated Tikhonov method. The numerical results show that the combination of such scaling matrices and Nesterov-like extrapolation parameters yields an effective acceleration towards the solution of the problem.

凸优化正则化原始对偶方法图像处理数值优化