Convergent Nested Alternating Minimization Algorithms for Nonconvex Optimization Problems
提出一种嵌套交替最小化算法框架,结合经典交替最小化与内层迭代,首次给出非凸嵌套方法的全局收敛性分析,数值实验显示其优于现有方法。
We introduce a new algorithmic framework for solving nonconvex optimization problems, that is called nested alternating minimization, which aims at combining the classical alternating minimization technique with inner iterations of any optimization method. We provide a global convergence analysis of the new algorithmic framework to critical points of the problem at hand, which to the best of our knowledge, is the first of this kind for nested methods in the nonconvex setting. Central to our global convergence analysis is a new extension of classical proof techniques in the nonconvex setting that allows for errors in the conditions. The power of our framework is illustrated with some numerical experiments that show the superiority of this algorithmic framework over existing methods. Funding: This work was supported by the Deutsche Forschungsgemeinschaft [Grant 800240] and the Israel Science Foundation [Grant 2480/21].