证明无穷远处不存在虚假局部最小值

Certifying the Absence of Spurious Local Minima at Infinity

SIAM Journal on Optimization · 2023
被引 2
ABS 3

中文导读

针对非凸无约束优化问题,本文提出条件来证明无穷远处不存在虚假局部最小值,并验证其在主成分分析、矩阵感知和线性神经网络等应用中的有效性。

Abstract

When searching for global optima of nonconvex unconstrained optimization problems, it is desirable that every local minimum be a global minimum. This property of having no spurious local minima is true in various problems of interest nowadays, including principal component analysis, matrix sensing, and linear neural networks. However, since these problems are noncoercive, they may yet have spurious local minima at infinity. The classical tools used to analyze the optimization landscape, namely the gradient and the Hessian, are incapable of detecting spurious local minima at infinity. In this paper, we identify conditions that certify the absence of spurious local minima at infinity, one of which is having bounded subgradient trajectories. We check that they hold in several applications of interest.

非凸优化全局优化机器学习理论优化景观分析