Retraction-Based Direct Search Methods for Derivative Free Riemannian Optimization
将直接搜索方法扩展到黎曼优化中,处理变量受限于流形的黑箱优化问题,首次分析了无导数情况下非光滑目标函数的收敛性,并给出数值实验。
Abstract Direct search methods represent a robust and reliable class of algorithms for solving black-box optimization problems. In this paper, the application of those strategies is exported to Riemannian optimization, wherein minimization is to be performed with respect to variables restricted to lie on a manifold. More specifically, classic and linesearch extrapolated variants of direct search are considered, and tailored strategies are devised for the minimization of both smooth and nonsmooth functions, by making use of retractions. A class of direct search algorithms for minimizing nonsmooth objectives on a Riemannian manifold without having access to (sub)derivatives is analyzed for the first time in the literature. Along with convergence guarantees, a set of numerical performance illustrations on a standard set of problems is provided.