随机弱凸优化的零阶方法

A zeroth order method for stochastic weakly convex optimization

Computational Optimization and Applications · 2021
被引 8
ABS 3

中文导读

本文针对没有随机次梯度信息的弱凸优化问题,提出一种基于两点梯度近似的无导数算法,其收敛速度与现有方法相当但常数更大,数值实验验证了有效性。

Abstract

Abstract In this paper, we consider stochastic weakly convex optimization problems, however without the existence of a stochastic subgradient oracle. We present a derivative free algorithm that uses a two point approximation for computing a gradient estimate of the smoothed function. We prove convergence at a similar rate as state of the art methods, however with a larger constant, and report some numerical results showing the effectiveness of the approach.

随机优化弱凸优化无导数优化次梯度方法