用于优化和采样的极化共识动力学

Polarized consensus-based dynamics for optimization and sampling

Mathematical Programming · 2024
被引 10 · 同刊同年前 6%
ABS 4

中文导读

提出极化共识动力学,通过局部化核使粒子被附近粒子吸引,从而能同时找到多个全局最小值或多模态分布,并证明其无偏性和收敛性。

Abstract

Abstract In this paper we propose polarized consensus-based dynamics in order to make consensus-based optimization (CBO) and sampling (CBS) applicable for objective functions with several global minima or distributions with many modes, respectively. For this, we “polarize” the dynamics with a localizing kernel and the resulting model can be viewed as a bounded confidence model for opinion formation in the presence of common objective. Instead of being attracted to a common weighted mean as in the original consensus-based methods, which prevents the detection of more than one minimum or mode, in our method every particle is attracted to a weighted mean which gives more weight to nearby particles. We prove that in the mean-field regime the polarized CBS dynamics are unbiased for Gaussian targets. We also prove that in the zero temperature limit and for sufficiently well-behaved strongly convex objectives the solution of the Fokker–Planck equation converges in the Wasserstein-2 distance to a Dirac measure at the minimizer. Finally, we propose a computationally more efficient generalization which works with a predefined number of clusters and improves upon our polarized baseline method for high-dimensional optimization.

数学优化采样方法共识算法多模态分布