约束问题的贝叶斯优化

Bayesian Optimisation for Constrained Problems

ACM Transactions on Modeling and Computer Simulation · 2024
被引 11 · 同刊同年前 9%
ABS 3

中文导读

提出一种处理约束的贝叶斯优化算法,扩展了知识梯度采集函数,实验证明优于四种现有算法,并证明了无限预算下的理论收敛性。

Abstract

Many real-world optimisation problems such as hyperparameter tuning in machine learning or simulation-based optimisation can be formulated as expensive-to-evaluate black-box functions. A popular approach to tackle such problems is Bayesian optimisation, which builds a response surface model based on the data collected so far, and uses the mean and uncertainty predicted by the model to decide what information to collect next. In this article, we propose a generalisation of the well-known Knowledge Gradient acquisition function that allows it to handle constraints. We empirically compare the new algorithm with four other state-of-the-art constrained Bayesian optimisation algorithms and demonstrate its superior performance. We also prove theoretical convergence in the infinite budget limit.

机器学习超参数调优贝叶斯优化黑箱优化