无免费午餐的概率论重构:连续午餐并非免费

A Probabilistic Reformulation of No Free Lunch: Continuous Lunches Are Not Free

Evolutionary Computation · 2016
被引 12
ABS 3

中文导读

本文提出一种新的概率化无免费午餐定理形式化方法,证明在连续空间等大规模搜索域中该定理仍然成立,填补了随机优化器性能评估的理论空白。

Abstract

No Free Lunch (NFL) theorems have been developed in many settings over the last two decades. Whereas NFL is known to be possible in any domain based on set-theoretic concepts, probabilistic versions of NFL are presently believed to be impossible in continuous domains. This article develops a new formalization of probabilistic NFL that is sufficiently expressive to prove the existence of NFL in large search domains, such as continuous spaces or function spaces. This formulation is arguably more complicated than its set-theoretic variants, mostly as a result of the numerous technical complications within probability theory itself. However, a probabilistic conceptualization of NFL is important because stochastic optimization methods inherently need to be evaluated probabilistically. Thus the present study fills an important gap in the study of performance of stochastic optimizers.

机器学习优化理论概率论理论计算机科学