论随机复杂度与非参数密度估计

On Stochastic Complexity and Nonparametric Density Estimation

Biometrika · 1988
被引 15
ABS 4

中文导读

利用随机复杂度和描述长度概念,为非参数密度估计中的平滑参数选择提供数据驱动方法,推导了直方图估计的精确公式,并证明该方法在最小化L∞距离上几乎最优。

Abstract

We use the concepts of stochastic complexity, description length, and model selection to develop data-based methods for choosing smoothing parameters in nonparametric density estimation. In the case of histogram estimators, we derive a simple, exact formula for stochastic complexity when the prior distribution of cell probabilities is uniform over the class of all possible choices. The formula depends only on the data and the smoothing parameter, which is readily chosen according to the criterion of minimum stochastic complexity. Approaches based on stochastic complexity and description length are shown to be asymptotically equivalent in certain circumstances. They produce a degree of smoothing which is almost optimal from the viewpoint of minimizing L∞, or supremum, distance, but which smooths a little more than is optimal in the sense of minimizing Lr distance for any finite value of r.

非参数统计密度估计模型选择平滑参数