On Stochastic Complexity and Nonparametric Density Estimation
利用随机复杂度和描述长度概念,为非参数密度估计中的平滑参数选择提供数据驱动方法,推导了直方图估计的精确公式,并证明该方法在最小化L∞距离上几乎最优。
We use the concepts of stochastic complexity, description length, and model selection to develop data-based methods for choosing smoothing parameters in nonparametric density estimation. In the case of histogram estimators, we derive a simple, exact formula for stochastic complexity when the prior distribution of cell probabilities is uniform over the class of all possible choices. The formula depends only on the data and the smoothing parameter, which is readily chosen according to the criterion of minimum stochastic complexity. Approaches based on stochastic complexity and description length are shown to be asymptotically equivalent in certain circumstances. They produce a degree of smoothing which is almost optimal from the viewpoint of minimizing L∞, or supremum, distance, but which smooths a little more than is optimal in the sense of minimizing Lr distance for any finite value of r.