A Flexible and Fast Method for Automatic Smoothing
提出一种基于渐近最优带宽的插件估计方法，通过迭代估计回归函数的二阶导数，相比交叉验证大幅降低带宽估计的变异性，适用于小样本和多种设计，计算快速且灵活。
Abstract The choice of smoothing parameter or bandwidth is crucial when applying nonparametric regression estimators such as kernel estimators. The optimal choice depends on the data at hand. A data-driven bandwidth selection, close to the optimal one, would make these curve estimators objective, more reliable, and easier to use. Minimizing residual mean squared error criteria, such as cross-validation, have been frequently proposed to estimate the optimal smoothing parameter. Empirical and theoretical evidence indicates that cross-validation rules and related methods lead to rather variable estimated optimal bandwidths. The method presented here builds on estimating the asymptotically optimal bandwidth from the data. Since estimators for the residual variance and for an asymptotic expression for the bias are plugged into the asymptotic formula, such selection rules are called “plug-in” estimators. The functional that quantifies bias is approximated by the integrated squared second derivative of the regression function. This functional is determined by an iterative procedure with good convergence properties in theory and practice. A theoretical large-sample analysis shows that the plug-in estimator is attractive in terms of variability, with a relative rate OP (n -1/2) for smooth functions. In contrast, cross-validation leads to a relative rate OP (n -1/10). Despite the estimation of second derivatives involved, asymptotic properties are still adequate for nonsmooth functions. This robustness is desirable for a non-parametric approach. An extensive simulation study confirms the theoretical findings: The plug-in estimator of the bandwidth has much lower variability than cross-validation estimators for a broad variety of situations, including nonsmooth functions. Despite its asymptotic background, it works well for sample sizes as small as n = 15–25. It applies to fixed and to random design, to equally spaced and nonequally spaced design. Additional assets are computational speed and the great flexibility of this approach. It can also be extended to estimating the optimal bandwidth when determining derivatives of a regression function or probability densities and spectrum densities.