海量数据的最优子抽样自助法

Optimal Subsampling Bootstrap for Massive Data

Journal of Business & Economic Statistics · 2023
被引 6
人大 AABS 4

中文导读

针对海量数据下传统自助法计算量过大的问题,提出一种超参数选择方法,通过优化子样本大小、子样本数和重抽样数等参数,在控制计算成本的同时提高估计精度,并通过数值实验验证了有效性。

Abstract

The bootstrap is a widely used procedure for statistical inference because of its simplicity and attractive statistical properties. However, the vanilla version of bootstrap is no longer feasible computationally for many modern massive datasets due to the need to repeatedly resample the entire data. Therefore, several improvements to the bootstrap method have been made in recent years, which assess the quality of estimators by subsampling the full dataset before resampling the subsamples. Naturally, the performance of these modern subsampling methods is influenced by tuning parameters such as the size of subsamples, the number of subsamples, and the number of resamples per subsample. In this paper, we develop a novel hyperparameter selection methodology for selecting these tuning parameters. Formulated as an optimization problem to find the optimal value of some measure of accuracy of an estimator subject to computational cost, our framework provides closed-form solutions for the optimal hyperparameter values for subsampled bootstrap, subsampled double bootstrap and bag of little bootstraps, at no or little extra time cost. Using the mean square errors as a proxy of the accuracy measure, we apply our methodology to study, compare and improve the performance of these modern versions of bootstrap developed for massive data through numerical study. The results are promising.

最优子抽样自助法海量数据超参数选择