广义核双样本检验

Generalized kernel two-sample tests

Biometrika · 2023
被引 8
ABS 4

中文导读

针对现有核双样本检验在高维数据中因维数灾难而效果不佳的问题,提出一种利用中高维共性模式的新检验统计量,显著提升检验功效,并提供低计算成本的替代方法,适用于大型数据集。

Abstract

Summary Kernel two-sample tests have been widely used for multivariate data to test equality of distributions. However, existing tests based on mapping distributions into a reproducing kernel Hilbert space mainly target specific alternatives and do not work well for some scenarios when the dimension of the data is moderate to high due to the curse of dimensionality. We propose a new test statistic that makes use of a common pattern under moderate and high dimensions and achieves substantial power improvements over existing kernel two-sample tests for a wide range of alternatives. We also propose alternative testing procedures that maintain high power with low computational cost, offering easy off-the-shelf tools for large datasets. The new approaches are compared to other state-of-the-art tests under various settings and show good performance. We showcase the new approaches through two applications: the comparison of musks and nonmusks using the shape of molecules, and the comparison of taxi trips starting from John F. Kennedy airport in consecutive months. All proposed methods are implemented in an R package kerTests.

统计假设检验核方法高维数据分析多元统计