基于生成神经网络的双重稳健条件独立性检验

Doubly robust conditional independence testing with generative neural networks

Journal of the Royal Statistical Society. Series B: Statistical Methodology · 2025
被引 0
ABS 4

中文导读

提出一种新的非参数检验方法,通过生成神经网络从条件分布中采样,避免直接估计条件分布,检验两个随机变量在给定第三个变量时的独立性,对高维数据有效且具有双重稳健性。

Abstract

Abstract This article addresses the problem of testing the conditional independence of two generic random vectors X and Y given a third random vector Z, which plays an important role in statistical and machine learning applications. We propose a new non-parametric testing procedure that avoids explicitly estimating any conditional distributions but instead requires sampling from the two marginal conditional distributions of X given Z and Y given Z. We further propose using a generative neural network (GNN) framework to sample from these approximated marginal conditional distributions, which tends to mitigate the curse of dimensionality due to its adaptivity to any low-dimensional structures and smoothness underlying the data. Theoretically, our test statistic is shown to enjoy a double robustness property against GNN approximation errors, meaning that the test statistic retains all desirable properties of the oracle test statistic utilizing the true marginal conditional distributions, as long as the product of the two approximation errors decays to zero faster than the parametric rate. Asymptotic properties of our statistic and the consistency of a bootstrap procedure are derived under both null and local alternatives. Extensive numerical experiments and real data analysis illustrate the effectiveness and broad applicability of our proposed test.

统计学机器学习计量经济学非参数检验生成神经网络