Conditioning on posterior samples for flexible frequentist goodness-of-fit testing
本文提出一种新的拟合优度检验方法,通过从贝叶斯后验分布中采样作为近似充分统计量,扩展了现有方法的适用范围,并在多个常见模型上验证了其有效性和优越性。
Summary Tests of goodness of fit are used in nearly every domain where statistics is applied.One powerful and flexible approach is to sample artificial data sets that are exchangeable with the real data under the null hypothesis (but not under the alternative), as this allows the analyst to conduct a valid test using any test statistic they desire. Such sampling is typically done by conditioning on either an exact or approximate sufficient statistic, but existing methods for doing so have significant limitations, which either preclude their use or substantially reduce their power or computational tractability for many important models. In this paper, we propose to condition on samples from a Bayesian posterior distribution, which constitute a very different type of approximate sufficient statistic than those considered in prior work. Our approach, approximately co-sufficient sampling via Bayes , considerably expands the scope of this flexible type of goodness-of-fit testing. We prove the approximate validity of the resulting test, and demonstrate its utility on three common null models where no existing methods apply, as well as its outperformance on models where existing methods do apply.