Sequential Gibbs posteriors with applications to principal component analysis
提出序贯吉布斯后验方法,解决传统吉布斯后验在不确定性量化上的不足,证明其满足伯恩斯坦-冯·米塞斯定理,并在主成分分析中展示应用。
Summary Gibbs posteriors are proportional to a prior distribution multiplied by an exponentiated loss function, with a key tuning parameter that weights the information in the loss relative to the prior and provides control of posterior uncertainty. Gibbs posteriors provide a principled framework for likelihood-free Bayesian inference; however, in many situations, the inclusion of a single tuning parameter inevitably leads to poor uncertainty quantification. In particular, regardless of the value of the parameter, credible regions are far from attaining nominal frequentist coverage, even in large samples. We propose a sequential extension to Gibbs posteriors to address this problem. We prove that the proposed sequential posterior exhibits concentration and satisfies a Bernstein–von Mises theorem, which holds under easily verifiable conditions in Euclidean space and on manifolds. As a by-product, we obtain the first Bernstein–von Mises theorem for traditional likelihood-based Bayesian posteriors on manifolds. All methods are illustrated with an application to principal component analysis.