A conditional Lindley paradox in Bayesian linear models
本文提出一种条件信息渐近框架,分析混合g先验在回归系数差异较大时的表现,揭示了最小二乘估计和条件林德利悖论两个新现象,并指出它们通常是不理想的。
The development of prior distributions for Bayesian regression has traditionally been driven by the goal of achieving sensible model selection and parameter estimation. The formalization of properties that characterize good performance has led to the development and popularization of thick-tailed mixtures of g priors such as the Zellner–Siow and hyper-g priors. In this paper we introduce a conditional information asymptotic regime that is motivated by the common data analysis setting where at least one regression coefficient is much larger than the others. We analyse existing mixtures of g priors under this limit and reveal two new phenomena, essentially least-squares estimation and the conditional Lindley paradox, and argue that these are, in general, undesirable. The driver behind both is the use of a single, latent scale parameter common to all coefficients.