Gaussian Variational Approximation for Ordinal Data with Crossed Random Effects
提出一种Gaussian变分近似方法,用于估计带交叉随机效应的大规模有序响应模型,在标准笔记本电脑上几分钟内即可处理数百万条观测数据,计算速度接近线性,精度接近Laplace近似。
We consider large scale ordinal response models with crossed random effects. We use a Gaussian variational approximation simplifying the associated optimization problem using the delta method, and other approximations to calculate both point estimates and standard errors whilst maintaining computational scalability. We apply our methodology on large scale recommender systems and are able to fit the proposed model with millions of observations within minutes on a standard laptop computer. Experiments show that estimation using this methodology scales close to linearly, and a factor better than the Penalized Quasi-Likelihood (PQL), with the number of observations, while maintaining an accuracy close to the Laplace Approximation (LA) with only slightly more underestimated variance parameters compared to LA in these large-scale settings. Our method thereby enables estimation of accurate, large scale ordinal models with crossed random effects.