Residual Diagnostics for Mixture Models
本文提出基于观测与期望拟合之比的残差来评估混合模型拟合的充分性,利用同质性模型残差的凸性检测混合存在,并通过平滑残差确定非参数最大似然估计的支持点数量,辅助EM算法求解。
Abstract A sample is commonly modeled by a mixture distribution if the observations follow a common distribution, but the parameter of interest differs between observations. For example, we observe the lengths but not the ages of a sample offish. It may be reasonable to assume that length is normally distributed about an unknown mean that depends on the age of the fish. Provided there is more than one age class in the sample, then the data are distributed as a mixture of normals. In this article we assume that the data are a random sample from a mixture of exponential family distributions and that for each observation the parameter of interest is sampled independently from an unknown mixing distribution Q. The adequacy of a fitted mixture model can be assessed by examining residuals based on the ratio of the observed to expected fit. Residuals based on the homogeneity model (in which Q is a one-point distribution) display a convexity property when the data follow a mixture model; this becomes the basis for diagnostic plots to detect the presence of mixing. Similar results also are obtained from smoothed residuals; thus the diagnostic also can be applied to sparse or continuous data. The nonparametric maximum likelihood estimate [Qcirc] of the distribution Q is known to be discrete. Smoothed residuals obtained from the fitted mixed model provide information about the number of support points in [Qcirc]. This facilitates the use of the EM algorithm to find [Qcirc]. The residuals evaluated at [Qcirc] determine whether or not the maximum likelihood estimate is unique and hence interpretable. Simulated and actual data sets are analyzed to illustrate the power and the utility of these procedures.