Bias Reduction of Autoregressive Estimates in Time Series Regression Model through Restricted Maximum Likelihood
研究了时间序列回归模型中自回归参数的最大似然和限制最大似然估计的偏差，发现限制最大似然估计偏差更小，尤其适用于短或中等样本长度，能提高回归参数推断的准确性。
Abstract This article considers maximum likelihood (ML) and restricted maximum likelihood (REML) estimation of time series regression models with autoregressive AR(p) noise. Approximate biases of the ML and REML estimators of the AR parameters, based on their approximate representations, are derived. In addition, a bias result for the ML estimator (MLE) of the error variance is established. Numerical results are presented to illustrate the biases of the MLE and REML estimator for the AR parameters, and simulation results are provided to assess the adequacy of our approximations. The impact of bias of the AR estimates on testing of linear trend in a regression trend model is also investigated. For a time series of short or moderate sample length, the REML estimator is generally much less biased than the MLE. Consequently, the REML approach leads to more accurate inferences for the regression parameters.