I Got More Data, My Model is More Refined, but My Estimator is Getting Worse! Am I Just Dumb?
指出，在非概率原则方法下，更多数据或更好模型并不保证估计量更优，并通过回归参数和相关系数估计等常见任务演示这一现象，提出检测和避免陷阱的策略。
Possibly, but more likely you are merely a victim of conventional wisdom. More data or better models by no means guarantee better estimators (e.g., with a smaller mean squared error), when you are not following probabilistically principled methods such as MLE (for large samples) or Bayesian approaches. Estimating equations are particularly vulnerable in this regard, almost a necessary price for their robustness. These points will be demonstrated via common tasks of estimating regression parameters and correlations, under simple models such as bivariate normal and ARCH(1). Some general strategies for detecting and avoiding such pitfalls are suggested, including checking for self-efficiency (Meng, 1994 Meng , X.-L. ( 1994 ). Multiple-imputation inferences with uncongenial sources of input (with discussions) . Statistical Science 9 : 538 – 573 .[Web of Science ®] , [Google Scholar]; Statistical Science) and adopting a guiding working model. Using the example of estimating the autocorrelation ρ under a stationary AR(1) model, we also demonstrate the interaction between model assumptions and observation structures in seeking additional information, as the sampling interval s increases. Furthermore, for a given sample size, the optimal s for minimizing the asymptotic variance of is s = 1 if and only if ρ2 ≤ 1/3; beyond that region the optimal s increases at the rate of log −1(ρ−2) as ρ approaches a unit root, as does the gain in efficiency relative to using s = 1. A practical implication of this result is that the so-called “non-informative” Jeffreys prior can be far from non-informative even for stationary time series models, because here it converges rapidly to a point mass at a unit root as s increases. Our overall emphasis is that intuition and conventional wisdom need to be examined via critical thinking and theoretical verification before they can be trusted fully.