The Null Result Penalty
研究显示,经济学领域中对零结果研究的评价存在系统性偏见,即使样本量和估计精度相同,零结果也被认为更不可发表、质量更低、重要性更差,这种惩罚在博士生和期刊编辑中程度相似。
Abstract We examine how the evaluation of research studies in economics depends on whether a study yielded a null result. Studies with null results are perceived to be less publishable, of lower quality, less important and less precisely estimated than studies with large and statistically significant results, even when holding constant all other study features, including the sample size and the precision of the estimates. The null result penalty is of similar magnitude among PhD students and journal editors. The penalty is larger when experts predict a large effect and when statistical uncertainty is communicated with p-values rather than standard errors. Our findings highlight the value of a pre-result review.