The influence of hidden researcher decisions in applied microeconomics
通过多位研究者独立复制两项已发表的因果实证研究，发现数据准备和分析决策差异巨大，且多数决策不会在论文中报告，导致样本量、统计显著性和效应符号在不同复制中不一致，估计值的标准差是报告标准误的3-4倍。
Abstract Researchers make hundreds of decisions about data collection, preparation, and analysis in their research. We use a many‐analysts approach to measure the extent and impact of these decisions. Two published causal empirical results are replicated by seven replicators each. We find large differences in data preparation and analysis decisions, many of which would not likely be reported in a publication. No two replicators reported the same sample size. Statistical significance varied across replications, and for one of the studies the effect's sign varied as well. The standard deviation of estimates across replications was 3–4 times the mean reported standard error.