Reusing Natural Experiments
通过基于真实数据的模拟,说明研究者重复使用自然实验时产生的多重假设检验问题,并为差分法、工具变量和回归不连续设计等常见实证设定提供推断指导。
ABSTRACT After a natural experiment is first used, other researchers often reuse the setting, examining different outcome variables. We use simulations based on real data to illustrate the multiple hypothesis testing problem that arises when researchers reuse natural experiments. We then provide guidance for future inference based on popular empirical settings including difference‐in‐differences, instrumental variables, and regression discontinuity designs. When we apply our guidance to two extensively studied natural experiments, business combination laws and the Regulation SHO pilot, we find that many results that were statistically significant using single hypothesis testing do not survive corrections for multiple hypothesis testing.