Researchers' degrees of flexibility: Revisiting COVID‐19 policy evaluations
研究发现,早期新冠政策对社会距离影响的估计结果,在研究者通常未探索的灵活度维度上并不稳健,常规稳健性检验也未能发现这些问题。
Abstract Empirical research involves multiple, seemingly‐minor choices that can substantially impact a study's findings. While acknowledged, the importance of these “degrees of flexibility” on published estimates is not well understood. We examine the considerable literature focused on the impacts of early COVID‐19 policies on social distancing to assess the role of researchers' degrees of flexibility on the estimated effects of mobility‐reducing policies. We find that estimates reported in previous studies are not robust to minor changes in typically‐unexplored dimensions of the degree of flexibility space, and usual robustness tests systematically fail to detect these issues.