A framework for evaluating reproducibility and replicability in economics
提出了一个评估经济学研究可重复性和可复制性的框架,将研究分为五种类型,并设计了衡量单个研究和一组研究可重复性程度的指标。
Abstract We propose a framework for evaluating reproducibility and replicability in economics. Reproducibility is defined as testing if the results of an original study can be reproduced using the same data and replicability is defined as testing if the results of an original study hold in new data. We further divide reproducibility and replicability studies into five types: computational reproducibility, recreate reproducibility, robustness reproducibility, direct replicability and conceptual replicability. In addition to this typology we propose indicators to measure the degree of reproducibility and replicability in both individual studies and for a group of studies.