Reproducibility and Data Policy for Small (Open) Journals
2023
Summary of the Report
In recent years, there has been a momentum on the part of economic journals towards adopting a data policy or upgrading the previous one. Currently, around 72% of the top 100 journals, and 76 % of the top 50 journals have some sort of data policy.
The first version of a standard for code and data availability policies, prepared by a team of data editors of economic journals, was published in December 2022. DCAS seems to be the first important collective step towards homogenising the reproducibility and data policy of the economic journals and is expected to be endorsed by more and more journals in the coming months and years.
Endorsing DCAS and building a data repository “community” on Zenodo (or another comparable open data repository host) have near zero costs for any journal and seems to be a feasible contribution towards widening adoption of reproducibility policies even for the smaller journals with lower budgets.
Enforcement, which consists of checking the documentation and the data and code package as well as re-running the codes to ensure the consistency between the paper and the linked code/data (aka “computational reproducibility”) is costly, but can be performed on different levels depending on the budget constraints. The recent experience of the Economic Inquiry journal and Canadian Journal of Economics offer useful insights for smaller journals to reconcile the increasingly demanding requirements of reproducibility with their lower levels of resources.
