H. Christian M. Holme1,2 and Martin Uecker1,2,3
1Institute for Diagnostic and Interventional Radiology, University Medical Center Göttingen, Göttingen, Germany, 2Partner Site Göttingen, DZHK (German Centre for Cardiovascular Research), Göttingen, Germany, 3Campus Institute Data Science (CIDAS), University of Göttingen, Göttingen, Germany
1Institute for Diagnostic and Interventional Radiology, University Medical Center Göttingen, Göttingen, Germany, 2Partner Site Göttingen, DZHK (German Centre for Cardiovascular Research), Göttingen, Germany, 3Campus Institute Data Science (CIDAS), University of Göttingen, Göttingen, Germany
In science, it is important to ensure reproducibility of published results and also to ensure that this is achieved in such a way that it is possible to build on existing results. Therefore, we describe a workflow to verify the reproducibility of publications that make use of the BART toolbox.
Figure 1: Overview over the steps performed by our automatic reproducibility test. An example of a config file can be seen in Fig 2.
Figure 2: Configuration file for reproducing the demo data included with [5], showing the NRMSE-Tolerance, the reference version of BART and the test branch, as well as the scripts (in this case just "all.sh") and the outputs to be tested (recon-turnbased and reco-goldenangle). While not a full reproduction of all results of that publication, this configuration file can serve as an illustrative example.
