Skip to content

Demonstration on Colab

Open In Colab

In order to demonstrate what kinds of reproducibility experiments and meta-evaluation are made possible through the metadata annotations, we provide an interactive Python notebook that can be run on Google Colab.

The notebook gives a general introduction to the metadata handling that is implemented by the metadata-module in repro_eval and provides the experiments of Section 6 in the resource paper.