%0 Book Section
%@ 978-3-86488-172-5
%A Breuer, Timo
%A Schaer, Philipp
%B Information between Data and Knowledge
%C Glückstadt
%D 2021
%F epub:44953
%I Werner Hülsbusch
%K reproducibility; evaluation infrastructure; shared tasks
%P 348-362
%S Schriften zur Informationswissenschaft
%T A Living Lab Architecture for Reproducible Shared Task Experimentation
%U https://epub.uni-regensburg.de/44953/
%V 74
%X No existing evaluation infrastructure for shared tasks currently supports both reproducible on- and offline experiments. In this work, we present an architecture that ties together both types of experiments with a focus on reproducibility. The readers are provided with a technical description of the infrastructure and details of how to contribute their own experiments to upcoming evaluation tasks.
%Z Session 6: Emerging Technologies