General benchmarking apparatus for running multi-agent systems against benchmarks - View it on GitHub