A framework to evaluate LLMs on multiple choice benchmarks. - View it on GitHub