This is a benchmarking tool to help evaluate the performance of a given LLM and hardware platform. - View it on GitHub