AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution. - View it on GitHub