llmperf bench is a toolkit to benchmark Hugging Face TGI with llmperf easily. - View it on GitHub