Evaluate and Optimize Your LLM Deployments for Real-World Inference Needs - View it on GitHub