LMDeploy is a toolkit for compressing, deploying, and serving LLMs. - View it on GitHub