Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM - View it on GitHub