An OAI compatible exllamav2 API that's both lightweight and fast - View it on GitHub