RunPod serverless worker for the vLLM AI text-gen inference. Simple, optimized and customisable. - View it on GitHub
Star
0
Rank
13840946