Inferact is an AI inference infrastructure startup founded by the creators and core maintainers of vLLM, the most popular open-source LLM inference engine. Its mission is to grow vLLM as the world's AI inference engine and to make serving AI models effortless — as simple as spinning up a serverless database — by optimizing inference performance… - View it on GitHub
Star
0
Rank
14385819