Inferact is an AI inference infrastructure startup founded by the creators and core maintainers of vLLM, the most popular open-source LLM inference engine. Its mission is to grow vLLM as the world's AI inference engine and to make serving AI models effortless — as simple as spinning up a serverless database — by optimizing inference performance… -
View it on GitHub