Inferact is a startup founded by the creators and core maintainers of vLLM, the widely adopted open-source large language model inference engine. The company exists to supercharge vLLM adoption, developing inference and serving optimizations at the frontier where models meet hardware at scale and flowing those improvements back into the… - View it on GitHub