a community oriented 1:1 vLLM port in C++ with additional features - View it on GitHub