Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud. - View it on GitHub