This repository provides a framework to serve LLM(Large Language Model) based applications such as Chatbot. - View it on GitHub