A simple TUI for serving local LLM models. Pick a model, pick a backend, serve it - View it on GitHub
Star
236
Rank
154421