mini runtime that suitable for model inference in server. - View it on GitHub