Multi Model Server is a tool for serving neural net models for inference - View it on GitHub