The Triton Inference Server provides an optimized cloud and edge inferencing solution. - View it on GitHub