The TensorRT Inference Server provides a cloud inferencing solution optimized for NVIDIA GPUs. - View it on GitHub