TensorRT is a C++ library that facilitates high performance inference on NVIDIA GPUs and deep learning accelerators. - View it on GitHub