AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads - View it on GitHub