A quickstart and benchmark for pytorch distributed training. - View it on GitHub