According to funcwj's uPIT, the training code supporting multi-gpu is written, and the Dataloader is reconstructed. - View it on GitHub