The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our ICML2022 Oral paper: "Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum". - View it on GitHub