The Unofficial Tensorflow 2 Implementations of MADGRAD Optimizers. - View it on GitHub