Simple Tensorflow implementation of "On the Convergence of Adam and Beyond" (ICLR 2018) - View it on GitHub