Simple Tensorflow implementation of "On The Variance Of The Adaptive Learning Rate And Beyond" - View it on GitHub