Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients" - View it on GitHub