lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch - View it on GitHub