Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599 - View it on GitHub