Efficient Memory-Augmented Transformers - View it on GitHub