An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain - View it on GitHub