Really simple unofficial PyTorch implementation of the InfiniAttention paper (https://arxiv.org/pdf/2404.07143). - View it on GitHub