Learnable Semi-structured Sparsity for Vision Transformers and Diffusion Transformers - View it on GitHub