This is the repository for the paper "Token Weighting for Long-Range Language Modeling" to appear in NAACL 2025 (Findings) - View it on GitHub