Minimal and scalable research codebase in JAX, designed for rapid iteration on frontier research in LLM and other autoregressive models. - View it on GitHub