[ICML 2026 Spotlight] Official implementation of TetraJet-v2: Accurate NVFP4 Training for LLMs, with fully-NVFP4 linear layer with unbiased backprop, and algorithms to overcome LLMs' weight-oscillation and activation-outlier bottlenecks. -
View it on GitHub