an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere) - View it on GitHub