Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models. - View it on GitHub