A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs. - View it on GitHub