Implement llm model in pytorch, support MoE and RoPE - View it on GitHub