DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including x86 and ARMv9. - View it on GitHub
Star
1
Rank
5982720