Gitstar Ranking
Users
Organizations
Repositories
Rankings
Users
Organizations
Repositories
Sign in with GitHub
hijkzzz
Fetched on 2024/12/05 06:51
hijkzzz
/
Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc. -
View it on GitHub
https://github.com/DefTruth/Awesome-LLM-Inference
Star
2
Rank
3449277