A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM - View it on GitHub
Star
3
Rank
3385544