A lightweight inference engine supporting speculative speculative decoding (SSD). - View it on GitHub
Star
0
Rank
14086930