vllm-project/ speculators star history
A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM.
vllm-project/speculators has 955 GitHub stars as of . Source: GitHub's public API.