vllm-project

speculators

Recently maintained

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

Stars
938

Community interest

Forks
278

Community forks

7-day growth
+14

Observed snapshot change

Language
Python

Repository metadata

Star history & growth

Observed snapshots only. Missing observations are not invented.

938 ★49 observations
2026-08-102026-11-03
Inspect recent observations
DateStars
2026-10-05861
2026-10-06863
2026-10-07865
2026-10-08865
2026-10-09866
2026-10-10870
2026-10-11874
2026-10-12880
2026-10-13882
2026-10-14883
2026-10-15886
2026-10-16888
2026-10-17888
2026-10-18889
2026-10-19905
2026-10-20913
2026-10-21914
2026-10-22917
2026-10-23918
2026-10-24920
2026-10-25921
2026-10-26924
2026-10-27925
2026-10-28929
2026-10-29932
2026-10-30932
2026-10-31932
2026-11-01934
2026-11-02934
2026-11-03938

Get the source & start here

Cloning downloads source; follow official setup and dependency instructions.

git clone https://github.com/vllm-project/speculators.git
READMEgithub.dev

About this project

What is speculators?

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

How do I get started?

Clone with git clone https://github.com/vllm-project/speculators.git. Cloning is not a complete installation; follow the official README for dependencies, hosts and usage.

Can I use it commercially?

Current license information: Apache-2.0. Review the original terms, dependencies and your intended use.

What do maintenance and growth indicate?

Current status: Recently maintained. Activity is not a security audit. Growth uses collected snapshots; missing baselines are not estimated.