vllm-project/guidellm

guidellm

✅ Recently maintained

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

1,742Stars
283Forks
+167-day stars

Python · Apache-2.0 · Last push 2026-11-02

Official repository & installation ↗

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-02
View historical data
DateStars
2026-10-041,657
2026-10-051,658
2026-10-061,662
2026-10-071,666
2026-10-081,674
2026-10-091,676
2026-10-101,680
2026-10-111,683
2026-10-121,686
2026-10-131,690
2026-10-141,691
2026-10-151,694
2026-10-161,697
2026-10-171,697
2026-10-181,700
2026-10-191,704
2026-10-201,710
2026-10-211,711
2026-10-221,715
2026-10-231,720
2026-10-241,722
2026-10-251,723
2026-10-261,726
2026-10-271,728
2026-10-281,733
2026-10-291,734
2026-10-301,734
2026-10-311,736
2026-11-011,737
2026-11-021,742

Get the project

git clone https://github.com/vllm-project/guidellm.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

vllm

High-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.

★ 96,161litellm

Call 100+ LLM APIs using the OpenAI input/output format.

★ 62,514sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 38,385