thu-pacman/chitu

chitu

✅ Recently maintained

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

2,996Stars
249Forks
+57-day stars

Python · Apache-2.0 · Last push 2026-11-02

Official repository & installation ↗
deepseekgpullmpytorchllm-servingmodel-serving

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-02
View historical data
DateStars
2026-10-042,975
2026-10-052,975
2026-10-062,976
2026-10-072,977
2026-10-082,977
2026-10-092,977
2026-10-102,977
2026-10-112,977
2026-10-122,980
2026-10-132,980
2026-10-142,982
2026-10-152,984
2026-10-162,984
2026-10-172,984
2026-10-182,984
2026-10-192,985
2026-10-202,987
2026-10-212,988
2026-10-222,988
2026-10-232,988
2026-10-242,989
2026-10-252,989
2026-10-262,990
2026-10-272,992
2026-10-282,993
2026-10-292,996
2026-10-302,996
2026-10-312,996
2026-11-012,996
2026-11-022,996

Get the project

git clone https://github.com/thu-pacman/chitu.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

vllm

High-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.

★ 96,180sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 38,386litellm

Call 100+ LLM APIs using the OpenAI input/output format.

★ 62,604