jmaczan/tiny-vllm

tiny-vllm

✅ 近期有维护

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

1,180Stars
102Forks
+11近 7 天 Star

C++ · Apache-2.0 · 最近推送 2026-11-01

官方仓库与安装文档 ↗

Star 历史

2026-02-092026-11-02
查看历史数据
日期Stars
2026-10-041,140
2026-10-051,141
2026-10-061,143
2026-10-071,144
2026-10-081,146
2026-10-091,147
2026-10-101,147
2026-10-111,148
2026-10-121,150
2026-10-131,151
2026-10-141,151
2026-10-151,151
2026-10-161,152
2026-10-171,154
2026-10-181,156
2026-10-191,156
2026-10-201,157
2026-10-211,160
2026-10-221,162
2026-10-231,162
2026-10-241,166
2026-10-251,168
2026-10-261,170
2026-10-271,172
2026-10-281,173
2026-10-291,174
2026-10-301,175
2026-10-311,178
2026-11-011,180
2026-11-021,180

获取项目

git clone https://github.com/jmaczan/tiny-vllm.git

相关项目与平替候选

同领域不等于功能完全相同,选型前请核对官方文档和许可证。