tiny-vllm
✅ Recently maintainedBuild your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM
1,180Stars
102Forks
+117-day stars
C++ · Apache-2.0 · Last push 2026-11-01
Official repository & installation ↗Star history
2026-02-092026-11-02
View historical data
| Date | Stars |
|---|---|
| 2026-10-04 | 1,140 |
| 2026-10-05 | 1,141 |
| 2026-10-06 | 1,143 |
| 2026-10-07 | 1,144 |
| 2026-10-08 | 1,146 |
| 2026-10-09 | 1,147 |
| 2026-10-10 | 1,147 |
| 2026-10-11 | 1,148 |
| 2026-10-12 | 1,150 |
| 2026-10-13 | 1,151 |
| 2026-10-14 | 1,151 |
| 2026-10-15 | 1,151 |
| 2026-10-16 | 1,152 |
| 2026-10-17 | 1,154 |
| 2026-10-18 | 1,156 |
| 2026-10-19 | 1,156 |
| 2026-10-20 | 1,157 |
| 2026-10-21 | 1,160 |
| 2026-10-22 | 1,162 |
| 2026-10-23 | 1,162 |
| 2026-10-24 | 1,166 |
| 2026-10-25 | 1,168 |
| 2026-10-26 | 1,170 |
| 2026-10-27 | 1,172 |
| 2026-10-28 | 1,173 |
| 2026-10-29 | 1,174 |
| 2026-10-30 | 1,175 |
| 2026-10-31 | 1,178 |
| 2026-11-01 | 1,180 |
| 2026-11-02 | 1,180 |
Get the project
git clone https://github.com/jmaczan/tiny-vllm.git
Related projects & alternative candidates
Related domains do not imply feature parity. Review official documentation and licenses.
hermes-agent
Open-source AI agent from Nous Research that works with Claude, GPT and other models and grows with use.
★ 259,584firecrawlCrawls and scrapes web pages into clean Markdown for AI agents and LLM pipelines.
★ 197,744AutoGPTOpen-source autonomous AI agent platform that breaks down and executes multi-step tasks on its own.
★ 187,861