LightLLM
✅ Recently maintainedLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
4,350Stars
383Forks
+137-day stars
Python · Apache-2.0 · Last push 2026-11-02
Official repository & installation ↗Star history
2025-09-292026-11-02
View historical data
| Date | Stars |
|---|---|
| 2026-10-04 | 4,302 |
| 2026-10-05 | 4,303 |
| 2026-10-06 | 4,303 |
| 2026-10-07 | 4,308 |
| 2026-10-08 | 4,314 |
| 2026-10-09 | 4,316 |
| 2026-10-10 | 4,317 |
| 2026-10-11 | 4,317 |
| 2026-10-12 | 4,318 |
| 2026-10-13 | 4,318 |
| 2026-10-14 | 4,319 |
| 2026-10-15 | 4,323 |
| 2026-10-16 | 4,324 |
| 2026-10-17 | 4,326 |
| 2026-10-18 | 4,327 |
| 2026-10-19 | 4,329 |
| 2026-10-20 | 4,331 |
| 2026-10-21 | 4,333 |
| 2026-10-22 | 4,334 |
| 2026-10-23 | 4,335 |
| 2026-10-24 | 4,335 |
| 2026-10-25 | 4,336 |
| 2026-10-26 | 4,338 |
| 2026-10-27 | 4,340 |
| 2026-10-28 | 4,343 |
| 2026-10-29 | 4,345 |
| 2026-10-30 | 4,346 |
| 2026-10-31 | 4,349 |
| 2026-11-01 | 4,349 |
| 2026-11-02 | 4,350 |
Get the project
git clone https://github.com/ModelTC/LightLLM.git
Related projects & alternative candidates
Related domains do not imply feature parity. Review official documentation and licenses.
vllm
High-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.
★ 96,103LLMs-from-scratchStep-by-step guide to building a GPT-like LLM from scratch in PyTorch.
★ 107,671ollamaRun DeepSeek, Qwen, Gemma and other LLMs locally with one command, plus model management and an API.
★ 185,625