LitServe
✅ Recently maintainedA minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
3,980Stars
323Forks
+247-day stars
Python · Apache-2.0 · Last push 2026-11-01
Official repository & installation ↗GitValue · Value evidence
Unscored · Evidence coverage 0%
Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.
Star history
2025-09-292026-11-02
View historical data
| Date | Stars |
|---|---|
| 2026-10-04 | 3,943 |
| 2026-10-05 | 3,943 |
| 2026-10-06 | 3,943 |
| 2026-10-07 | 3,943 |
| 2026-10-08 | 3,943 |
| 2026-10-09 | 3,946 |
| 2026-10-10 | 3,946 |
| 2026-10-11 | 3,946 |
| 2026-10-12 | 3,946 |
| 2026-10-13 | 3,947 |
| 2026-10-14 | 3,948 |
| 2026-10-15 | 3,951 |
| 2026-10-16 | 3,953 |
| 2026-10-17 | 3,953 |
| 2026-10-18 | 3,953 |
| 2026-10-19 | 3,954 |
| 2026-10-20 | 3,955 |
| 2026-10-21 | 3,955 |
| 2026-10-22 | 3,955 |
| 2026-10-23 | 3,956 |
| 2026-10-24 | 3,956 |
| 2026-10-25 | 3,956 |
| 2026-10-26 | 3,956 |
| 2026-10-27 | 3,957 |
| 2026-10-28 | 3,957 |
| 2026-10-29 | 3,957 |
| 2026-10-30 | 3,963 |
| 2026-10-31 | 3,966 |
| 2026-11-01 | 3,978 |
| 2026-11-02 | 3,980 |
Get the project
git clone https://github.com/Lightning-AI/LitServe.git
Related projects & alternative candidates
Related domains do not imply feature parity. Review official documentation and licenses.
LLMs-from-scratch
Step-by-step guide to building a GPT-like LLM from scratch in PyTorch.
★ 107,704OpenHandsOpen-source AI agent that writes code, runs commands, and fixes bugs, automating developer tasks from start to finish.
★ 92,513AI-For-BeginnersMicrosoft official 12-week, 24-lesson curriculum covering symbolic AI, neural networks, CV, and NLP for beginners.
★ 70,487