inference
✅ Recently maintainedSwap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
9,636Stars
891Forks
+97-day stars
Python · Apache-2.0 · Last push 2026-11-02
Official repository & installation ↗GitValue · Value evidence
Unscored · Evidence coverage 0%
Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.
Star history
2025-09-292026-11-02
View historical data
| Date | Stars |
|---|---|
| 2026-10-04 | 9,582 |
| 2026-10-05 | 9,585 |
| 2026-10-06 | 9,587 |
| 2026-10-07 | 9,591 |
| 2026-10-08 | 9,593 |
| 2026-10-09 | 9,593 |
| 2026-10-10 | 9,596 |
| 2026-10-11 | 9,598 |
| 2026-10-12 | 9,600 |
| 2026-10-13 | 9,601 |
| 2026-10-14 | 9,604 |
| 2026-10-15 | 9,604 |
| 2026-10-16 | 9,606 |
| 2026-10-17 | 9,608 |
| 2026-10-18 | 9,610 |
| 2026-10-19 | 9,611 |
| 2026-10-20 | 9,615 |
| 2026-10-21 | 9,619 |
| 2026-10-22 | 9,621 |
| 2026-10-23 | 9,622 |
| 2026-10-24 | 9,624 |
| 2026-10-25 | 9,626 |
| 2026-10-26 | 9,627 |
| 2026-10-27 | 9,628 |
| 2026-10-28 | 9,631 |
| 2026-10-29 | 9,633 |
| 2026-10-30 | 9,635 |
| 2026-10-31 | 9,636 |
| 2026-11-01 | 9,636 |
| 2026-11-02 | 9,636 |
Get the project
git clone https://github.com/xorbitsai/inference.gitCloning downloads the source. For dependencies and installation, follow the project README.
Related projects & alternative candidates
Related domains do not imply feature parity. Review official documentation and licenses.