xllm
✅ Recently maintainedA high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
C++ · Apache-2.0 · Last push 2026-11-01
Official repository & installation ↗GitValue · Value evidence
Unscored · Evidence coverage 0%
Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.
Star history
View historical data
| Date | Stars |
|---|---|
| 2026-10-04 | 1,587 |
| 2026-10-05 | 1,589 |
| 2026-10-06 | 1,590 |
| 2026-10-07 | 1,592 |
| 2026-10-08 | 1,592 |
| 2026-10-09 | 1,594 |
| 2026-10-10 | 1,594 |
| 2026-10-11 | 1,595 |
| 2026-10-12 | 1,597 |
| 2026-10-13 | 1,599 |
| 2026-10-14 | 1,600 |
| 2026-10-15 | 1,600 |
| 2026-10-16 | 1,600 |
| 2026-10-17 | 1,601 |
| 2026-10-18 | 1,602 |
| 2026-10-19 | 1,602 |
| 2026-10-20 | 1,603 |
| 2026-10-21 | 1,603 |
| 2026-10-22 | 1,603 |
| 2026-10-23 | 1,604 |
| 2026-10-24 | 1,604 |
| 2026-10-25 | 1,605 |
| 2026-10-26 | 1,606 |
| 2026-10-27 | 1,609 |
| 2026-10-28 | 1,609 |
| 2026-10-29 | 1,612 |
| 2026-10-30 | 1,613 |
| 2026-10-31 | 1,613 |
| 2026-11-01 | 1,614 |
| 2026-11-02 | 1,615 |
Get the project
git clone https://github.com/xLLM-AI/xllm.gitCloning downloads the source. For dependencies and installation, follow the project README.
Related projects & alternative candidates
Related domains do not imply feature parity. Review official documentation and licenses.
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 38,385vllmHigh-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.
★ 96,161litellmCall 100+ LLM APIs using the OpenAI input/output format.
★ 62,514