OlliteRT
✅ Recently maintainedTurn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source
Kotlin · Apache-2.0 · Last push 2026-11-01
Official repository & installation ↗GitValue · Value evidence
Unscored · Evidence coverage 0%
Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.
Star history
View historical data
| Date | Stars |
|---|---|
| 2026-10-05 | 518 |
| 2026-10-06 | 523 |
| 2026-10-07 | 532 |
| 2026-10-08 | 547 |
| 2026-10-09 | 555 |
| 2026-10-10 | 557 |
| 2026-10-11 | 558 |
| 2026-10-12 | 561 |
| 2026-10-13 | 561 |
| 2026-10-14 | 564 |
| 2026-10-15 | 565 |
| 2026-10-16 | 567 |
| 2026-10-17 | 568 |
| 2026-10-18 | 569 |
| 2026-10-19 | 570 |
| 2026-10-20 | 572 |
| 2026-10-21 | 574 |
| 2026-10-22 | 574 |
| 2026-10-23 | 575 |
| 2026-10-24 | 576 |
| 2026-10-25 | 577 |
| 2026-10-26 | 580 |
| 2026-10-27 | 586 |
| 2026-10-28 | 592 |
| 2026-10-29 | 594 |
| 2026-10-30 | 596 |
| 2026-10-31 | 596 |
| 2026-11-01 | 598 |
| 2026-11-02 | 601 |
| 2026-11-03 | 605 |
Get the project
git clone https://github.com/NightMean/OlliteRT.gitCloning downloads the source. For dependencies and installation, follow the project README.
Related projects & alternative candidates
Related domains do not imply feature parity. Review official documentation and licenses.
LLM inference server for Apple Silicon with continuous batching and SSD caching, managed from the macOS menu bar.
★ 23,304vllmHigh-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.
★ 96,180litellmCall 100+ LLM APIs using the OpenAI input/output format.
★ 62,604