SwiftLM
✅ Recently maintained⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
792Stars
57Forks
+57-day stars
Swift · MIT · Last push 2026-11-01
Official repository & installation ↗Star history
2026-03-162026-11-02
View historical data
| Date | Stars |
|---|---|
| 2026-10-04 | 775 |
| 2026-10-05 | 776 |
| 2026-10-06 | 776 |
| 2026-10-07 | 776 |
| 2026-10-08 | 777 |
| 2026-10-09 | 778 |
| 2026-10-10 | 779 |
| 2026-10-11 | 779 |
| 2026-10-12 | 779 |
| 2026-10-13 | 780 |
| 2026-10-14 | 782 |
| 2026-10-15 | 783 |
| 2026-10-16 | 784 |
| 2026-10-17 | 784 |
| 2026-10-18 | 784 |
| 2026-10-19 | 784 |
| 2026-10-20 | 784 |
| 2026-10-21 | 786 |
| 2026-10-22 | 787 |
| 2026-10-23 | 787 |
| 2026-10-24 | 787 |
| 2026-10-25 | 787 |
| 2026-10-26 | 788 |
| 2026-10-27 | 788 |
| 2026-10-28 | 791 |
| 2026-10-29 | 791 |
| 2026-10-30 | 792 |
| 2026-10-31 | 792 |
| 2026-11-01 | 792 |
| 2026-11-02 | 792 |
Get the project
git clone https://github.com/SharpAI/SwiftLM.git
Related projects & alternative candidates
Related domains do not imply feature parity. Review official documentation and licenses.
sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 38,359vllmHigh-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.
★ 96,103hermes-agentOpen-source AI agent from Nous Research that works with Claude, GPT and other models and grows with use.
★ 259,584