intentee/paddler

paddler

✅ 近期有维护

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

1,685Stars
97Forks
+3近 7 天 Star

Rust · Apache-2.0 · 最近推送 2026-10-30

官方仓库与安装文档 ↗

Star 历史

2025-09-292026-11-02
查看历史数据
日期Stars
2026-10-041,674
2026-10-051,675
2026-10-061,675
2026-10-071,675
2026-10-081,675
2026-10-091,675
2026-10-101,675
2026-10-111,675
2026-10-121,675
2026-10-131,675
2026-10-141,675
2026-10-151,678
2026-10-161,679
2026-10-171,679
2026-10-181,679
2026-10-191,679
2026-10-201,681
2026-10-211,681
2026-10-221,681
2026-10-231,681
2026-10-241,681
2026-10-251,682
2026-10-261,682
2026-10-271,683
2026-10-281,685
2026-10-291,685
2026-10-301,685
2026-10-311,685
2026-11-011,685
2026-11-021,685

获取项目

git clone https://github.com/intentee/paddler.git

相关项目与平替候选

同领域不等于功能完全相同,选型前请核对官方文档和许可证。