paddler
β Recently maintainedOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ππ¦ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
1,685Stars
97Forks
+37-day stars
Rust Β· Apache-2.0 Β· Last push 2026-10-30
Official repository & installation βStar history
2025-09-292026-11-02
View historical data
| Date | Stars |
|---|---|
| 2026-10-04 | 1,674 |
| 2026-10-05 | 1,675 |
| 2026-10-06 | 1,675 |
| 2026-10-07 | 1,675 |
| 2026-10-08 | 1,675 |
| 2026-10-09 | 1,675 |
| 2026-10-10 | 1,675 |
| 2026-10-11 | 1,675 |
| 2026-10-12 | 1,675 |
| 2026-10-13 | 1,675 |
| 2026-10-14 | 1,675 |
| 2026-10-15 | 1,678 |
| 2026-10-16 | 1,679 |
| 2026-10-17 | 1,679 |
| 2026-10-18 | 1,679 |
| 2026-10-19 | 1,679 |
| 2026-10-20 | 1,681 |
| 2026-10-21 | 1,681 |
| 2026-10-22 | 1,681 |
| 2026-10-23 | 1,681 |
| 2026-10-24 | 1,681 |
| 2026-10-25 | 1,682 |
| 2026-10-26 | 1,682 |
| 2026-10-27 | 1,683 |
| 2026-10-28 | 1,685 |
| 2026-10-29 | 1,685 |
| 2026-10-30 | 1,685 |
| 2026-10-31 | 1,685 |
| 2026-11-01 | 1,685 |
| 2026-11-02 | 1,685 |
Get the project
git clone https://github.com/intentee/paddler.git
Related projects & alternative candidates
Related domains do not imply feature parity. Review official documentation and licenses.
composio
Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into act
β 30,872hermes-agentOpen-source AI agent from Nous Research that works with Claude, GPT and other models and grows with use.
β 259,584firecrawlCrawls and scrapes web pages into clean Markdown for AI agents and LLM pipelines.
β 197,744