vllm-project/semantic-router

semantic-router

✅ Recently maintained

An open, programmable decision layer for models and compute.

6,385Stars
1,101Forks
+1087-day stars

Go · Apache-2.0 · Last push 2026-11-03

Official repository & installation ↗
mixture-of-modelssemantic-routervllmai-gatewaykubernetesllmrouterllmguardrailsinferencepytorch

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-03
View historical data
DateStars
2026-10-056,023
2026-10-066,028
2026-10-076,037
2026-10-086,052
2026-10-096,058
2026-10-106,066
2026-10-116,089
2026-10-126,118
2026-10-136,144
2026-10-146,167
2026-10-156,186
2026-10-166,197
2026-10-176,201
2026-10-186,208
2026-10-196,218
2026-10-206,231
2026-10-216,242
2026-10-226,246
2026-10-236,250
2026-10-246,251
2026-10-256,257
2026-10-266,274
2026-10-276,281
2026-10-286,305
2026-10-296,318
2026-10-306,346
2026-10-316,354
2026-11-016,361
2026-11-026,379
2026-11-036,385

Get the project

git clone https://github.com/vllm-project/semantic-router.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

private-gpt

Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference serve

★ 57,626bifrost

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failo

★ 9,308