ome-projects/ome

ome

✅ Recently maintained

Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

523Stars
106Forks
+27-day stars

Go · Apache-2.0 · Last push 2026-11-03

Official repository & installation ↗
k8sllm-inferencemodel-as-a-servicemodel-servingmulti-node-kubernetesoracle-cloudsglangllmdeepseekkimi-k2

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-03
View historical data
DateStars
2026-10-05512
2026-10-06512
2026-10-07513
2026-10-08513
2026-10-09513
2026-10-10513
2026-10-11513
2026-10-12514
2026-10-13515
2026-10-14515
2026-10-15515
2026-10-16517
2026-10-17517
2026-10-18517
2026-10-19518
2026-10-20518
2026-10-21518
2026-10-22519
2026-10-23520
2026-10-24520
2026-10-25520
2026-10-26521
2026-10-27521
2026-10-28521
2026-10-29522
2026-10-30522
2026-10-31522
2026-11-01522
2026-11-02523
2026-11-03523

Get the project

git clone https://github.com/ome-projects/ome.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

private-gpt

Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference serve

★ 57,626