openvinotoolkit/model_server

model_server

✅ Recently maintained

A scalable inference server for models optimized with OpenVINO™

953Stars
291Forks
+17-day stars

C++ · Apache-2.0 · Last push 2026-10-31

Official repository & installation ↗
openvinoinferenceaiedgeclouddeep-learningservingdagkubernetesmachine-learning

Star history

2025-09-292026-11-02
View historical data
DateStars
2026-10-04941
2026-10-05942
2026-10-06945
2026-10-07945
2026-10-08946
2026-10-09947
2026-10-10947
2026-10-11947
2026-10-12947
2026-10-13947
2026-10-14947
2026-10-15947
2026-10-16948
2026-10-17948
2026-10-18950
2026-10-19952
2026-10-20952
2026-10-21952
2026-10-22952
2026-10-23952
2026-10-24952
2026-10-25952
2026-10-26952
2026-10-27952
2026-10-28952
2026-10-29952
2026-10-30952
2026-10-31952
2026-11-01953
2026-11-02953

Get the project

git clone https://github.com/openvinotoolkit/model_server.git

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

LLMs-from-scratch

Step-by-step guide to building a GPT-like LLM from scratch in PyTorch.

★ 107,671AI-For-Beginners

Microsoft official 12-week, 24-lesson curriculum covering symbolic AI, neural networks, CV, and NLP for beginners.

★ 70,448ai-engineering-from-scratch

A hands-on course that teaches AI engineering by building agents, transformers, and ML systems from scratch.

★ 76,295