ovg-project/kvcached

kvcached

✅ Recently maintained

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

2,020Stars
235Forks
+107-day stars

Python · Apache-2.0 · Last push 2026-11-03

Official repository & installation ↗
gpu-sharingkvcachellmsglangvllmkvcachedinference-enginegpu-mutiplexingkvcache-optimizationllm-framework

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-03
View historical data
DateStars
2026-10-051,506
2026-10-061,509
2026-10-071,510
2026-10-081,512
2026-10-091,541
2026-10-101,556
2026-10-111,583
2026-10-121,604
2026-10-131,635
2026-10-141,662
2026-10-151,686
2026-10-161,724
2026-10-171,749
2026-10-181,793
2026-10-191,820
2026-10-201,856
2026-10-211,886
2026-10-221,909
2026-10-231,944
2026-10-241,975
2026-10-252,006
2026-10-262,009
2026-10-272,013
2026-10-282,015
2026-10-292,017
2026-10-302,018
2026-10-312,018
2026-11-012,018
2026-11-022,018
2026-11-032,020

Get the project

git clone https://github.com/ovg-project/kvcached.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

vllm

High-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.

★ 96,180litellm

Call 100+ LLM APIs using the OpenAI input/output format.

★ 62,604sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 38,386