noonghunna/club-3090

club-3090

✅ Recently maintained

Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and model-agnostic. Currently shipping Qwen3.8-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B configs for 1×/2×/4x/8x cards.

2,473Stars
169Forks
+257-day stars

Python · Apache-2.0 · Last push 2026-11-03

Official repository & installation ↗

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2026-04-272026-11-03
View historical data
DateStars
2026-10-052,346
2026-10-062,350
2026-10-072,352
2026-10-082,355
2026-10-092,358
2026-10-102,364
2026-10-112,373
2026-10-122,378
2026-10-132,386
2026-10-142,393
2026-10-152,397
2026-10-162,399
2026-10-172,399
2026-10-182,403
2026-10-192,411
2026-10-202,417
2026-10-212,425
2026-10-222,433
2026-10-232,436
2026-10-242,440
2026-10-252,443
2026-10-262,447
2026-10-272,451
2026-10-282,454
2026-10-292,458
2026-10-302,462
2026-10-312,467
2026-11-012,470
2026-11-022,472
2026-11-032,473

Get the project

git clone https://github.com/noonghunna/club-3090.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

vllm

High-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.

★ 96,180litellm

Call 100+ LLM APIs using the OpenAI input/output format.

★ 62,604sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 38,386