dphnAI/sonar

sonar

✅ Recently maintained

Large-scale LLM inference engine

1,899Stars
213Forks
+137-day stars

Python · AGPL-3.0 · Last push 2026-10-30

Official repository & installation ↗
api-restinference-enginemachine-learningcudainferentiarocmintelloraspeculative-decodingtpu

Star history

2025-09-292026-11-02
View historical data
DateStars
2026-10-041,867
2026-10-051,867
2026-10-061,868
2026-10-071,869
2026-10-081,870
2026-10-091,871
2026-10-101,871
2026-10-111,872
2026-10-121,872
2026-10-131,874
2026-10-141,874
2026-10-151,875
2026-10-161,876
2026-10-171,877
2026-10-181,877
2026-10-191,878
2026-10-201,878
2026-10-211,880
2026-10-221,880
2026-10-231,882
2026-10-241,884
2026-10-251,885
2026-10-261,890
2026-10-271,893
2026-10-281,894
2026-10-291,896
2026-10-301,897
2026-10-311,899
2026-11-011,899
2026-11-021,899

Get the project

git clone https://github.com/dphnAI/sonar.git

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

LLMs-from-scratch

Step-by-step guide to building a GPT-like LLM from scratch in PyTorch.

★ 107,671vllm

High-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.

★ 96,103OpenBB

Open Data Platform for analysts, quants and AI agents.

★ 75,010