Luce-Org/lucebox

lucebox

✅ Recently maintained

LLM speculative inference server for heterogeneous hardware & consumer GPUs

2,970Stars
286Forks
+127-day stars

C++ · Apache-2.0 · Last push 2026-11-02

Official repository & installation ↗
kernelllama-cpplocal-aiqwenrtx3090megakernelcudacuda-kernelsdflashluce

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2026-03-302026-11-02
View historical data
DateStars
2026-10-042,887
2026-10-052,890
2026-10-062,891
2026-10-072,894
2026-10-082,895
2026-10-092,899
2026-10-102,901
2026-10-112,905
2026-10-122,906
2026-10-132,909
2026-10-142,915
2026-10-152,919
2026-10-162,921
2026-10-172,924
2026-10-182,930
2026-10-192,933
2026-10-202,938
2026-10-212,940
2026-10-222,946
2026-10-232,951
2026-10-242,952
2026-10-252,954
2026-10-262,958
2026-10-272,959
2026-10-282,961
2026-10-292,962
2026-10-302,964
2026-10-312,968
2026-11-012,969
2026-11-022,970

Get the project

git clone https://github.com/Luce-Org/lucebox.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

private-gpt

Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference serve

★ 57,624