ztxz16/fastllm

fastllm

✅ Recently maintained

fastllm是后端无依赖的高性能大模型推理库，帮助您在大部分设备上高效推理大模型！

5,130Stars
505Forks
+97-day stars

C++ · Apache-2.0 · Last push 2026-11-02

Official repository & installation ↗

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-03
View historical data
DateStars
2026-10-055,081
2026-10-065,081
2026-10-075,083
2026-10-085,086
2026-10-095,090
2026-10-105,091
2026-10-115,092
2026-10-125,094
2026-10-135,096
2026-10-145,100
2026-10-155,100
2026-10-165,101
2026-10-175,101
2026-10-185,103
2026-10-195,104
2026-10-205,106
2026-10-215,108
2026-10-225,110
2026-10-235,114
2026-10-245,116
2026-10-255,119
2026-10-265,120
2026-10-275,124
2026-10-285,127
2026-10-295,127
2026-10-305,130
2026-10-315,130
2026-11-015,130
2026-11-025,130
2026-11-035,130

Get the project

git clone https://github.com/ztxz16/fastllm.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.