Neroued/ninfer

ninfer

✅ Recently maintained

High-performance single-GPU inference for selected model checkpoints and GPUs.

3,236Stars
674Forks
+547-day stars

C++ · Apache-2.0 · Last push 2026-11-02

Official repository & installation ↗

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2026-06-222026-11-02
View historical data
DateStars
2026-10-042,685
2026-10-052,719
2026-10-062,757
2026-10-072,793
2026-10-082,831
2026-10-092,858
2026-10-102,884
2026-10-112,924
2026-10-122,955
2026-10-132,978
2026-10-143,006
2026-10-153,030
2026-10-163,043
2026-10-173,054
2026-10-183,071
2026-10-193,087
2026-10-203,105
2026-10-213,124
2026-10-223,134
2026-10-233,139
2026-10-243,151
2026-10-253,160
2026-10-263,175
2026-10-273,193
2026-10-283,201
2026-10-293,209
2026-10-303,219
2026-10-313,223
2026-11-013,229
2026-11-023,236

Get the project

git clone https://github.com/Neroued/ninfer.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.