pykeio/ort

ort

✅ Recently maintained

Fast ML inference & training for ONNX models in Rust

2,603Stars
278Forks
+107-day stars

Rust · Apache-2.0 · Last push 2026-11-01

Official repository & installation ↗
aiinferencemachine-learningonnxruntimerustonnxai-trainingfine-tuning

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-03
View historical data
DateStars
2026-10-052,549
2026-10-062,551
2026-10-072,551
2026-10-082,552
2026-10-092,554
2026-10-102,555
2026-10-112,557
2026-10-122,558
2026-10-132,561
2026-10-142,563
2026-10-152,566
2026-10-162,571
2026-10-172,572
2026-10-182,573
2026-10-192,575
2026-10-202,577
2026-10-212,580
2026-10-222,581
2026-10-232,584
2026-10-242,586
2026-10-252,590
2026-10-262,592
2026-10-272,594
2026-10-282,594
2026-10-292,598
2026-10-302,600
2026-10-312,602
2026-11-012,602
2026-11-022,604
2026-11-032,603

Get the project

git clone https://github.com/pykeio/ort.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

vllm

High-throughput, memory-efficient LLM inference and serving engine that lets developers deploy models faster without building serving infrastructure.

★ 96,180sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 38,386litellm

Call 100+ LLM APIs using the OpenAI input/output format.

★ 62,604