NVIDIA/TensorRT-Edge-LLM

TensorRT-Edge-LLM

✅ Recently maintained

High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI

607Stars
145Forks
+87-day stars

Python · Apache-2.0 · Last push 2026-10-31

Official repository & installation ↗

Star history

2025-09-292026-11-01
View historical data
DateStars
2026-10-03576
2026-10-04576
2026-10-05577
2026-10-06577
2026-10-07581
2026-10-08581
2026-10-09582
2026-10-10583
2026-10-11583
2026-10-12583
2026-10-13586
2026-10-14588
2026-10-15591
2026-10-16592
2026-10-17593
2026-10-18594
2026-10-19596
2026-10-20597
2026-10-21597
2026-10-22597
2026-10-23597
2026-10-24598
2026-10-25598
2026-10-26600
2026-10-27601
2026-10-28602
2026-10-29606
2026-10-30606
2026-10-31607
2026-11-01607

Get the project

git clone https://github.com/NVIDIA/TensorRT-Edge-LLM.git

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.