EvolvingLMMs-Lab/lmms-eval

lmms-eval

✅ Recently maintained

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

4,479Stars
683Forks
+147-day stars

Python · License unverified · Last push 2026-11-02

Official repository & installation ↗

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-02
View historical data
DateStars
2026-10-034,435
2026-10-044,435
2026-10-054,436
2026-10-064,437
2026-10-074,441
2026-10-084,441
2026-10-094,442
2026-10-104,445
2026-10-114,446
2026-10-124,446
2026-10-134,446
2026-10-144,448
2026-10-154,451
2026-10-164,451
2026-10-174,453
2026-10-184,456
2026-10-194,458
2026-10-204,460
2026-10-214,461
2026-10-224,461
2026-10-234,461
2026-10-244,462
2026-10-254,462
2026-10-264,465
2026-10-274,468
2026-10-284,471
2026-10-294,475
2026-10-304,476
2026-10-314,478
2026-11-024,479

Get the project

git clone https://github.com/EvolvingLMMs-Lab/lmms-eval.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.