huggingface/lighteval

lighteval

✅ Recently maintained

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

2,575Stars
602Forks
+57-day stars

Python · MIT · Last push 2026-10-29

Official repository & installation ↗
evaluationevaluation-frameworkevaluation-metricshuggingface

Star history

2025-09-292026-11-02
View historical data
DateStars
2026-10-042,550
2026-10-052,550
2026-10-062,552
2026-10-072,553
2026-10-082,553
2026-10-092,553
2026-10-102,554
2026-10-112,554
2026-10-122,555
2026-10-132,557
2026-10-142,560
2026-10-152,561
2026-10-162,563
2026-10-172,564
2026-10-182,564
2026-10-192,564
2026-10-202,565
2026-10-212,566
2026-10-222,567
2026-10-232,569
2026-10-242,569
2026-10-252,570
2026-10-262,571
2026-10-272,571
2026-10-282,571
2026-10-292,572
2026-10-302,575
2026-10-312,575
2026-11-012,575
2026-11-022,575

Get the project

git clone https://github.com/huggingface/lighteval.git

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

VoiceStudio

A fully local open-source voice studio for cloning, dubbing, transcription and audiobook creation across 646 languages.

★ 98,205rea

Use AI agents to reverse engineer app behavior and native binaries with tool integrations.

★ 419,787openclaw

Cross-platform open-source personal AI assistant focused on data ownership, written in TypeScript for self-hosting.

★ 393,671