modelscope/evalscope

evalscope

✅ Recently maintained

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

3,631Stars
547Forks
+407-day stars

Python · Apache-2.0 · Last push 2026-11-02

Official repository & installation ↗
evaluationllmperformanceragvlm

Star history

2025-09-292026-11-02
View historical data
DateStars
2026-10-043,496
2026-10-053,499
2026-10-063,500
2026-10-073,502
2026-10-083,506
2026-10-093,510
2026-10-103,515
2026-10-113,521
2026-10-123,527
2026-10-133,533
2026-10-143,542
2026-10-153,552
2026-10-163,554
2026-10-173,557
2026-10-183,560
2026-10-193,565
2026-10-203,569
2026-10-213,574
2026-10-223,580
2026-10-233,582
2026-10-243,585
2026-10-253,589
2026-10-263,595
2026-10-273,601
2026-10-283,608
2026-10-293,612
2026-10-303,619
2026-10-313,623
2026-11-013,627
2026-11-023,631

Get the project

git clone https://github.com/modelscope/evalscope.git

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simpl

★ 26,723open-webui

Self-hosted AI chat interface that works with Ollama and OpenAI APIs out of the box.

★ 157,506mem0

The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.

★ 68,261