huggingface/datatrove

datatrove

✅ 近期有维护

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

3,414Stars
328Forks
+7近 7 天 Star

Python · Apache-2.0 · 最近推送 2026-11-03

官方仓库与安装文档 ↗

GitValue · 价值证据

待补证 · 证据覆盖 0%

试跑评分;文档声明与实测分开。未收集证据不代表项目没有价值。

Star 历史

2025-09-292026-11-03
查看历史数据
日期Stars
2026-10-053,372
2026-10-063,373
2026-10-073,374
2026-10-083,377
2026-10-093,378
2026-10-103,379
2026-10-113,379
2026-10-123,381
2026-10-133,383
2026-10-143,387
2026-10-153,389
2026-10-163,390
2026-10-173,390
2026-10-183,393
2026-10-193,393
2026-10-203,395
2026-10-213,397
2026-10-223,398
2026-10-233,400
2026-10-243,402
2026-10-253,405
2026-10-263,406
2026-10-273,409
2026-10-283,409
2026-10-293,410
2026-10-303,412
2026-10-313,413
2026-11-013,414
2026-11-023,414
2026-11-033,414

获取项目

git clone https://github.com/huggingface/datatrove.git

克隆仅获取源码;依赖与安装步骤请参照项目的 README.

相关项目与平替候选

同领域不等于功能完全相同,选型前请核对官方文档和许可证。