scrapy
✅ 近期有维护Scrapy, a fast high-level web crawling & scraping framework for Python.
65,188Stars
12,095Forks
+124近 7 天 Star
Python · BSD-3-Clause · 最近推送 2026-11-02
官方仓库与安装文档 ↗GitValue · 价值证据
待补证 · 证据覆盖 0%
试跑评分;文档声明与实测分开。未收集证据不代表项目没有价值。
Star 历史
2025-09-292026-11-03
查看历史数据
| 日期 | Stars |
|---|---|
| 2026-10-05 | 64,534 |
| 2026-10-06 | 64,555 |
| 2026-10-07 | 64,590 |
| 2026-10-08 | 64,616 |
| 2026-10-09 | 64,643 |
| 2026-10-10 | 64,662 |
| 2026-10-11 | 64,688 |
| 2026-10-12 | 64,720 |
| 2026-10-13 | 64,748 |
| 2026-10-14 | 64,773 |
| 2026-10-15 | 64,800 |
| 2026-10-16 | 64,819 |
| 2026-10-17 | 64,831 |
| 2026-10-18 | 64,849 |
| 2026-10-19 | 64,874 |
| 2026-10-20 | 64,894 |
| 2026-10-21 | 64,922 |
| 2026-10-22 | 64,943 |
| 2026-10-23 | 64,966 |
| 2026-10-24 | 64,989 |
| 2026-10-25 | 65,022 |
| 2026-10-26 | 65,055 |
| 2026-10-27 | 65,079 |
| 2026-10-28 | 65,108 |
| 2026-10-29 | 65,107 |
| 2026-10-30 | 65,121 |
| 2026-10-31 | 65,136 |
| 2026-11-01 | 65,162 |
| 2026-11-02 | 65,166 |
| 2026-11-03 | 65,188 |
获取项目
git clone https://github.com/scrapy/scrapy.git克隆仅获取源码;依赖与安装步骤请参照项目的 README.
相关项目与平替候选
同领域不等于功能完全相同,选型前请核对官方文档和许可证。
firecrawl
把网页抓取并转成干净 Markdown 数据,供 AI 智能体调用,适合做搜索与数据抽取。
★ 198,099crawl4ai专为大语言模型和 AI Agent 设计的开源异步网页爬取与 Markdown 提取引擎。
★ 86,808Scrapling🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ
★ 93,360