spatie/crawler

crawler

✅ Recently maintained

https://spatie.be/docs/crawler

2,830Stars
368Forks
07-day stars

PHP · MIT · Last push 2026-10-22

Official repository & installation ↗
phpcrawlerguzzleconcurrency

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-03
View historical data
DateStars
2026-10-052,828
2026-10-062,828
2026-10-072,828
2026-10-082,828
2026-10-092,828
2026-10-102,828
2026-10-112,828
2026-10-122,829
2026-10-132,829
2026-10-142,829
2026-10-152,829
2026-10-162,829
2026-10-172,829
2026-10-182,829
2026-10-192,829
2026-10-202,829
2026-10-212,829
2026-10-222,829
2026-10-232,829
2026-10-242,830
2026-10-252,831
2026-10-262,831
2026-10-272,831
2026-10-282,831
2026-10-292,831
2026-10-302,831
2026-10-312,831
2026-11-012,831
2026-11-022,830
2026-11-032,830

Get the project

git clone https://github.com/spatie/crawler.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

Scrapling

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ

★ 93,360scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

★ 65,188CloakBrowser

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.

★ 32,700