JayBizzle/Crawler-Detect

Crawler-Detect

βœ… Recently maintained

πŸ•· CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent

2,408Stars
281Forks
+17-day stars

PHP Β· MIT Β· Last push 2026-10-20

Official repository & installation β†—
phpuser-agentcrawlerspiderbotsdetecthacktoberfest

Star history

2025-09-292026-11-02
View historical data
DateStars
2026-10-042,401
2026-10-052,401
2026-10-062,401
2026-10-072,402
2026-10-082,402
2026-10-092,402
2026-10-102,403
2026-10-112,404
2026-10-122,404
2026-10-132,404
2026-10-142,405
2026-10-152,405
2026-10-162,405
2026-10-172,405
2026-10-182,405
2026-10-192,405
2026-10-202,405
2026-10-212,405
2026-10-222,406
2026-10-232,406
2026-10-242,407
2026-10-252,407
2026-10-262,407
2026-10-272,407
2026-10-282,407
2026-10-292,407
2026-10-302,407
2026-10-312,407
2026-11-012,408
2026-11-022,408

Get the project

git clone https://github.com/JayBizzle/Crawler-Detect.git

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

firecrawl

Crawls and scrapes web pages into clean Markdown for AI agents and LLM pipelines.

β˜… 197,744crawl4ai

Open-source LLM-friendly web crawler and data extractor for AI pipelines.

β˜… 86,744curl

A command line tool and library for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS,

β˜… 43,346