webrecorder/browsertrix-crawler

browsertrix-crawler

✅ Recently maintained

Run a high-fidelity browser-based web archiving crawler in a single Docker container

1,183Stars
154Forks
+77-day stars

TypeScript · AGPL-3.0 · Last push 2026-10-29

Official repository & installation ↗
crawlercrawlingwaczwarcweb-archivingweb-crawlerwebrecorder

GitValue · Value evidence

Unscored · Evidence coverage 0%

Provisional rubric; documentation and runtime testing are separate. Missing evidence does not imply low value.

Star history

2025-09-292026-11-02
View historical data
DateStars
2026-10-041,148
2026-10-051,149
2026-10-061,153
2026-10-071,154
2026-10-081,154
2026-10-091,154
2026-10-101,154
2026-10-111,155
2026-10-121,158
2026-10-131,160
2026-10-141,163
2026-10-151,164
2026-10-161,166
2026-10-171,166
2026-10-181,166
2026-10-191,167
2026-10-201,168
2026-10-211,168
2026-10-221,169
2026-10-231,171
2026-10-241,173
2026-10-251,176
2026-10-261,176
2026-10-271,176
2026-10-281,177
2026-10-291,178
2026-10-301,178
2026-10-311,179
2026-11-011,182
2026-11-021,183

Get the project

git clone https://github.com/webrecorder/browsertrix-crawler.git

Cloning downloads the source. For dependencies and installation, follow the project README.

Related projects & alternative candidates

Related domains do not imply feature parity. Review official documentation and licenses.

Scrapling

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ

★ 92,711scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

★ 65,166CloakBrowser

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 50+ tests passed.

★ 32,695