advertools - online marketing productivity and analysis tools

Open-Source Python Based SEO Web Crawler

R integration with Screaming Frog CLI

The AI-native technical SEO crawler. Open-source MCP server for Claude / Cursor / Codex — 37 tools, 50+ checks, unlimited pages, WAF detection, ephemeral by design. Built on LibreCrawl. MIT.

Free SEO crawler & website audit tool — a self-hosted, open-source SEO spider that crawls any website for technical SEO issues. Concurrent, CMS-aware (Shopify/WordPress/Webflow), XLSX export. A free alternative to Screaming Frog.

Local-first desktop SEO crawler. Audit your site on your own machine — no cloud, no accounts, no data leaves your computer.

Fastest site-base crawler with AJAX content rendered

Search Engine scraper with PHP

Python async SEO crawler — Core Web Vitals, OpenGraph, JSON-LD, security headers, DNS, Gemini AI fixes. 30+ checks per page.

media extraction crawler utility