A powerful and minimal command-line web scraper written in Go, designed to recursively extract HTML content and follow links with optional caching and export support (JSON or Markdown). Built with concurrency and extensibility in mind, the scraper lets you easily crawl and parse websites from your terminal.
Runnable Go examples for building reliable web scrapers with the Crawlbase Go SDK dual status codes, JS rendering, Amazon scrapers, retries, and geo routing. Companion code for the blog post Web Scraping in Go: Build Reliable Scrapers with Crawlbase SDK.
The official Go SDK for Spidra
A CTI reconnaissance tool that captures HTML source code and full-page screenshots developed with Go.
Add a description, image, and links to the go-web-scraper topic page so that developers can more easily learn about it.
To associate your repository with the go-web-scraper topic, visit your repo's landing page and select "manage topics."