Home

Code in browser tool documentation

General help

Scraping for Journalists by Paul Bradshaw - we recommend this ebook for beginners, even if you're not a journalist! The later chapters cover ScraperWiki.

Frequently Asked Questions - if you have specific "how to" questions about the "code in your browser" editor and how it runs scripts, or you got an error message.

ScraperWiki Google Group - lots of really good scraper coders on on this public email list. It's a great place to ask any questions about scraping!

Introduction to Web (and data!) Scraping with Python - thorough Python video tutorial with plenty of worked examples.

Scraping tutorials

These tutorials show you how to write code to extract structured data from websites.

You can run them using the "Code in your browser" tool on ScraperWiki's platform, see this tutorial. Alternatively, run them on your own computer by installing the scraperwiki Python package first.

Python

• First scraper tutorial (Python)
• CSV reading guide (Python)
• Excel reading guide (Python)
• HTML parsing guide (Python)
• Dates and times guide (Python)

Ruby

• First scraper tutorial (Ruby)
• CSV reading guide (Ruby)

Classic tutorials

The original versions of these tutorials are currently still available. If you miss any, please do add them to this wiki. The Html2MarkDown site is useful for converting them.