A Python based web scraper, pulling in Python Mechanize Browser and BeautifulSoup into one simple interface for making quick web scrapers.
Support custom/random user agents, and html caching of fetched data. The caching allows you to not have to re-fetch websites too much if you are repeatadly processing the data, and it also allows you to debug your scraper without hammering the target server.
Look at "example_scraper.py" to see how it can be used.