DataGrab.io - DataGrab - Extract web data easily and scalably without coding.
Scrapy - Scrapy | A Fast and Powerful Scraping and Web Crawling Framework
Data Miner - Data Miner is a Google Chrome extension that helps you scrape data from web pages and into a CSV file or Excel spreadsheet.
StormCrawler - StormCrawler is an open source SDK for building distributed web crawlers with Apache Storm.
ScrapeHunt - Get a scraped database in 60 seconds
Apache Nutch - Apache Nutch is a highly extensible and scalable open source web crawler software project.