Scrapy - Scrapy | A Fast and Powerful Scraping and Web Crawling Framework
DuckDuckGo - The Internet privacy company that empowers you to seamlessly take control of your personal information online, without any tradeoffs.
StormCrawler - StormCrawler is an open source SDK for building distributed web crawlers with Apache Storm.
Google - Google Search, also referred to as Google Web Search or simply Google, is a web search engine developed by Google. It is the most used search engine on the World Wide Web
Apache Nutch - Apache Nutch is a highly extensible and scalable open source web crawler software project.
Searx - Open source metasearch engine