Top 6 Open-Source Alternatives to Apache Nutch

Product categories

API APIs Bookmark Manager Bot Protection Data Data Dashboard Data Extraction Download Manager Headless Browsers Proxy Web Crawling Web Scraping

Summary

The top open-source alternatives to Apache Nutch are Scrapy, StormCrawler, and Mixnode. One of the criteria for ordering this list is the number of mentions that products have on reliable external sources. You can suggest additional sources through the form here.

Scrapy Landing Page
1

Scrapy

Scrapy | A Fast and Powerful Scraping and Web Crawling Framework
Pricing:
- Open Source
#Web Scraping #Data Extraction #Data 93 social mentions
StormCrawler Landing Page
2

StormCrawler

StormCrawler is an open source SDK for building distributed web crawlers with Apache Storm.
Pricing:
- Open Source
#Web Scraping #Data Extraction #Data
Mixnode Landing Page
3

Mixnode

Turn the web into a database!
Pricing:
- Open Source
#Web Scraping #Data Extraction #Data
HTTrack Landing Page
4

HTTrack

HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility.
Pricing:
- Open Source
#Utilities #Download Manager #Web Copier 2 social mentions
Scrapfly.io Landing Page
5

Scrapfly.io

Simple but powerful Web Scraping API - We provide fully managed web scraping through a simple REST API. The promise is to turn any website into database effortlessly in a unified tool.
Pricing:
- Open Source
- Freemium
- Free Trial
- $15.0 / Monthly (all features)
#Web Scraping #Data Extraction #Scraper 33 social mentions
ScrapeHero Landing Page
6

ScrapeHero

A web scraping service to collect data from websites, without any programming or DIY tools.
Pricing:
- Open Source
- Freemium
- Free Trial
- $5.0 / Monthly
#Web Scraping #Data Extraction #Data 1 social mentions