Software Alternatives, Accelerators & Startups

Top 7 Internet Search Products in Web Scraping

The best Internet Search Products within the Web Scraping category - based on our collection of reviews & verified products.

YaCy CommonCrawl Google Custom Search Px proxy Shadowsocks Manticore search

Summary

The top products on this list are YaCy, CommonCrawl, and Google Custom Search. All products here are categorized as: Tools and platforms for searching and browsing the internet. Tools for extracting data from websites. One of the criteria for ordering this list is the number of mentions that products have on reliable external sources. You can suggest additional sources through the form here.
  1. 1
    YaCy is a free search engine that anyone can use to build a search portal for their intranet or to...
    Pricing:
    • Open Source

    #Search Engine #Internet Search #Web Search 73 social mentions

  2. Common Crawl
    Pricing:
    • Open Source

    #Search Engine #Internet Search #Web Search 100 social mentions

  3. HTTP proxy server to automatically authenticate through an NTLM proxy

    #Web Scraping #Proxy #Proxy Server 2 social mentions

  4. Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web...

    #Search Engine #Search API #Custom Search

  5. A fast tunnel proxy that helps you bypass firewalls
    Pricing:
    • Open Source

    #Security #VPN #Security & Privacy 10 social mentions

Related categories

If you want to make changes on any of the products, you can go to its page and click on the "Suggest Changes" link. Alternatively, if you are working on one of these products, it's best to verify it and make the changes directly through the management page. Thanks!