Apify
import.io
Octoparse
ParseHub
Scrapy
Bright Data
Data Miner
Zyte
Pulno
Screaming Frog SEO Spider
Checkbot
Netpeak Spider
LinkChecker
Dead Link Checker
DRKSpiderJava
Fast Link Checker
Apify is a JavaScript & Node.js based data extraction tool for websites that crawls lists of URLs and automates workflows on the web. With Apify you can manage and automatically scale a pool of headless Chrome / Puppeteer instances, maintain queues of URLs to crawl, store crawling results locally or in the cloud, rotate proxies and much more.
Created by the team of SEO experts, Pulno is an SEO audit and website analysis tool that merges in-depth website analyses with easy-to-follow tips in order to help gain visibility, traffic and rank better in search engines. The tool can identify and analyze more than 100 different parameters including performance, broken links, broken graphics, no alternative descriptions, linking level and content issues. In addition to that, it also monitors all the implemented changes, tracks unwanted modifications and allows customers to maintain control over their websites. Pulno is also equipped with Unique Content Analyzer which checks for duplicate content off-site and on-site.
Apify PulnoAlthough daunting at first glance, Pulno soon became my best friend. There is a lot to grasp but there is no unnecessary information. Everything you see is there to help with detailed descriptions of issues, hand icons with colors showing severity of problems on your website. Additional help hidden in tooltips, and more. This tool is like an army knife - it has everything you need.
It is a real gem. Pulno checks incredbile amount of parameters and also gives you tips on how to deal with the found issues. There are tooltips with not only explanation but also links to more materials and a list of pages affected by a certain issue. There are different tools featured too like Website Structure Visualization where you can SEE how does your website look like or Backlink Checker or Content Analyzer or a tool that let's you monitor changes on your site. On top of that you can integrate Pulno with GSC granting data in a whole new level.
This tool is equipped with incredible number of useful functions. Just to name a few: Backlinks Analyzer; Duplicate Content (on-site and off-site!) Analyzer; Integration with GSC. You can check every single parameter of your website: empty headings, title tags, missing keywords, broken images, broken links and more. Moreover, it allows you to monitor the changes on your website so you can react hastily.
Based on our record, Apify seems to be more popular. It has been mentiond 21 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
In this article, I will walk you through everything, from crafting your initial scraping script (Actor) using the Apify SDK for TypeScript to deploying it to the Apify Actors Store for seamless data collection, and then, I will show you how to run your deployed Actor on the Apify platform. With Apify, you don't need to be a programming pro to harness the power of web scraping and start gaining insights. - Source: dev.to / about 2 months ago
I am surprised nobody mentioned https://apify.com/ and they even offer discount for YC startups as ex-graduate from the YC Combinator program. - Source: Hacker News / 2 months ago
Web Scraping, Data Extraction and Automation · Apify ( https://apify.com/ ). Source: 11 months ago
At this point of the tutorial, I'll take the opportunity to do a bit of self-promotion. I'm the COO of Apify, a cloud platform that helps you develop, run, and maintain your web scrapers easily and efficiently. It comes with tons of features like queue storages and proxies, and it supports Puppeteer without any extra configuration. You can run the above scraper, save results and control everything with a powerful... - Source: dev.to / about 1 year ago
Apify a saas that can be helpful in this situation since you can use its api to call actors from your java code. Source: over 1 year ago
import.io - Import. io helps its users find the internet data they need, organize and store it, and transform it into a format that provides them with the context they need.
Screaming Frog SEO Spider - The Screaming Frog SEO Spider is a small desktop program (PC or Mac) which crawls websites’ links...
Octoparse - Octoparse provides easy web scraping for anyone. Our advanced web crawler, allows users to turn web pages into structured spreadsheets within clicks.
Checkbot - Checkbot will boost the SEO, speed and security of your site by checking you're following 50+ web best practices. Browser extension with free and paid plans.
ParseHub - ParseHub is a free web scraping tool. With our advanced web scraper, extracting data is as easy as clicking the data you need.
Netpeak Spider - A desktop tool for fast and comprehensive technical audit of the entire website.