ScrapingBee
Apify
Scraper API
Zyte
Scrapy
Bright Data
Firecrawl
Web Scraper
Webiny
Ionic Creator V2
Payload CMS
Strapi
Serverless
Kodular
Webflow
Contentful
Web Scraping is hard, scraping at scale can be very challenging.
You have to handle:
ScrapingBee is a simple API that does all the above for you, and much more.
Open-source serverless enterprise CMS platform. Includes a headless CMS, page builder, form builder, and file manager. Easy to customize and expand. Deploys to AWS.
ScrapingBee WebinyNo ScrapingBee videos yet. You could help us improve this page by suggesting one.
Webiny might be a bit more popular than ScrapingBee. We know about 4 links to it since March 2021 and only 3 links to ScrapingBee. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
If youโre worried about the security risks, edge cases, maintenance pain and scaling challenges of self hosting there are various solid hosted alternatives: - https://browserless.io - low level browser control - https://scrapingbee.com - scraping specialists - https://urlbox.com - screenshot specialists* Theyโre all profitable and have been around for years so you can depend on the businesses and the tech. *... - Source: Hacker News / over 1 year ago
If you really just need the data you can use something like https://scrapingbee.com to scrape the info from the various price pages to make sure your info is always up to date. Source: over 3 years ago
Well done! And posting here was a great idea. Not sure I would have found scrapingbee.com otherwise. We will probably become a customer. Signed up for the trial account. Source: about 4 years ago
Even Strapi needs to be hosted somewhere, and that usually involves a recurring fee. I've had great success over the past 2 years building blogs using http://webiny.com, and because they get low traffic, I've only ever had 1 bill from AWS that was around 80 cents US. Source: about 4 years ago
Strapi is awesome, I've been a fan of the project since its early days. However, I've been closely watching Webiny too. It's easier to host because you don't have to worry about running Docker containers or installing MongoDB on your local machine. Instead you put it on your AWS account (can be done with a few clicks), define your content models once it's there and you then only pay for usage. http://webiny.com. Source: over 4 years ago
Yeah I hear you, SAAS CMS platforms can get prohibitively expensive really quickly after the initial free tier expires. I've found hosting Strapi (or similar) on Heroku has saved me the cost of keeping a server instance running, which usually would cost $5-10 per month. However, the most cost effective for me so far has been Webiny. It's serverless so you install it on AWS and typically don't pay as much (if... Source: over 4 years ago
Otherwise if you want a framework to build on, there's Redwood (which works particularly well on Netlify and Vercel) or Webiny (for AWS, Azure and others). - Source: dev.to / almost 5 years ago
Apify - Apify is a web scraping and automation platform that can turn any website into an API.
Ionic Creator V2 - Build better mobile apps, faster
Scraper API - Scale Data Collection with a Simple API.
Payload CMS - Headless CMS and Application Framework built with Node.js, React and MongoDB
Zyte - We're Zyte (formerly Scrapinghub), the central point of entry for all your web data needs.
Strapi - Manage any content. Anywhere. The leading open-source headless CMS. 100% JavaScript / TypeScript and fully customizable.
