
ScrapingBee
Apify
Scraper API
Zyte
Scrapy
Bright Data
Web Scraper
Portia
QuickMocker
Beeceptor
WireMock
Mockoon
MockServer
Mocko.dev
Webhook.site
SOAP/REST Mock Service
Web Scraping is hard, scraping at scale can be very challenging.
You have to handle:
ScrapingBee is a simple API that does all the above for you, and much more.
QuickMoker โ Online API Mocking Tool. Mock API or create fake web services (rest, soap etc) based on the HTTP(S) protocol. Alternatively simulate API, stub API, fake API or create API for tests. Perform an instant live debugging of requests to endpoints with an extensive information about request headers, body etc. More than 100 random or faker shortcodes for response templating. Forward the requests to your localhost with the help of the Local Forwarder feature. Proxy requests to any external URL, restrict fake API endpoint by IP address or authorization header. Use regular expression for your URL paths, multiple HTTP methods per fake API endpoint, endpoint prioritization etc.
QuickMocker has a free subscription plan which is enough for most of development and testing needs and it does not require any credit cards.
ScrapingBee
QuickMockerNo ScrapingBee videos yet. You could help us improve this page by suggesting one.
Based on our record, ScrapingBee should be more popular than QuickMocker. It has been mentiond 3 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
If youโre worried about the security risks, edge cases, maintenance pain and scaling challenges of self hosting there are various solid hosted alternatives: - https://browserless.io - low level browser control - https://scrapingbee.com - scraping specialists - https://urlbox.com - screenshot specialists* Theyโre all profitable and have been around for years so you can depend on the businesses and the tech. *... - Source: Hacker News / over 1 year ago
If you really just need the data you can use something like https://scrapingbee.com to scrape the info from the various price pages to make sure your info is always up to date. Source: over 3 years ago
Well done! And posting here was a great idea. Not sure I would have found scrapingbee.com otherwise. We will probably become a customer. Signed up for the trial account. Source: about 4 years ago
QuickMocker โ Manage online fake API endpoints under your own subdomain, forward requests to localhost URL for webhooks development and testing, use RegExp and multiple HTTP methods for URL path, prioritize endpoints, more than 100 shortcodes (dynamic or fake response values) for response templating, import from OpenAPI (Swagger) Specifications in JSON format, proxy requests, restrict endpoint by IP address and... - Source: dev.to / almost 5 years ago
Apify - Apify is a web scraping and automation platform that can turn any website into an API.
Beeceptor - Unblock yourself from API dependencies, and build & integrate with APIs fast. Beeceptor helps you build a mock Rest API in a few seconds.
Scraper API - Scale Data Collection with a Simple API.
WireMock - WireMock - a web service test double for all occasions.
Zyte - We're Zyte (formerly Scrapinghub), the central point of entry for all your web data needs.
Mockoon - Mockoon is the easiest and quickest way to design and run mock REST APIs. No remote deployment, no account required, free and open-source.