TinyProxy
Squid Proxy
Varnish
Polipo
Apache Traffic Server
Privoxy
mitmproxy
nginx
Crawlera
import.io
Data Miner
Apify
Kimono
Octoparse
ParseHub
ScrapeHero
Crawlera is a downloader designed for web scraping and web crawling. It provides a universal HTTP proxy API for integrating with any technology used by your web crawling stack. It scales to billions of unblocked requests per month, you only pay for successful requests.
TinyProxy CrawleraCrawlera is recommended for businesses, developers, and data scientists who require reliable and scalable web scraping solutions. It's especially beneficial for those who need to scrape data from sites with strict anti-bot measures, such as e-commerce websites, competitor analysis, and market research projects.
No Crawlera videos yet. You could help us improve this page by suggesting one.
Super simple and straight to the point. All I had to do, in a linux server, was this:
Based on our record, TinyProxy seems to be more popular. It has been mentiond 8 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
The first result led me to TinyProxywhich was the exactly what I needed. Itโs a small, proxy server that handles forwarding HTTPS requests, requiring almost zero configuration, and has on-going maintenance. Adding it to the container and updating HAProxy to pass the appropriate traffic to it filled in the missing piece. It would handle HTTPS traffic while Nginx continued to handle caching. - Source: dev.to / 4 months ago
Leverage open-source proxy tools like mitmproxy or tinyproxy, which allow you to intercept and modify HTTP requests and responses in real-time. By configuring these, you can simulate different geo conditions:. - Source: dev.to / 6 months ago
Probably by modifying the source code of https://tinyproxy.github.io (it's a lightweight proxy, but modifying the source would be not a 5-minute thing...). - Source: Hacker News / about 2 years ago
I found Privoxy, and it seems to do what I want, so maybe wondering if anyone would be eager to recommend. There is also Tinyproxy, but it can only add headers not remove them. Source: over 2 years ago
To test proxying,I'm using tinyproxy, running a very simple config on port 8080. This supports SPDY (HTTP/2), which is a complication I don't really want to consider at this point, but the analysis ends up quite similar to HTTP/1. - Source: dev.to / almost 3 years ago
Squid Proxy - Website Content Acceleration and Distribution. Thousands of web-sites around the Internet use Squid to drastically increase their content delivery. Squid can reduce your server load and improve delivery speeds to clients.
import.io - Import. io helps its users find the internet data they need, organize and store it, and transform it into a format that provides them with the context they need.
Varnish - High-performance HTTP accelerator
Data Miner - Data Miner is a Google Chrome extension that helps you scrape data from web pages and into a CSV file or Excel spreadsheet.
Polipo - A small and fast caching web proxy (a web cache, an HTTP proxy, a proxy server).
Apify - Apify is a web scraping and automation platform that can turn any website into an API.
