
import.io
Octoparse
Apify
ParseHub
Scrapy
Diffbot
Kimono
Data Miner
TinyProxy
Squid Proxy
Varnish
Polipo
Apache Traffic Server
Privoxy
mitmproxy
nginx
import.io
TinyProxySuper simple and straight to the point. All I had to do, in a linux server, was this:
Based on our record, TinyProxy should be more popular than import.io. It has been mentiond 8 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Sort of, import.io is a portion. This could also automate tasks on your local computer as well. Source: over 5 years ago
This should be possible. But I think you can do this faster with import.io and google sheets. DM me, we'll figure it out. Source: over 5 years ago
The first result led me to TinyProxywhich was the exactly what I needed. Itโs a small, proxy server that handles forwarding HTTPS requests, requiring almost zero configuration, and has on-going maintenance. Adding it to the container and updating HAProxy to pass the appropriate traffic to it filled in the missing piece. It would handle HTTPS traffic while Nginx continued to handle caching. - Source: dev.to / 3 months ago
Leverage open-source proxy tools like mitmproxy or tinyproxy, which allow you to intercept and modify HTTP requests and responses in real-time. By configuring these, you can simulate different geo conditions:. - Source: dev.to / 5 months ago
Probably by modifying the source code of https://tinyproxy.github.io (it's a lightweight proxy, but modifying the source would be not a 5-minute thing...). - Source: Hacker News / about 2 years ago
I found Privoxy, and it seems to do what I want, so maybe wondering if anyone would be eager to recommend. There is also Tinyproxy, but it can only add headers not remove them. Source: over 2 years ago
To test proxying,I'm using tinyproxy, running a very simple config on port 8080. This supports SPDY (HTTP/2), which is a complication I don't really want to consider at this point, but the analysis ends up quite similar to HTTP/1. - Source: dev.to / almost 3 years ago
Octoparse - Octoparse provides easy web scraping for anyone. Our advanced web crawler, allows users to turn web pages into structured spreadsheets within clicks.
Squid Proxy - Website Content Acceleration and Distribution. Thousands of web-sites around the Internet use Squid to drastically increase their content delivery. Squid can reduce your server load and improve delivery speeds to clients.
Apify - Apify is a web scraping and automation platform that can turn any website into an API.
Varnish - High-performance HTTP accelerator
ParseHub - ParseHub is a free web scraping tool. With our advanced web scraper, extracting data is as easy as clicking the data you need.
Polipo - A small and fast caching web proxy (a web cache, an HTTP proxy, a proxy server).