Octoparse
import.io
Apify
ParseHub
Data Miner
Scrapy
Kimono
ScrapeHero
TinyProxy
Squid Proxy
Varnish
Polipo
Apache Traffic Server
Privoxy
mitmproxy
nginx
Octoparse TinyProxySmall to medium-sized businesses, marketing professionals, data analysts, researchers, and anyone needing to automate data extraction tasks without investing heavily in technical resources or hiring developers.
I've been playing around with different scraping tools in the past month, trying to find the best one to help with my research project, and I have to say this new feature of auto-detection comes like a life-savor. I only need to give the software the link and it will auto-detect the content and build the crawler for me. I can even enjoy it with just a free plan!
Super simple and straight to the point. All I had to do, in a linux server, was this:
Based on our record, TinyProxy should be more popular than Octoparse. It has been mentiond 8 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Octoparse.com might work, they have a very nice interactive tool + 14 day free trail. Source: over 4 years ago
These are no-code solutions for scraping websites. You donโt need any technical knowledge to scrape Aliexpress using these tools. Using advanced AI-powered click and scrape tools, you can get started scraping within seconds either locally or in the cloud. Choosing a good scraping tool can save you lots of money and time as well. Source: almost 5 years ago
I have always been able to extract data without any problems with Octoparse. It is also a very easy to use tool. Source: about 5 years ago
The first result led me to TinyProxywhich was the exactly what I needed. Itโs a small, proxy server that handles forwarding HTTPS requests, requiring almost zero configuration, and has on-going maintenance. Adding it to the container and updating HAProxy to pass the appropriate traffic to it filled in the missing piece. It would handle HTTPS traffic while Nginx continued to handle caching. - Source: dev.to / 3 months ago
Leverage open-source proxy tools like mitmproxy or tinyproxy, which allow you to intercept and modify HTTP requests and responses in real-time. By configuring these, you can simulate different geo conditions:. - Source: dev.to / 5 months ago
Probably by modifying the source code of https://tinyproxy.github.io (it's a lightweight proxy, but modifying the source would be not a 5-minute thing...). - Source: Hacker News / about 2 years ago
I found Privoxy, and it seems to do what I want, so maybe wondering if anyone would be eager to recommend. There is also Tinyproxy, but it can only add headers not remove them. Source: over 2 years ago
To test proxying,I'm using tinyproxy, running a very simple config on port 8080. This supports SPDY (HTTP/2), which is a complication I don't really want to consider at this point, but the analysis ends up quite similar to HTTP/1. - Source: dev.to / almost 3 years ago
import.io - Import. io helps its users find the internet data they need, organize and store it, and transform it into a format that provides them with the context they need.
Squid Proxy - Website Content Acceleration and Distribution. Thousands of web-sites around the Internet use Squid to drastically increase their content delivery. Squid can reduce your server load and improve delivery speeds to clients.
Apify - Apify is a web scraping and automation platform that can turn any website into an API.
Varnish - High-performance HTTP accelerator
ParseHub - ParseHub is a free web scraping tool. With our advanced web scraper, extracting data is as easy as clicking the data you need.
Polipo - A small and fast caching web proxy (a web cache, an HTTP proxy, a proxy server).
