
Agenty
Octoparse
Diggernaut
eScraper
artoo.js
Screen Scraper
Crawlbase
import.io
mitmproxy
Charles Proxy
HTTP Toolkit
Surge for Mac
Weer
James
Proxyman.io
Burp Suite
Agenty is a SaaS platform with easy-to-use automated cloud-based agents for data scraping, text extraction, text classification, OCR, categorization, change tracking and more with no coding required!
Agenty
mitmproxyMitmproxy is recommended for software developers, QA testers, network administrators, and security researchers who require advanced tools for inspecting and debugging HTTP/HTTPS traffic. It is also beneficial for students and educators in computer science and cybersecurity disciplines who are learning about network protocols.
Based on our record, mitmproxy seems to be more popular. It has been mentiond 93 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Mitmproxy is the gold standard here. It's free, open source, and Python-scriptable. - Source: dev.to / 3 months ago
A Man-in-the-Middle (MITM) proxy sits between your client and the destination server, intercepting and decrypting TLS traffic so you can inspect it in plain text. Before you panic about the name โ this is a standard, legitimate debugging technique. Tools like mitmproxy have been used by developers for years. - Source: dev.to / 4 months ago
Leverage open-source proxy tools like mitmproxy or tinyproxy, which allow you to intercept and modify HTTP requests and responses in real-time. By configuring these, you can simulate different geo conditions:. - Source: dev.to / 6 months ago
I have had great experience scripting and running http://mitmproxy.org for these purposes. I also have set it in production as a dumb caching proxy for upstream services (We do a lot dumb GETs to list/enumerate). - Source: Hacker News / 8 months ago
We used mitmproxy. Itโs lightweight, easy to run, and gives a clean log of every outbound request. - Source: dev.to / 12 months ago
Octoparse - Octoparse provides easy web scraping for anyone. Our advanced web crawler, allows users to turn web pages into structured spreadsheets within clicks.
Charles Proxy - HTTP proxy / HTTP monitor / Reverse Proxy
Diggernaut - Web scraping is just became easy. Extract any website content and turn it into datasets. No programming skills required.
HTTP Toolkit - Beautiful, cross-platform & open-source tools to debug, test & build with HTTP(S). One-click setup for browsers, servers, Android, CLI tools, scripts and more.
eScraper - eScraper is an eCommerce data scraping tool that collects data from multiple sites and prepares a relevant .csv or excel file with all product info for your stores, whether its, PrestaShop, Magento, WooCommerce, or Shopify store.
Surge for Mac - Advanced Web Debugging Proxy for Mac & iOS