Data extraction: https://simplescraper.io A project that I launched on HN that became a business. Simplescraper rode the no-code wave of a few years back ('instant structured data without parsing html'). Now working on increasing the surface area for AI agents: MCP support, screenshots API, and (experimentally) x402^ ^ https://simplescraper.io/blog/x402-payment-protocol/. - Source: Hacker News / 5 months ago

1. Clicking the box programmatically – possible but inconsistent 2. Outsourcing the task to one of the many CAPTCHA-solving services (2Captcha etc) – better 3. Using a pool of reliable IP addresses so you don't encounter checkboxes or turnstiles – best I run a web scraping startup (https://simplescraper.io) and this is usually the approach. It has become more difficult, and I think a lot of the AI crawlers are... - Source: Hacker News / about 1 year ago

Making my data extraction Saas (https://simplescraper.io) more LLM friendly. Markdown extraction, improved Google search, workflows - search for this terms, visit the first N links, summarize etc. Big demand for (or rather, expectation of) this lately. - Source: Hacker News / almost 2 years ago

Things are much easier for one-person startups these days—it's a gift. I remember building a todo app as my first SaaS project, and choosing something called Stormpath for authentication. It subsequently shut down, forcing me to do a last-minute migration from a hostel in Japan using Nitrous Cloud IDE (which also shut down). Just pain upon pain.[1] Now, you can just pick a full-stack cloud service and run with it.... - Source: Hacker News / about 2 years ago

Simplescraper — Trigger your webhook after each operation. The free plan includes 100 cloud scrape credits. - Source: dev.to / over 2 years ago

There is an open source web browser proxy thing called finicky [0]. I use at work that lets me redirect urls clicked in other apps like slack to specific browers (firefox / chrome) or even specific chrome profiles. It'll also allow you to rewrite the urls. [0] https://github.com/johnste/finicky. - Source: Hacker News / 3 months ago

On Mac I used Finicky. I switched to Linux with Omarchy almost a year ago and went looking for an equivalent. Junction only asks every time, mimi doesn't carry routing rules. The remaining path was "build your own", and I did. It worked well, with a TUI that paired nicely with Omarchy. Then I thought: this should be a built-in feature on every OS, the same way each OS has a rule for which app opens PDFs. So I... - Source: dev.to / 3 months ago

On Mac I used Finicky for this. For anyone who never saw it: it lets you write rules that decide which browser opens each link. You set Finicky as the system's default browser, and it applies your rules to every link clicked in any app, picking the right one. Rules are short scripts in JavaScript, simple or as elaborate as you need. It can even rewrite the URL before opening it: force HTTPS, strip tracking... - Source: dev.to / 3 months ago

In addition to making the link look shady, it adds considerable lag to opening the link. I'm using Finicky[1] on Mac to rewrite the URL by extracting the original URL from the query params[2]. 1: https://github.com/johnste/finicky 2: https://github.com/fphilipe/dotfiles/blob/31e3d18fe5f51b2fd86cb7f1762453c1c4779ef9/finicky.js#L4-L8. - Source: Hacker News / 11 months ago

Just curious, did you explore finicky(https://github.com/johnste/finicky)? - Source: Hacker News / over 2 years ago