Off topic but on your home page https://fetchfox.ai/ the wider your screen the fewer 'Our Happy Users' anecdotes you get. Somewhere around 2400px the number goes to zero. - Source: Hacker News / 4 months ago

We’re looking for someone with top notch programming skills, fast coding, and a great sense for technical design. The role is open-ended, and there is challenging work to be done on many aspects of the project, including the core library, proxies, the website, and more. The only requirement is that you must have excellent technical skills. Our compensation is competitive. Our cash compensation is similar to YC... - Source: Hacker News / 4 months ago

FetchFox.ai | https://fetchfox.ai | REMOTE | competitive compensation FetchFox is an AI web scraper. It convert takes a prompt and a URL, and crawls that site to give structured data. I'm the founder, and I'm looking for smart engineers/hackers to improve the product. We have a lot of flexibility on what you can work on, including the web app, or the free open source library which you can find at - Source: Hacker News / 5 months ago

Kadoa | Senior Software Engineer | Remote (Europe) | Full-Time | https://kadoa.com At Kadoa, we are building the foundational infrastructure for unstructured data ETL. We enable any organization to instantly transform unstructured data (websites, documents, emails, etc.) into structured insights - without code or maintenance overhead. We are VC-funded with strong traction. There are two official roles, but we... - Source: Hacker News / 5 months ago

We've been working on AI-automated web scraping at https://kadoa.com and our early experiments were similar to yours. We started when only the expensive and slow GPT-3 was available, which pushed us to develop a cost-effective solution at scale. Here is what we ended up with: - Extraction: We use codegen models to generate CSS selectors or XPath extraction code. This is more efficient than using LLMs for every... - Source: Hacker News / 9 months ago

> Data extraction/structuring data is the only serious application of LLMs I fully agree. I realized this early on when experimenting with GPT-3 for web data extraction. We then started seeing a lot of demand for automating rule-based web scraping stacks (lots of maintenance, hard to scale), which led to the creation of our startup (https://kadoa.com). AI won't eliminate our jobs, but it will automate tedious,... - Source: Hacker News / 11 months ago

You're right, LLMs are really good at extracting and structuring data from third party sources. I've been working on a "Zapier for data extraction" for this reason: https://kadoa.com. - Source: Hacker News / almost 2 years ago

We're using LLMs to generate web scrapers and data processing steps on the fly that adapt to website changes. Using an LLM for every data extraction, as most comparable tools do, is expensive and slow, but using LLMs to generate the scraper code and subsequently adapt it to website modifications is highly efficient. Try it out https://kadoa.com. - Source: Hacker News / almost 2 years ago