Scraping Fish Reviews and details

Social recommendations and mentions

• What is the most useful project you've ever worked on?

  I’m still working on a web scraping API (https://scrapingfish.com/). For some people it’s evil bot but for others it’s enabler for public data access. I thinks it’s useful. - Source: Hacker News / 25 days ago

• Ask HN: How much to charge for an API call?

  To give you a reference point, at https://scrapingfish.com/ we charge $0.002 per API call but in our case, the API call gives you the value by itself: access to mobile proxies and cluster of browsers. For you, I would recommend to either give the API access for free as I assume users already pay for the product. Another option would be to include API access only to higher plan users who pay more and this could be... - Source: Hacker News / about 2 months ago

• Web Scraping in Python – The Complete Guide

  I'm using Scraping Fish because of their pay-as-you-go style pricing as opposed to subscription with monthly scraping volume commitment. And they don't charge extra credits for JS rendering or residential proxies because the cost of each request is the same: https://scrapingfish.com. - Source: Hacker News / 2 months ago

• Ask HN: What apps have you created for your own use?

  I've created a mobile proxy pool for a personal project of web scraping real estate data: https://scrapingfish.com/blog/byo-mobile-proxy-for-web-scraping Then, I expanded the infrastructure and built a web scraping API on top of it: https://scrapingfish.com. - Source: Hacker News / 5 months ago

• Email Obfuscation Rendered Almost Ineffective Against ChatGPT

  0.2 cents is how much a single request costs for well-protect website where web scrapers look for emails (e.g. LinkedIn): https://scrapingfish.com/#pricing Paying additional 0.2 cents per request, if it can significantly improve your success rate, is not really that much and some people use LLMs for even simpler parsing tasks to save time on development efforts. - Source: Hacker News / 6 months ago

• Show HN: I built a dataset of 25k+ Gumroad products to spot market opportunities

  I'm curious too since I'm developing a web scraping API product (https://scrapingfish.com). - Source: Hacker News / 8 months ago

• Real challenge for web scrapers- Need Help!

  Just tried with https://scrapingfish.com/ and it worked using JavaScript rendering. The best thing is you don’t pay extra credits for JS rendering. Disclaimer: I am a co-founder of Scraping Fish. Source: 10 months ago

• Ticketmaster event scraping

  What is the best way to scrape ticketmaster events? I have tried apify and ScrapingFish residential ips and both of them are blocked, apify 100% of my requests fail and on scrapingfish, only 1 out of every 300-ish requests succeed. Any ideas, esp on where I could get better residential IPs or how I can get around the blocking. Source: 11 months ago

• Cheapest way to scrape google search results?

  If you are willing to just get the SERPs I believe our solution is cheap. https://scrapingfish.com. You would get just the html though, not a preprocessed JSON. Feel free to DM me if you’ve got any questions. Source: 12 months ago

• Proxy needed!

  For Google https://scrapingfish.com/ will work very well. Source: about 1 year ago

• Ask HN: Side project of more that $2k monthly revenue what's your project?

  For https://scrapingfish.com/ it took us about 5-6 months from idea to $2k/month. It’s still not our main source of income. It was fun to build especially that it involved working with hardware. - Source: Hacker News / about 1 year ago

• Help with finding proxy provider

  Https://scrapingfish.com/ seems pretty good. Source: about 1 year ago

• Long-polling, API

  Not really, polling is the only option for you. You can add more delay between requests. Test if you get banned if you make one request every 5 minutes instead of 6 seconds. If you’re use case requires checking for new data every few seconds, you can use proxy or some kind of service which does ip rotation for you, like https://scrapingfish.com/. Source: about 1 year ago

• Experimental library for scraping websites using OpenAI's GPT API

  I don’t see how any LLM would help me with a high quality proxy, which is what I actually need in web scraping and I’m using https://scrapingfish.com/ for this. - Source: Hacker News / about 1 year ago

• How to scrape Walmart?

  You could use our Scraping Fish API (https://scrapingfish.com) or one of the other web scraping APIs or good proxies. Otherwise, they most likely will block you eventually. Plain user agents shuffling is unlikely to suffice. Source: about 1 year ago

• Those making $500/month on side projects in 2023 – Show and tell

  Scraping Fish - a web scraping API powered by custom-build, ethical, mobile proxy pool: https://scrapingfish.com/. - Source: Hacker News / over 1 year ago

• Ask HN: How to come up with ideas for micro side projects?

  Here is my story, which may provide some inspiration. My co-founder was searching for an apartment to purchase and found that all the tools he was using had weaknesses and none of them met his needs. We decided to create an aggregator for real estate offers. Initially, we intended to target users looking to buy an apartment, but we later pivoted to focus on real estate agencies and added features around this.... - Source: Hacker News / over 1 year ago

• Do You Have Suggestions About Call-To-Action?

  Some time ago I used https://marketingexamples.com to help me design landing page for [Scraping Fish](https://scrapingfish.com) and it also covers CTA to some extent:. Source: over 1 year ago

• Best Proxy Lists?

  Did you consider a web scraping API like https://scrapingfish.com instead of a proxy. Depending on the scale of you scraping job, it can be more affordable option. Source: over 1 year ago

• Good proxies for big webscraping project

  You should consider a webscraping API which is usually more affordable that proxies with bandwidth based pricing. I recommend https://scrapingfish.com. Source: over 1 year ago

• Spreadsheet webscraping

  You need some kind of rotating proxy service or API, for example https://scrapingfish.com/. Source: over 1 year ago