Simple Scraper VS Scrapy

Simple Scraper Reviews

Scrapy Reviews

Simple Scraper mentions (18)

• A list of SaaS, PaaS and IaaS offerings that have free tiers of interest to devops and infradev

  Simplescraper — Trigger your webhook after each operation. The free plan includes 100 cloud scrape credits. - Source: dev.to / 3 months ago

• Ask HN: Successful one-person online businesses?

  I run Simplescraper (https://simplescraper.io). Started in 2020 and it's now profitable. > Have any recent trends affected your business? Not really. People like data as much as ever. As a one-person biz, the main dilemma remains how to juggle development, marketing and support. Reaching a point where the price of context-switching to customer support is becoming a little too high. But that's easily fixable and... - Source: Hacker News / about 1 year ago

• Experimental library for scraping websites using OpenAI's GPT API

  > perhaps you can simply ask the API to create Python or JS code that is deterministic, instead. Had a conversation last week with a customer that did exactly that - spent 15 minutes in chatGPT generating working Scrapy code. Neat to see people solve their own problem so easily but it doesn't yet erode our value. I run https://simplescraper.io and a lot of value is integrations,scale, proxies, scheduling,... - Source: Hacker News / about 1 year ago

• Those making $500/month on side projects in 2023 – Show and tell

  I'm making https://simplescraper.io - a no-code web scraping tool. Saved up, quit my job and went all in...on a todo app. Needless to say it, that didn't go far, but it did teach me how to code. When I was close to broke (much too close) I pivoted to this product and finally gained traction and now it's doing well enough to be my main source of income. I'm kind of following the "1000 true fans" ethos that pops up... - Source: Hacker News / over 1 year ago

• Export any.do tasks

  I just discovered simplescraper.io. If you're needing to export all your stuff in any.do this works pretty well. simplescraper.ioIf you're needing to export all your stuff in any.do this works pretty well. Source: over 1 year ago

Scrapy mentions (93)

• What is SERP? Meaning, Use Cases and Approaches

  While there is no specific library for SERP, there are some web scraping libraries that can do the Google Search Page Ranking. One of them which is quite famous is Scrapy - It is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It offers rich developer community support and has been used by more than 50+ projects. - Source: dev.to / 5 months ago

• Creating an advanced search engine with PostgreSQL

  If you're looking for a turn-key solution, I'd have to dig a little. I generally write a scraper in python that dumps into a database or flat file (depending on number of records I'm hunting). Scraping is a separate subject, but once you write one you can generally reuse relevant portions for many others. If you can get adept at a scraping framework like Scrapy you can do it fairly quickly, but there aren't many... - Source: Hacker News / 10 months ago

• What do .NET devs use for web scraping these days?

  I know this might not be a good answer, as it's not .NET, but we use https://scrapy.org/ (Python). Source: 11 months ago

• BeutifulSoup and getting URLs

  Take a look at Scrapy. It has a fairly advanced throttling mechanism for you to not get banned. Source: 11 months ago

• Looking for a Python (or R) program or package to save only images from any plain vanilla website

  Not only Windows, you can also use it on Mac and Linux too. But for Python and CLI, you can use scrapy. Source: 12 months ago