Apache Nutch
Scrapy
StormCrawler
CommonCrawl
Heritrix
ACHE Crawler
Mixnode
Apache Solr
The Google Cemetery
Killed by Google
Failory
Google Graveyard by SaaSHub
Startup Graveyard
How not to launch
Collapsed
YC Rejects
Apache Nutch The Google CemeteryBased on our record, The Google Cemetery seems to be a lot more popular than Apache Nutch. While we know about 31 links to The Google Cemetery, we've tracked only 2 mentions of Apache Nutch. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Hi, I have read few comments under the post, there are great suggestions also your questions regarding task are on the point. But I believe handling this with a script might be not easy. If I were you, I would use Apache Nutch or similar open source software/library.I have used Nutch for my thesis for similar task that I had to scrap a lot of blog pages and the other pages they were referencing. You can configure... Source: over 1 year ago
I've never used it, but I was on a project where we considered Apache Nutch: https://nutch.apache.org/. Source: over 1 year ago
No one wants to play the guessing game of which products will live and die (well, maybe those who are compulsive gambler do) https://gcemetery.co/. - Source: Hacker News / about 1 year ago
If you haven't come across these sites in the past, The Google Cemetery and Killed By Google sites are really fun to scroll through. So much has been killed off! Source: about 1 year ago
It’s made by Google, I wouldn’t hold my breath. Source: about 1 year ago
Google 2023 is the company who killed RSS, removed "don't be evil", slapped adverts all over YouTube while asking you to pay for it, produces garbage SEO-spam-filled ad-ridden search results which ignore what you searched for, turned Android into creepy stalker advert OS, shuts people's paid-for accounts without warning and no human support available, has an also-ran cloud service behind even Microsoft's, and is... Source: about 1 year ago
There are a few listing like the "Google Graveyard": - https://killedbygoogle.com/ - https://gcemetery.co/. Source: about 1 year ago
Scrapy - Scrapy | A Fast and Powerful Scraping and Web Crawling Framework
Killed by Google - Killed by Google is the open source list of dead Google products, services, and devices. It serves as a tribute and memorial of beloved services and products killed by Google.
StormCrawler - StormCrawler is an open source SDK for building distributed web crawlers with Apache Storm.
Failory - Failory is a community visited by startup founders every day to read articles about entrepreneurship, interviews with failed and successful founders, insightful postmortems and our monthly reports.
CommonCrawl - Common Crawl
Google Graveyard by SaaSHub - The Google Graveyard is the complete list of discontinued products by Google. Also known as 'The Google Cemetery'
