DuckDuckGo: Bang VS Apache Nutch

And when you do need google, you can always just add `!g` to your search query. There are a bunch of other useful ones [0], my favorite is probably `!w` [0] https://duckduckgo.com/bangs. - Source: Hacker News / about 16 hours ago

Check out https://duckduckgo.com/bangs you can dump into pretty much any site, Wikipedia, YouTube, Spotify, Google Translate from the DDG search bar if you have a few favorite bangs memorized. You can put the ! anywhere in the query for it to be picked up as well. - Source: Hacker News / 21 days ago

Seriously, I'm surprised at how many devs haven't seen DuckDuckGo's bangs: https://duckduckgo.com/bangs I use them all the time for work. !mdn for MDN, !dnab for .NET, !npm for NPM, !py3 for Python3 docs, !debman for Debian Manpages, !w for Wikipedia, !a for Amazon, !g for Google when you really need it. I'm not affiliated with DDG; I just really, really love it. - Source: Hacker News / 4 months ago

I think everyone in the thread knows about "search engines" in Chrome and bookmark keywords in Firefox. The crux of the issue is that there are more than 10,000 bang commands in DDG. Setting up even a popular subset in any given browser is a significant investment. It's fine if it's the browser you use 99% of the time, but for those spanning multiple computers, phones, and other devices, simply using bang... - Source: Hacker News / 4 months ago

Where is the place to add personal bangs to DuckDuckGo? I can't find it in https://duckduckgo.com/bangs or https://duckduckgo.com/settings. - Source: Hacker News / 5 months ago

Hi, I have read few comments under the post, there are great suggestions also your questions regarding task are on the point. But I believe handling this with a script might be not easy. If I were you, I would use Apache Nutch or similar open source software/library.I have used Nutch for my thesis for similar task that I had to scrap a lot of blog pages and the other pages they were referencing. You can configure... Source: over 1 year ago

I've never used it, but I was on a project where we considered Apache Nutch: https://nutch.apache.org/. Source: over 1 year ago