I've been playing around with different scraping tools in the past month, trying to find the best one to help with my research project, and I have to say this new feature of auto-detection comes like a life-savor. I only need to give the software the link and it will auto-detect the content and build the crawler for me. I can even enjoy it with just a free plan!
Based on our record, grep.app should be more popular than Octoparse. It has been mentiond 15 times since March 2021. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Https://grep.app - To search repos for patterns. I usually use it when I'm using an obscure or badly documented library. https://unicode.scarfboy.com/ - Unicode stuff. There are a lot of small Unicode tool sites. - Source: Hacker News / 3 months ago
There are some alternatives like https://grep.app or https://sourcegraph.com/search if you want fast live search, but at the end of the day these are generally expensive services to provide, especially for free anonymous users, so you should probably at least accept that service providers can and do change things like this. You can also run something like your own copy of Zoekt and then ingest repositories on... - Source: Hacker News / 9 months ago
Https://grep.app/ is another good one. Not sure how many repos they index though. - Source: Hacker News / 9 months ago
Https://grep.app/ is similar and seems to return results, but I have not compared it to native GitHub search. - Source: Hacker News / 11 months ago
Https://grep.app/ has served me well for the last couple of years finding snippets for random APIs. But recently I found that certain strings from open-source projects suddenly yield no results. For example: VaultServiceTimeout from https://github.com/rajanadar/VaultSharp has no results for https://grep.app/search?q=VaultServiceTimeout. Is there some alternative service for this task that is up-to-date? - Source: Hacker News / about 1 year ago
Octoparse.com might work, they have a very nice interactive tool + 14 day free trail. Source: over 3 years ago
These are no-code solutions for scraping websites. You don’t need any technical knowledge to scrape Aliexpress using these tools. Using advanced AI-powered click and scrape tools, you can get started scraping within seconds either locally or in the cloud. Choosing a good scraping tool can save you lots of money and time as well. Source: almost 4 years ago
I have always been able to extract data without any problems with Octoparse. It is also a very easy to use tool. Source: almost 4 years ago
Sourcegraph - Sourcegraph is a free, self-hosted code search and intelligence server that helps developers find, review, understand, and debug code. Use it with any Git code host for teams from 1 to 10,000+.
import.io - Import. io helps its users find the internet data they need, organize and store it, and transform it into a format that provides them with the context they need.
OpenGrok - OpenGrok is a fast and usable source code search and cross reference engine.
ParseHub - ParseHub is a free web scraping tool. With our advanced web scraper, extracting data is as easy as clicking the data you need.
searchcode - A source code search engine
Apify - Apify is a web scraping and automation platform that can turn any website into an API.