Scraper API
Scrapy
Octoparse
Bright Data
Apify
Zyte
ScrapingBee
Crawlbase
Vespa.ai
Meilisearch
Typesense
Qdrant
Algolia
txtai
Milvus
Weaviate
Scraper API manages thousands of proxies and headless browsers internally and gives developers a simple API endpoint to scrape any web page and render javascript. Get started with 1000 free API calls/month!
Scraper APINo Vespa.ai videos yet. You could help us improve this page by suggesting one.
We are using Scraper API more than 6 months. The product is very effective and we integrate it into our SaaS software.
Based on our record, Vespa.ai seems to be a lot more popular than Scraper API. While we know about 19 links to Vespa.ai, we've tracked only 1 mention of Scraper API. We are tracking product recommendations and mentions on various public social media platforms and blogs. They can help you identify which product is more popular and what people think of it.
Yeah, scraperapi.com also has a feature called "autoparse", and it converts some sites that it supports (e.g. Amazon) to JSON. Source: almost 2 years ago
If you're serious about scaling up, definitely consider Vespa (https://vespa.ai). At serious scale, Vespa will likely knock all the other options out of the park. - Source: Hacker News / about 2 months ago
Yahoo released their geographic data catalogue under open license and it still lives on as https://whosonfirst.org/ Afaik https://en.wikipedia.org/wiki/Apache_ZooKeeper started at Yahoo https://vespa.ai/ was Yahoo's search engine for news and other content product, now spinned off (https://techcrunch.com/2023/10/04/yahoo-spins-out-vespa-its-search-tech-into-an-independent-company/). - Source: Hacker News / 4 months ago
I think https://vespa.ai/ has the right approach in this space by focusing on being hybrid - vectors alone aren't great for production use cases, it's the combining of vectors+text that lets you use ranking to get meaningful result. (I'm an investor so I'm biased; but it's also the reason why I invested). - Source: Hacker News / 4 months ago
So what’s the catch? Why is this not everywhere? Because IR is not quite NLP — it hasn’t gone fully mainstream, and a lot of the IR frameworks are, quite frankly, a bit of a pain to work with in-production. Some solid efforts to bridge the gap like Vespa [1] are gathering steam, but it’s not quite there. [1] https://vespa.ai. - Source: Hacker News / 5 months ago
When it comes to search I cannot disagree more. https://vespa.ai is a purpose built search engine. If you start bolting search onto your database, your relevance will be terrible, you'll be rewriting a lot of table stakes tools/features from scratch, and your technical debt will skyrocket. - Source: Hacker News / 11 months ago
Scrapy - Scrapy | A Fast and Powerful Scraping and Web Crawling Framework
Meilisearch - Ultra relevant, instant, and typo-tolerant full-text search API
Octoparse - Octoparse provides easy web scraping for anyone. Our advanced web crawler, allows users to turn web pages into structured spreadsheets within clicks.
Typesense - Typo tolerant, delightfully simple, open source search 🔍
Bright Data - World's largest proxy service with a residential proxy network of 72M IPs worldwide and proxy management interface for zero coding.
Qdrant - Qdrant is a high-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/