Apify Reviews and details

Social recommendations and mentions

• Automating Data Collection with Apify: From Script to Deployment

  In this article, I will walk you through everything, from crafting your initial scraping script (Actor) using the Apify SDK for TypeScript to deploying it to the Apify Actors Store for seamless data collection, and then, I will show you how to run your deployed Actor on the Apify platform. With Apify, you don't need to be a programming pro to harness the power of web scraping and start gaining insights. - Source: dev.to / about 1 month ago

• Web Scraping in Python – The Complete Guide

  I am surprised nobody mentioned https://apify.com/ and they even offer discount for YC startups as ex-graduate from the YC Combinator program. - Source: Hacker News / 2 months ago

• AI tools I have found useful w/ research. What do you guys think? What did I miss?

  Web Scraping, Data Extraction and Automation · Apify ( https://apify.com/ ). Source: 10 months ago

• How to scrape the web with Puppeteer in 2023

  At this point of the tutorial, I'll take the opportunity to do a bit of self-promotion. I'm the COO of Apify, a cloud platform that helps you develop, run, and maintain your web scrapers easily and efficiently. It comes with tons of features like queue storages and proxies, and it supports Puppeteer without any extra configuration. You can run the above scraper, save results and control everything with a powerful... - Source: dev.to / about 1 year ago

• Web Search and Scrape

  Apify a saas that can be helpful in this situation since you can use its api to call actors from your java code. Source: over 1 year ago

• How to stay one step ahead of errors and downtime as you scale up your business

  At FINN we use Checkly once again to run our scheduled E2E tests. Some teams also use a combination of Make and Apify to run scheduled E2E tests on smaller projects. - Source: dev.to / over 1 year ago

• What's new in the Webscraping Ecosystem ? from OxyCon 2022

  Crawlee: A new webscraping framework by Apify. - Source: dev.to / over 1 year ago

• Crawlee - the web scraping and browser automation library

  Actively maintained and developed by Apify—we use it ourselves! Source: over 1 year ago

• Show HN: Crawlee – The web scraping and browser automation library for Node.js

  Hi there! We dont have any benchmarks for Crawlee just yet, but we are working on those as we speak. We care deeply about bot detection, one of the features of Crawlee is generated fingerprints based on real browser data we gather - you can read more about it in the https://github.com/apify/fingerprint-suite repository, which is used under the hood in Crawlee. Crawlee is and always will be open source. It... - Source: Hacker News / over 1 year ago

• Are there jobs out there where all you do is build scrappers ?

  Have you looked at Apify? They have a freelancer section. https://apify.com/. Source: over 1 year ago

• Ask HN: What are the best tools for web scraping in 2022?

  I'm working on a personal project that involves A LOT of scraping, and through several iterations I've gotten some stuff that works quite well. Here's a quick summary of what I've explored (both paid and free): * Apify (https://apify.com/) is a great, comprehensive system if you need to get fairly low-level. Everything is hosted there, they've got their own proxy service (or you can roll your own), and their... - Source: Hacker News / over 1 year ago

• [Resource Request] Absolute must have marketing tools and resources for founders and entrepreneurs

  I would add Apify it is a good alternative to Phantomubster for some workflow QApop.com for Quora marketing Zapier or intgromate to glue all the tools together. Source: about 2 years ago

• Looking for webscraping services suggestions

  Check out apify.com It can do everything you need. Source: about 2 years ago

• Is web scraping legal or illegal?

  To give you an example, I'm part of Apify, a web scraping and automation company. Here at Apify, we are partners with Thorn, an anti-human trafficking organization, and we use our web scraping technology to help identify and fight child traffickers online. Clearly, this is a good use of web scraping. Nevertheless, this same technology can be used for conducting illegal activities, such as collecting personal data... Source: about 2 years ago

• free proxy....? or cheap bulk proxies?

  You can host your code on Apify and then use their proxies. Residential proxies are part of their free plan, and if you need something more powerful in the future, they also offer rotating proxies for a cheap monthly subscription fee. Source: over 2 years ago

• Best Scraping Tools For Amazon: How to Shake the Market

  Apify is a web scraping tool specialized in Amazon’s data, and its aim is to provide what the official API of Amazon can not provide for the users. Apify’s Amazon Scraper harvest and download data, including detailed descriptions of online products, images of the items, prices, pictures, the name of the seller, condition of the article, whether they are new, refurbished, or broken, and all other information... - Source: dev.to / over 2 years ago

• Best cheap proxies?

  I recommend hosting your code on Apify. Their free plan includes access to residential proxies, which should be enough for you to scrape FB. Even if you need to scale your solution in the future, their monthly paid plan is quite cheap and gives you access to shared datacenter proxies and Apify Proxy as well. Source: over 2 years ago

• Created a working web scraper for a popular US airline, but could use help refining it

  Hi there! It will help if you use a proxy. I would recommend writing your project with Apify SDK. It is a tool built on top of other JS libraries, such as puppeteer, so you can quickly apply it to your project. Then, you can run your project on the Apify platform. There you can set up proxies for your scraper, making it harder for the website to identify and block your bot. You can check the Apify SDK docs to get... Source: over 2 years ago

• Show HN: I spent 1.5 years making a Chrome extension that automates any website

  A sample in alphabetical order - and by no means exhaustive: https://apify.com/ https://axiom.ai/ (YC W21) https://include.ai/ https://www.progress.com/imacros https://trysmartcuts.com (YC W21) https://ui.vision/ https://wildfire.ai/ 3 of these are YC companies (reminds me of mixpanel vs segment vs amplitude, where YC are backing all the horses). Each company is different in its particular approach and market,... - Source: Hacker News / over 2 years ago

• How to correctly crawl lots of pages without getting a bot checking screen from cloudflare?

  Convincing Cloudflare that you're a human and not a bot is not easy, but we do that every day at Apify so if you need more help with scraping, you can definitely get in touch with us. Source: over 2 years ago

• Twitter bio Scraper to identify micro-influencers, search and export users and profile info as CSV file

  2) Write code from scratch or hit an API from rapidAPI or Apify. Based on my research these cost $50/month for the cheapest plan. Source: almost 3 years ago