Colly Reviews and details

Social recommendations and mentions

• Web Scraping in Golang

  In this blog, we will be covering the basics of web scraping in Go using the Fiber and Colly frameworks. Colly is an open-source web scraping framework written in Go. It provides a simple and flexible API for performing web scraping tasks, making it a popular choice among Go developers. Colly uses Go's concurrency features to efficiently handle multiple requests and extract data from websites. It offers a wide... - Source: dev.to / about 1 year ago

• FAQs on my side project

  I wrote a script in Go to scrape jobs from these companies. If you are interested in writing scraper with Go, check out http://go-colly.org/ a potent tool for scraping in Go. I scrape every day just to keep up to date with the jobs. Source: over 1 year ago

• Preferred Programming Languages for Web Scraping

  In addition the article mention that "Also, C++ is not good for creating web crawlers, is programming language is great for simple web scraping" but in reality when you need a fast and performant crawler C++ will be beat languages like ruby and python from performance perspective , the same for golang programming language which will perform better most of the programming languages written on the article and has... Source: over 1 year ago

• Scraping websites with go

  Strange that the author didn’t mention the most popular and, frankly, convenient way: Colly. Source: over 1 year ago

• Ask HN: What are the best tools for web scraping in 2022?

  I’m not sure about “best” but I’ve been using Colly (written in Go) and it’s been pretty slick. Haven’t run in to anything it can’t do. http://go-colly.org/. - Source: Hacker News / over 1 year ago

• First project - The API for engineering multiple choice questions

  There is the scraper struct that spawns goroutine. Then, each goroutine scraps the web URL using go colly, and the structured MCQ questions are served from API endpoints. Users can choose between persistent Postgres model or in-memory data structure to store the questions and retrieve them from API. I have used dependency injection to inject the models via the interface to my application struct. Source: almost 2 years ago

• How I Scraped Michelin Guide Using Go

  What follows is my thought process on how I collect all restaurant details from the Michelin Guide using Go with Colly. The final dataset is available free to be downloaded here. - Source: dev.to / about 2 years ago

• The State of Web Scraping in 2021

  If you're familiar with Go, there's Colly too [1]. I liked its simplicity and approach and even wrote a little wrapper around it to run it via Docker and a config file: https://gotripod.com/insights/super-simple-site-crawling-and-scraping/ [1] http://go-colly.org/. - Source: Hacker News / over 2 years ago

• How to Crawl the Web with Scrapy

  What's your problem with Colly? [0] [0] http://go-colly.org/. - Source: Hacker News / over 2 years ago