Scrapy VS colly

Compare Scrapy vs colly and see what are their differences.

Scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python. (by scrapy)

colly

Elegant Scraper and Crawler Framework for Golang (by gocolly)
Our great sponsors
  • Scout APM - Less time debugging, more time building
  • SonarLint - Deliver Cleaner and Safer Code - Right in Your IDE of Choice!
  • SaaSHub - Software Alternatives and Reviews
Scrapy colly
96 14
43,565 16,631
0.9% 2.4%
8.8 5.3
3 days ago 29 days ago
Python Go
BSD 3-clause "New" or "Revised" License Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

Scrapy

Posts with mentions or reviews of Scrapy. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-05-25.

colly

Posts with mentions or reviews of colly. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-05-08.

What are some alternatives?

When comparing Scrapy and colly you can also consider the following projects:

requests-html - Pythonic HTML Parsing for Humans™

pyspider - A Powerful Spider(Web Crawler) System in Python.

GoQuery - A little like that j-thing, only in Go.

MechanicalSoup - A Python library for automating interaction with websites.

xpath - XPath package for Golang, supports HTML, XML, JSON document query.

RoboBrowser

Grab - Web Scraping Framework

pyppeteer - Headless chrome/chromium automation library (unofficial port of puppeteer)

playwright-python - Python version of the Playwright testing and automation library.

portia - Visual scraping for Scrapy

Ferret - Declarative web scraping

feedparser - Parse feeds in Python