Ray VS Scrapy

Compare Ray vs Scrapy and see what are their differences.

Ray

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library. (by ray-project)

Scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python. (by scrapy)
Our great sponsors
  • Nanos - Run Linux Software Faster and Safer than Linux with Unikernels
  • Scout APM - A developer's best friend. Try free for 14-days
  • SaaSHub - Software Alternatives and Reviews
Ray Scrapy
24 64
18,352 42,299
2.4% 0.7%
10.0 9.1
7 days ago about 18 hours ago
Python Python
Apache License 2.0 GNU General Public License v3.0 or later
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

Ray

Posts with mentions or reviews of Ray. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-11-08.

Scrapy

Posts with mentions or reviews of Scrapy. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-12-06.

What are some alternatives?

When comparing Ray and Scrapy you can also consider the following projects:

requests-html - Pythonic HTML Parsing for Humans™

pyspider - A Powerful Spider(Web Crawler) System in Python.

MechanicalSoup - A Python library for automating interaction with websites.

Faust - Python Stream Processing

stable-baselines3 - PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.

RoboBrowser

gevent - Coroutine-based concurrency library for Python

Grab - Web Scraping Framework

SCOOP (Scalable COncurrent Operations in Python) - SCOOP (Scalable COncurrent Operations in Python)

portia - Visual scraping for Scrapy

Thespian Actor Library - Python Actor concurrency library

feedparser - Parse feeds in Python