Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR. Learn more →
Scrapy-redis Alternatives
Similar projects and alternatives to scrapy-redis
-
Playwright
Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.
-
Judoscale
Save 47% on cloud hosting with autoscaling that just works. Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.
-
-
-
-
-
-
-
InfluxDB
InfluxDB high-performance time series database. Collect, organize, and act on massive volumes of high-resolution data to power real-time intelligent systems.
-
undetected-chromedriver
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
-
-
-
browserless
Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.
-
-
-
Webscraping Open Project
Discontinued The web scraping open project repository aims to share knowledge and experiences about web scraping with Python [Moved to: https://github.com/TheWebScrapingClub/webscraping-from-0-to-hero]
-
-
-
-
-
-
-
CodeRabbit
CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
NOTE:
The number of mentions on this list indicates mentions on common posts plus user suggested alternatives.
Hence, a higher number means a better scrapy-redis alternative or higher similarity.
scrapy-redis discussion
scrapy-redis reviews and mentions
Posts with mentions or reviews of scrapy-redis.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-26.
- How to make scrapy run multiple times on the same URLs?
-
Ask HN: What are the best tools for web scraping in 2022?
11. With some work, you can use Scrapy for distributed projects that are scraping thousands (millions) of domains. We are using https://github.com/rmax/scrapy-redis.
-
How can I clone a github project to offline machine ?
git clone https://github.com/darkrho/scrapy-redis.git cd scrapy-redis python setup.py install
-
A note from our sponsor - CodeRabbit
coderabbit.ai | 19 Apr 2025
Stats
Basic scrapy-redis repo stats
4
5,590
6.0
10 months ago
rmax/scrapy-redis is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of scrapy-redis is Python.
Popular Comparisons
Sponsored
Save 47% on cloud hosting with autoscaling that just works
Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.
judoscale.com