scrapy-cloudflare-middleware vs scrapy-splash

scrapy-cloudflare-middleware

A Scrapy middleware to bypass the CloudFlare's anti-bot protection (by clemfromspace)

Source Code

Suggest alternative

Edit details

scrapy-splash

Scrapy+Splash for JavaScript integration (by scrapy-plugins)

Scrapy headless-browsers

Source Code

Suggest alternative

Edit details

Our great sponsors

InfluxDB - Power Real-Time Data Analytics at Scale

WorkOS - The modern identity platform for B2B SaaS

SaaSHub - Software Alternatives and Reviews

Our great sponsors

scrapy-cloudflare-middleware		scrapy-splash
	Project
1	Mentions	3
102	Stars	3,051
-	Growth	0.0%
0.0	Activity	0.0
almost 3 years ago	Latest Commit	about 1 year ago
Python	Language	Python
Do What The F*ck You Want To Public License	License	BSD 3-clause "New" or "Revised" License

The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

scrapy-cloudflare-middleware

Posts with mentions or reviews of scrapy-cloudflare-middleware. We have used some of these posts to build our list of alternatives and similar projects.

We haven't tracked posts mentioning scrapy-cloudflare-middleware yet.
Tracking mentions began in Dec 2020.

scrapy-splash

Posts with mentions or reviews of scrapy-splash. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2021-05-10.

Scrape with Splash Requests returns empty
1 project | /r/scrapy | 17 Jun 2022

I have also modified the settings.py from according to steps 1-5 from https://github.com/scrapy-plugins/scrapy-splash
Anybody actually hoard something they weren't able to find later on the internet?
4 projects | /r/DataHoarder | 10 May 2021

To add to u/nemec, here are the docs for scrapy splash which I’ve used several times (and just requires you to spin up their docker container to get started): https://github.com/scrapy-plugins/scrapy-splash
How Do I Scrape Data From A Scrollable List That
1 project | /r/scrapy | 10 Jan 2021

Your best bet is scrapy splash as you're dealing with dynamically generated html: https://github.com/scrapy-plugins/scrapy-splash

What are some alternatives?

When comparing scrapy-cloudflare-middleware and scrapy-splash you can also consider the following projects:

undetected-chromedriver - Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

scrapy-playwright - 🎭 Playwright integration for Scrapy

scrapydweb - Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:

scrapy-rotating-proxies - use multiple proxies with Scrapy

scrapy-fake-useragent - Random User-Agent middleware based on fake-useragent

Fail2Ban - Daemon to ban hosts that cause multiple authentication errors

btcrecover - An open source Bitcoin wallet password and seed recovery tool designed for the case where you already know most of your password/seed, but need assistance in trying different possible combinations.

Scrapy - Scrapy, a fast high-level web crawling & scraping framework for Python.