Scrapy-redis Alternatives

Similar projects and alternatives to scrapy-redis

• Playwright

  3 48,671 10.0 TypeScript scrapy-redis VS Playwright

  Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

  

• estela

  2 110 8.3 Python scrapy-redis VS estela

  estela, an elastic web scraping cluster 🕸

  

• InfluxDB

  www.influxdata.com

  sponsored

  Access the most powerful time series database as a service. Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

  

• puppeteer

  1 82,383 9.9 TypeScript scrapy-redis VS puppeteer

  Headless Chrome Node.js API

  

• jq

  1 24,492 1.6 C scrapy-redis VS jq

  Command-line JSON processor

• colly

  1 19,168 4.4 Go scrapy-redis VS colly

  Elegant Scraper and Crawler Framework for Golang

  

• pup

  1 7,692 0.0 HTML scrapy-redis VS pup

  Parsing HTML at the command line

• chrome

  1 5,298 9.5 TypeScript scrapy-redis VS chrome

  The browserless Chrome service in Docker. Run on our cloud, or bring your own.

  

• Sonar

  www.sonarsource.com

  sponsored

  Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  

• undetected-chromedriver

  1 4,422 8.7 Python scrapy-redis VS undetected-chromedriver

  Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

• steam-for-linux

  1 3,727 0.0 scrapy-redis VS steam-for-linux

  Issue tracking for the Steam for Linux beta client

  

• chrome-aws-lambda

  1 2,965 0.0 TypeScript scrapy-redis VS chrome-aws-lambda

  Chromium Binary for AWS Lambda and Google Cloud Functions

• scrapyd

  1 2,610 2.1 Python scrapy-redis VS scrapyd

  A service daemon to run Scrapy spiders

  

• curl-impersonate

  1 2,087 7.6 Python scrapy-redis VS curl-impersonate

  curl-impersonate: A special build of curl that can impersonate Chrome & Firefox

• Webscraping Open Project

  1 1,199 6.7 Python scrapy-redis VS Webscraping Open Project

  The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

  

• linkedom

  1 1,118 8.8 HTML scrapy-redis VS linkedom

  A triple-linked lists based DOM implementation.

• bumblebee-Old-and-abbandoned

  1 453 0.0 Shell scrapy-redis VS bumblebee-Old-and-abbandoned

  OUTDATED!!!!! - Replaced by "The Bumblebee Project" and "Ironhide"

• google-search-results-php

  1 43 2.8 PHP scrapy-redis VS google-search-results-php

  Google Search Results PHP API via Serp Api

  

• wistalk

  1 20 0.0 Python scrapy-redis VS wistalk

  Wistalk : Analyze Wikipedia User's Activity

• ssscraper

  1 15 1.7 Go scrapy-redis VS ssscraper

  A crawler/scraper based on golang + colly, configurable via JSON

  

• powerpage-web-crawler

  1 6 0.0 HTML scrapy-redis VS powerpage-web-crawler

  a portable, lightweight web crawler using Powerpage.

• wi-page

  1 1 0.0 Python scrapy-redis VS wi-page

  Rank Wikipedia Article's Contributors by Byte Counts.

• SaaSHub

  www.saashub.com

  sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives