Scrapy-redis Alternatives

Similar projects and alternatives to scrapy-redis

• steam-for-linux

  463 4,096 2.0 scrapy-redis VS steam-for-linux

  Issue tracking for the Steam for Linux beta client

  

• Playwright

  377 61,381 9.9 TypeScript scrapy-redis VS Playwright

  Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

  

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• puppeteer

  356 86,704 9.9 TypeScript scrapy-redis VS puppeteer

  Node.js API for Chrome

  

• jq

  306 25,063 0.0 C scrapy-redis VS jq

  Discontinued Command-line JSON processor [Moved to: https://github.com/jqlang/jq] (by stedolan)

  

• bumblebee-Old-and-abbandoned

  76 467 0.0 Shell scrapy-redis VS bumblebee-Old-and-abbandoned

  OUTDATED!!!!! - Replaced by "The Bumblebee Project" and "Ironhide"

• pup

  52 7,992 0.0 HTML scrapy-redis VS pup

  Parsing HTML at the command line

• colly

  39 22,120 6.0 Go scrapy-redis VS colly

  Elegant Scraper and Crawler Framework for Golang

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• undetected-chromedriver

  40 8,018 7.1 Python scrapy-redis VS undetected-chromedriver

  Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)

• google-search-results-php

  32 53 2.2 PHP scrapy-redis VS google-search-results-php

  Google Search Results PHP API via Serp Api

  

• curl-impersonate

  31 3,308 7.1 Python scrapy-redis VS curl-impersonate

  curl-impersonate: A special build of curl that can impersonate Chrome & Firefox

• browserless

  21 7,842 9.8 TypeScript scrapy-redis VS browserless

  Deploy headless browsers in Docker. Run on our cloud or bring your own. Free for non-commercial uses.

  

• linkedom

  13 1,463 8.1 HTML scrapy-redis VS linkedom

  A triple-linked lists based DOM implementation.

• chrome-aws-lambda

  12 3,135 0.0 TypeScript scrapy-redis VS chrome-aws-lambda

  Chromium Binary for AWS Lambda and Google Cloud Functions

• Webscraping Open Project

  11 1,307 0.0 Python scrapy-redis VS Webscraping Open Project

  Discontinued The web scraping open project repository aims to share knowledge and experiences about web scraping with Python [Moved to: https://github.com/TheWebScrapingClub/webscraping-from-0-to-hero]

  

• estela

  10 153 8.1 Python scrapy-redis VS estela

  estela, an elastic web scraping cluster 🕸

  

• powerpage-web-crawler

  6 7 0.0 HTML scrapy-redis VS powerpage-web-crawler

  a portable, lightweight web crawler using Powerpage.

• scrapyd

  6 2,838 5.9 Python scrapy-redis VS scrapyd

  A service daemon to run Scrapy spiders

  

• wi-page

  2 1 0.0 Python scrapy-redis VS wi-page

  Rank Wikipedia Article's Contributors by Byte Counts.

• polite

  2 322 5.3 R scrapy-redis VS polite

  Be nice on the web

• wistalk

  5 24 0.0 Python scrapy-redis VS wistalk

  Wistalk : Analyze Wikipedia User's Activity

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives