The Complete Guide To ScrapydWeb, Get Setup In 3 Minutes!

This page summarizes the projects mentioned and recommended in the original post on dev.to
hardware-buttons linkedin-bot template-engine-js

Judoscale - Save 47% on cloud hosting with autoscaling that just works
Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.
judoscale.com
featured
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai
featured

  1. scrapydweb

    Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. Docs 文档 :point_right:

    ScrapydWeb is the most popular open source Scrapyd admin dashboards. Boasting 2,400 Github stars, ScrapydWeb has been fully embraced by the Scrapy community.

  2. Judoscale

    Save 47% on cloud hosting with autoscaling that just works. Judoscale integrates with Django, FastAPI, Celery, and RQ to make autoscaling easy and reliable. Save big, and say goodbye to request timeouts and backed-up task queues.

    Judoscale logo

  3. scrapyd

    A service daemon to run Scrapy spiders

    ScrapydWeb is the most popular open source Scrapyd admin dashboards. Boasting 2,400 Github stars, ScrapydWeb has been fully embraced by the Scrapy community.

  4. SpiderKeeper

    admin ui for scrapy/open source scrapinghub

    There are many different Scrapyd dashboard and admin tools available, from ScrapeOps (Live Demo) to SpiderKeeper, and Gerapy.

  5. Gerapy

    Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

    There are many different Scrapyd dashboard and admin tools available, from ScrapeOps (Live Demo) to SpiderKeeper, and Gerapy.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Best scrapydweb fork

    1 project | /r/scrapy | 16 Nov 2022

  • The Complete Scrapyd Guide - Deploy, Schedule & Run Your Scrapy Spiders

    2 projects | dev.to | 13 Jan 2022

  • Daily Share Price Notifications using Python, SQL and Africas Talking - Part Two

    3 projects | dev.to | 30 May 2021

  • Scrapyd + Django in Docker: HTTPConnectionPool (host = '0.0.0.0', port = 6800) error.

    1 project | /r/scrapy | 15 Feb 2021

  • Distribution of gross and net salaries on r/BESalary [OC]

    1 project | /r/BESalary | 1 Jul 2023
Loading...