4 External Tools to Help Stabilize Your Web Crawling

This page summarizes the projects mentioned and recommended in the original post on dev.to
Python Webpage Monitor

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • urlwatch

    Watch (parts of) webpages and get notified when something changes via e-mail, on your phone or via other means. Highly configurable.

    • It is a good idea to keep track of HTML changes, especially certain portions of the webpage we are scraping. We use a tool internally at Proxies API called urlWatch https://github.com/thp/urlwatch

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Ask HN: If a website has no RSS, how do you keep of any updates?

    1 project | news.ycombinator.com | 1 Aug 2023

  • Got tired of grad cafe alerts not working so I automated it lol

    1 project | /r/gradadmissions | 21 Feb 2022

  • Selfhosted Page Monitor Like Distillvisualping On

    1 project | /r/selfhosted | 6 Feb 2021

  • changedetection.io alternatives?

    4 projects | /r/selfhosted | 5 Oct 2022

  • What are some common things you look at while reviewing Pull requests?

    2 projects | /r/Python | 2 Oct 2022