netrunner, a CLI utility to crawl and create web archives

This page summarizes the projects mentioned and recommended in the original post on reddit.com/r/rust

Our great sponsors
  • InfluxDB - Build time-series-based applications quickly and at scale.
  • Scout APM - Truly a developer’s best friend
  • Zigi - Workflow assistant built for devs & their teams
  • SonarQube - Static code analysis for 29 languages.
  • netrunner

    Lens crawler & cacher (by spyglass-search)

    Open-source here: https://github.com/spyglass-search/netrunner

  • spyglass

    A personal search engine, crawl & index websites/files you want with a simple set of rules

    I initially created this cli to make it easier to build filters/rules for my search engine project (spyglass) but figured this would be useful in general for folks who want to crawl & archive websites.

  • InfluxDB

    Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Data Platform where developers build real-time applications for analytics, IoT and cloud-native services in less time with less code.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts