Rust Crawler

Open-source Rust projects categorized as Crawler Edit details

Top 6 Rust Crawler Projects

  • spider

    Multithreaded Web spider crawler written in Rust. (by madeindjs)

  • starfish-ql

    ✴️ A graph database and query engine

    Project mention: What's new in SeaORM 0.8.0 | dev.to | 2022-05-15

    SeaORM is the foundation of StarfishQL, an experimental graph database and query engine.

  • SonarQube

    Static code analysis for 29 languages.. Your projects are multi-language. So is SonarQube analysis. Find Bugs, Vulnerabilities, Security Hotspots, and Code Smells so you can release quality code every time. Get started analyzing your projects today for free.

  • chan-downloader

    CLI to download all images/webms in a 4chan thread

  • mc-crawler

    A MobileCoin network crawler. Corresponding preprint available on arXiv (https://arxiv.org/pdf/2111.12364.pdf).

    Project mention: Crawling the MobileCoin Quorum System | reddit.com/r/mobilecoin | 2021-11-25

    Crawler: https://github.com/wiberlin/mc-crawler

  • doonop

    Doonop is a crawler and scrapper on behalf. Focused on collecting arbitrary information from an entire site or its part.

    Project mention: Plato-solutions/doonop: - A crawler and scrapper on behalf. Focused on collecting arbitrary information from an entire site or its part. | reddit.com/r/rust | 2021-07-21
  • hltv-rust

    A client to fetch and parse data from HLTV.org

    Project mention: HLTV Rust API | reddit.com/r/rust | 2022-03-06
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-05-15.

Rust Crawler related posts

Index

What are some of the best open-source Crawler projects in Rust? This list will help you:

Project Stars
1 spider 101
2 starfish-ql 49
3 chan-downloader 17
4 mc-crawler 3
5 doonop 2
6 hltv-rust 2
Find remote jobs at our new job board 99remotejobs.com. There are 4 new remote jobs listed recently.
Are you hiring? Post a new remote job listing for free.
Developer Ecosystem Survey 2022
Take part in the Developer Ecosystem Survey 2022 by JetBrains and get a chance to win a Macbook, a Nvidia graphics card, or other prizes. We’ll create an infographic full of stats, and you’ll get personalized results so you can compare yourself with other developers.
surveys.jetbrains.com