Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 8 Rust Crawler Projects
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
hltv-rust
A client to fetch and parse data from HLTV.org (origin at https://foss.alic.dev/dist1ll/hltv-rust)
-
mc-crawler
A MobileCoin network crawler. Corresponding preprint available on arXiv (https://arxiv.org/pdf/2111.12364.pdf).
-
doonop
Doonop is a crawler and scrapper on behalf. Focused on collecting arbitrary information from an entire site or its part.
-
rust-chromium-azure-functions-crawler-poc
PoC of a crawler/scraper built with Rust and Chromium to pre-render and scrape websites. Can be hosted on Azure Functions or standalone!
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
Rust Crawler related posts
- HLTV Rust API
- Owl - Rust Port Analyzer and Network Mapper
- Plato-solutions/doonop: - A crawler and scrapper on behalf. Focused on collecting arbitrary information from an entire site or its part.
- chan-downloader - CLI to download all images/webms of a 4chan thread
- Any decent web crawler?
-
A note from our sponsor - InfluxDB
www.influxdata.com | 26 Apr 2024
Index
What are some of the best open-source Crawler projects in Rust? This list will help you:
Project | Stars | |
---|---|---|
1 | spider | 630 |
2 | chan-downloader | 41 |
3 | crab | 11 |
4 | hltv-rust | 4 |
5 | mc-crawler | 4 |
6 | doonop | 3 |
7 | rust-chromium-azure-functions-crawler-poc | 2 |
8 | waxy | 2 |
Sponsored