Top 15 Rust Scraper Projects

Scraper

• Add a project

1. webclaw

   1 7 1,706 9.4 Rust

   Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

   

   Project mention: Puppeteer networkidle is not a scraping strategy | dev.to | 2026-05-23

   GitHub repo

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. wreq

   2 0 917 9.5 Rust

   An ergonomic, censorship-resistant Rust HTTP Client (by 0x676e67)

   

4. scraping-with-rust

   3 2 260 0.0 Rust

   👾 scraping hacker news with rust

   

5. nipper

   4 1 125 0.0 Rust

   A Rust crate for manipulating HTML with CSS selectors

   

6. website-stalker

   5 1 71 7.0 Rust

   Track changes on websites via git

   

7. job-shell

   6 1 59 9.5 Rust

   JobShell is a command-line tool that takes the hassle out of job searching for software engineers by scraping job postings from companies you care about. Whether you prefer the interactive CLI experience or automated Discord updates, JobShell keeps you ahead of the curve.

   

8. chan-downloader

   7 1 54 0.0 Rust

   CLI to download all images/webms in a 4chan thread

   

9. Zeiver

   8 1 18 2.8 Rust

   A Scraper, Downloader, & Recorder for static open directories.

   

10. crusty-core

    9 1 16 0.0 Rust

    A small library for building fast and highly customizable web crawlers

    

11. xpath-scraper

    10 3 13 1.5 Rust

    Makes it simple to scrape websites with xpath structs.

    

12. crab

    11 1 12 1.8 Rust

    Python-based Scraping and parsing toolkit (by bazhenov)

    

13. rust-chromium-azure-functions-crawler-poc

    12 1 3 10.0 Rust

    PoC of a crawler/scraper built with Rust and Chromium to pre-render and scrape websites. Can be hosted on Azure Functions or standalone!

    

14. doonop

    13 1 3 0.0 Rust

    Doonop is a crawler and scrapper on behalf. Focused on collecting arbitrary information from an entire site or its part.

    

15. job-hunt-rust

    14 2 2 5.1 Rust

    A locally run and customisable recent job aggregator with in-memory datastore, query language (JHQL), and REPL.

    

16. web-loader-engine

    15 1 0 - Rust

    High-performance web content extraction engine built in Rust. Primary purpose is serving as an external web loader for OpenWebUI

    

    Project mention: A Self-Hosted Web Content Extraction API | dev.to | 2026-05-20

    The Web Loader Engine is a web content extraction service built in Rust that handles this. It loads each page in a headless Chromium browser and runs it through Mozilla Readability, so you get the actual content without the clutter around it. It can return Markdown, HTML, plain text, or a screenshot, all through a HTTP API call. Useful for RAG pipelines, scraping, archiving pages, and screenshots.

Rust Scraper related posts

• Xee: A Modern XPath and XSLT Engine in Rust

  9 projects | news.ycombinator.com | 28 Mar 2025

• Plato-solutions/doonop: - A crawler and scrapper on behalf. Focused on collecting arbitrary information from an entire site or its part.

  1 project | /r/rust | 21 Jul 2021

• chan-downloader - CLI to download all images/webms of a 4chan thread

  1 project | /r/coolgithubprojects | 7 Mar 2021

• Any decent web crawler?

  4 projects | /r/rust | 2 Mar 2021

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Rust projects with our weekly report!