Rust web-crawler Projects
A small library for building fast and highly customizable web crawlersProject mention: Meet Crusty, Fast Scalable && Polite Broad Web Crawler Built With Rust! | reddit.com/r/rust | 2021-06-04
While I was working on Crusty I realized that the web crawling core is universal and spent some time separating crawling logic into a library https://github.com/let4be/crusty-core
Rust web-crawler related posts
Meet Crusty, Fast Scalable && Polite Broad Web Crawler Built With Rust!
3 projects | reddit.com/r/rust | 4 Jun 2021
Are you hiring? Post a new remote job listing for free.