|6 months ago||2 months ago|
|GNU General Public License v3.0 only||MIT License|
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Meet Crusty, Fast Scalable && Polite Broad Web Crawler Built With Rust!
3 projects | reddit.com/r/rust | 4 Jun 2021
While I was working on Crusty I realized that the web crawling core is universal and spent some time separating crawling logic into a library https://github.com/let4be/crusty-core
generic purpose library in rust
1 project | reddit.com/r/rust | 21 Mar 2021
You can also mix them a bit. The library tungstenite is implemented like this, and allows async-tungstenite to reuse the same logic but in a non-blocking manner. You have the API of the second option, but if a write call returns WouldBlock, you return to the caller and allow them to continue when the buffer is flushed. This can get complicated saving state though (e.g. whether it's currently doing authentication, uploading a file, etc.), but see my note below about Rust's async/await.
What are some alternatives?
tokio-tungstenite - Tokio binding for Tungstenite, the Lightweight stream-based WebSocket implementation
async-std - Async version of the Rust standard library
another-rust-load-balancer - A load balancer with support for different middlewares and load balancing strategies, based on hyper and tokio
delay-timer - Time-manager of delayed tasks. Like crontab, but synchronous asynchronous tasks are possible scheduling, and dynamic add/cancel/remove is supported.
rustpad - Efficient and minimal collaborative code editor, self-hosted, no database required
rust-websocket-lite - A fast, low-overhead WebSocket client
crusty - Broad Web Crawler
gtk-rs-core - Provides Rust bindings for Gnome libraries
spider - Multithreaded Web spider crawler written in Rust.
tungstenite-rs - Lightweight stream-based WebSocket implementation for Rust.