flume
Rust-Bio
flume | Rust-Bio | |
---|---|---|
14 | 9 | |
2,168 | 1,511 | |
- | 2.1% | |
4.4 | 6.4 | |
about 2 months ago | 26 days ago | |
Rust | Rust | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
flume
-
Hyperbridge: Fast multi-producer, multi-consumer unbounded channel in Rust
The repository seems abandoned; or maybe complete?
At work we use flume, which is another capable multi-producer, multi-consumer async-capable channel [1]. It's great for shuffling data between threads, as well as between async tasks, and between threads and async tasks. Basically any time you want to pieces of code to exchange data or signals without pesky shared state.
1: https://github.com/zesterer/flume
- pub/sub Event bus in rust
-
Is there any part of the Standard Library that really impresses you?
I also like flume, it has impressive performance (although not the best). More importantly, it's written only with safe rust. https://github.com/zesterer/flume
-
appreciating fearless concurrency
The most commonly suggested replacement for mspc is crossbeam-channel; flume is also relatively popular.
-
Rust has a small standard library (and that's ok)
It's not officially deprecated, but the alternatives on crates.io are considered better. flume and crossbeam-channel feature less unsafe code and offer better performance. Benchmarks.
-
Why are so many important features not in standard library yet?
it's slow (checkout flume's benchmarks for example)
-
Request-response communication between threads?
I would have done the same. I think, and I might be wrong, but the only other alternative, besides anything unsafe, would be to pass mutex back, but I am not sure this would be faster. Btw, I have not done testing, but you might want to look at Flume for your mpsc channels: https://github.com/zesterer/flume Flume, seems to be very fast mpsc implementation. I am planning to evaluate it for logging system.
-
A mini-Erlang/Elixir -- tell me if/why my idea sucks
For concurrency/parallelism, you launch at most 2 * CPU Cores, PIN them and use a fast broker to spread the task (like a ring buffer or an MPSC). But you keep linear scan, tight loops, SIMD friendly data, on each. You are not switching context that much, and instead, bet you will process the batch fast. (CPUs are fast today!)
- Whats your favourite open source Rust project that needs more recognition?
-
Suggestions on a fast spmc architecture.
https://crates.io/crates/flume and https://crates.io/crates/crossbeam-channel provide MPMC channels.
Rust-Bio
- Bioinformatics Data Structures in Rust
- Bioinformatics with Rust
-
bioinformatic libraries and zig?
Does anyone know of zig native libraries for bioinformatics (here is a Rust example https://rust-bio.github.io/ )? It seems as though one could pull in a lot of bioinformatics C libraries such as done with https://github.com/brentp/hts-zig.
-
Proteomics search engine written in Rust
e.g. Rust-Bio
-
What are your top 3-5 programming languages and why?
I would start with the book and then rust-bio library. Rust is a pretty low level language compared to R/Python. It’s an especially good fit for writing efficient tools that make use of the kinds of algorithms / data structures that are implemented in rust-bio.
-
I have to admit. The free code camp course is a bit more sparing than I would have preferred. How did everyone learn Rust?
Absolutely! It already is, e.g., https://github.com/rust-bio/rust-bio. I'm moving from the academia/nonprofit world into industry bioinformatics, and I intend to use Rust as much as possible. I've already replaced as much of my Python as possible with Rust. I feel I'm able to create larger, more complex programs with Rust because I have the compiler to keep me from making common mistakes that are so easy to make in dynamically typed languages like Perl and Python. It might take longer to write a program initially, but I've started to create a library of functions I can paste together to do things like parse a positive integer, find a bunch of files with a certain file extension, search through data for a pattern, parse CSV files, etc. Writing my latest book has provided even more common patterns I keep finding I use over and over.
-
Is learning Rust and systems programming through the books Rust in Action and Crafting Interpreters a good idea?
I think there is huge potential for Rust in bioinformatics, and there are already some great projects like https://rust-bio.github.io/. It seems industry is also hiring for these skills. This Nature article is a little old, but also covers why people in the field are looking for greater safety and performance. It's relatively easy to write a Python program to do bio stuff, but it's also very easy to get lots of things wrong or for the resulting program to be slow and/or impossible to extend and maintain. In the long run, I think it makes sense to write in Rust. Perl was king in biofx when I started, and I would not have predicted it being displaced by Python, so there's good reason to believe that Python may one day be eclipsed by Rust.
-
Whats your favourite open source Rust project that needs more recognition?
Well, someone mentioned https://rust-bio.github.io/
-
How can one make Rust excel in the Sciences
So generally stuff in this maths/numerical space. The term is a bit deceptive because it rarely means domain-specific science libraries like rust-bio even thought that might be what you think when you hear "scientific computing".
What are some alternatives?
uniffi-rs - a multi-language bindings generator for rust
dash - Data Apps & Dashboards for Python. No JavaScript Required.
rust - Empowering everyone to build reliable and efficient software.
kanidm - Kanidm: A simple, secure and fast identity management platform
Cargo - The Rust package manager
clickhouse-rs - Asynchronous ClickHouse client library for Rust programming language.
async-wormhole
GeoRust - Geospatial primitives and algorithms for Rust
bevy - A refreshingly simple data-driven game engine built in Rust
Rhai - Rhai - An embedded scripting language for Rust.
trust-dns - A Rust based DNS client, server, and resolver [Moved to: https://github.com/hickory-dns/hickory-dns]
cycle - Modern and safe symbolic mathematics