iai
criterion.rs
Our great sponsors
iai | criterion.rs | |
---|---|---|
9 | 30 | |
559 | 4,153 | |
- | - | |
0.0 | 6.5 | |
11 months ago | 12 days ago | |
Rust | Rust | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
iai
-
How to benchmark in Rust with libtest bench
The three popular options for benchmarking in Rust are: libtest bench, Criterion, and Iai.
-
Adding runtime benchmarks to the Rust compiler benchmark suite
Iai^1 uses CacheGrind^2 to count instructions
[1] - https://github.com/bheisler/iai
-
How to catch performance regressions in Rust
But, /u/bencherdev, please consider integrating iai measurements! By the same person behind criterion but designed for one-shot measurements that are stable in CI measurements.
-
Hey Rustaceans! Got a question? Ask here! (34/2022)!
Is lai no longer maintained? It hasn't had any commits in a year and a half.
-
[Question / Discussion] Why is .unwrap() so heavily discouraged?
Lately I've found that using unwrap_unchecked has nearly zero performance gain but all the UB to gain if you change the code one day. My source is iai which provides exact instruction counts and is entirely deterministic for any given execution (and almost-deterministic across different compilations of the same program).
-
[MEDIA] Which will perform faster, a trivial comparison in performance of two functions.
Have you tried criterion.rs or iai ? The first is great at micro benchmarks and, if it is not enough, the second can catch even smaller performance difference.
-
Blog post: (I want) A Better Rust Profiler
In the mean time maybe https://github.com/bheisler/iai could be of help
- Experimental one-shot benchmark framework using Cachegrind
-
What's everyone working on this week (1/2021)?
Well, the most interesting one is probably Iai; an experimental benchmark framework that runs all of the benchmarks in Cachegrind for much higher precision and repeatability than is possible with Criterion.rs. It's still a work-in-progress, so I haven't published it on Crates.io yet. See the readme for a more detailed discussion of the pros/cons relative to Criterion.rs.
criterion.rs
-
How to benchmark in Rust with libtest bench
The three popular options for benchmarking in Rust are: libtest bench, Criterion, and Iai.
-
Divan: Fast and Simple Benchmarking for Rust
Holy crap. I was just writing a blog to complain about the state of Rust benchmarking and I think this might address most of my points. The biggest one is the ability to have benchmarks collocated within the library like tests which is the biggest annoyance.
It’s also nice to see that it can report multiple counters in parallel. I put up a similar feature[1] for criterion recently but I fear the project isn’t being maintained anymore…
Haven’t looked deeply into divan yet but the other requirements I have for criterion’s power is to run tests with statistical guarantees on the results, terminate quickly when statistical significance is reached (—quick), provide a comparison of the delta from a previous benchmark, and to run async code. Wonder how this stacks up.
[1] https://github.com/bheisler/criterion.rs/pull/722
-
how expensive is an operation?
criterion for benchmarks,
- Autometrics 0.4: Spot commits that introduce errors or slow down your application
- Performance-related question
-
How can I further optimize this file parser? (std, serde, diesel)
For an extra optimization, you might look into techniques like branchless code, turning array of structs into struct of arrays for better cache utilization/lowering branch mispredictions. There is many talks on YouTube how to actually measure and improve performance of native code. And for rust there is a criterion.rs for benchmarking.
- making a virtual machine in rust
-
How much does Rust's bounds checking cost?
https://github.com/bheisler/criterion.rs is good for tests like that. It will give you much more than a single number and handle things like outliers. This makes identifying noisy tests simpler.
-
Tips in using criterion to properly benchmark a database?
I have tried many ways but I think is not possible. I put it on https://github.com/bheisler/criterion.rs/issues/631.
-
Rust 1.64 Became 10-20% Faster On Windows
Criterion is still the gold standard.
Pros for Criterion over the stdlib: https://github.com/bheisler/criterion.rs#features
Downsides of Criterion: https://bheisler.github.io/criterion.rs/book/user_guide/know...
What are some alternatives?
rust-socketio - An implementation of a socket.io client written in the Rust programming language.
hyperfine - A command-line benchmarking tool
TinyTemplate - A small, lightweight template engine
sqlglot - Python SQL Parser and Transpiler
tree-buf - An experimental serialization system written in Rust
glassbench - A micro-benchmark framework to use with cargo bench
scribble - An experimental terminal text-editor written in Rust. ⚠️
sccache - Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.
bfc-rs - Brainfuck compiler for x86-64 Linux implemented in Rust.
tracing - Application level tracing for Rust.
firestorm - A fast intrusive flamegraph
tungstenite-rs - Lightweight stream-based WebSocket implementation for Rust.