cargo-fuzz VS mutagen

I used libFuzzer via cargo-fuzz - https://github.com/rust-fuzz/cargo-fuzz and input data was not really great

People use cargo-fuzz.

cargo fuzz init

Check out https://rust-fuzz.github.io/book/cargo-fuzz.html

I've fed it cargo-fuzz and it has discovered at around 200 distinct execution paths within 5 minutes, without any crashes or panics. We'll see what happens after I leave it overnight, but the initial results are very encouraging!

There are two testing techniques you didn't mention: Snapshot tests (which are greatly simplified using the insta crate and mutation testing (which can be done on nightly with my mutagen crate.

How does this compare to mutagen?

Do you mean as part of build.rs? Yes, that's certainly doable, and has been done in the past. You can use env!("OUT_DIR") for that. Examples you may want to refer to include my mutagen crate and criterion.

Would be great if this could include mutation testing.

I wrote a good number of macros though, both macro_rules! and various proc_macros. The latest iteration of overflower has both, for example. mutagen is a mutation testing tool built as a proc macro, and it's helper library has a bunch of macros, too. compact_arena uses macros to tie unique lifetime tags to arenas.

Also there are far more mutation testing frameworks. I maintain the rust-based mutagen one. There are also LLVM-based ones (etc. mull) that can cover multiple languages (but may yield mutations not expressible in your preferred one).

Cargo (and Rust) makes it so easy to write test cases that you should really use it to find these kinds of bugs. And there are other good test crates available: mutagen, quickcheck, etc.

I had a student completely reachitecture my mutagen tool, and saw some working on various clippy contributions.