sharpfuzz
Stryker.NET
sharpfuzz | Stryker.NET | |
---|---|---|
1 | 14 | |
351 | 1,715 | |
- | 0.9% | |
6.5 | 9.3 | |
2 months ago | about 10 hours ago | |
C# | C# | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sharpfuzz
-
When do you consider your unit tests be "enough"?
Because of the above I've generally been using tools like Stryker.NET and FsCheck to augment my testing suite. I'm still doing unit testing to find the more obvious "I haven't had my coffee, let's make sure I'm doing what I think I'm doing" bugs. I'm just using things like mutation testing, property testing, fuzzing, etc. to find the deeper issues in my code. There's a ton of libraries out there, including one that I've built for myself to help with testing but FsCheck and Stryker are just beautiful. And if you're interested in fuzzing, SharpFuzz is a great option. But that one isn't quite as easy of an on ramp compared to the other two that I mentioned.
Stryker.NET
-
Stryker.NET alternatives - Testura.Mutation, visualmutator, fettle, and Faultify
5 projects | 9 Jun 2023
-
Do you guys mock everything in your Unit Tests?
Bogus - For creating fake data Verify - Snapshot testing for .NET MELT - For testing ILogger usage Stryker - Mutation Testing for .NET TestContainers - run docker programmatically in integration tests
-
Scope of unit testing (karma/Jas) Boss wants unreasonable testing?
This is called mutation testing btw.
-
Don't target 100% coverage
Let's try it on our small example using Stryker.
- PhD'ers, what are you working on? What CS topics excite you?
-
Killing mutants to improve your tests
There are tools that do this automatically, stryker[2] is one of them. When you run stryker, it will create many mutant versions of your production code, and run your tests for each mutant (that's how mutations are called in stryker's' documentation) version of the code. If your tests fail then the mutant is killed. If your tests passed, the mutant survived. Let's have a look at the the result of runnning stryker against reffects-store's code:
-
Not sure if popular opinion: Greenfield projects should have 100% test coverage.
Mutation testing is pretty solid. Better than code coverage for sure. Using Stryker personally.
-
Seriously what are they and why does everyone hate them?
A mutation testing tool (like Stryker) runs your unit tests to verify they all pass then makes a small change (mutation) to your code and reruns the tests. At least one test should fail because the modified code should behave differently.
-
Relesed v1.0.0 of my pet javasscript project yesterday after hitting 100% coverage- a gesture detection library
I haven't tried it yet, but last time I researched it, this is the library that looked most promising: https://stryker-mutator.io/
-
Mutation Testing in NodeJS
Website: https://stryker-mutator.io/
What are some alternatives?
FsCheck - Random Testing for .NET
xUnit - xUnit.net is a free, open source, community-focused unit testing tool for .NET.
AFLplusplus - The fuzzer afl++ is afl with community patches, qemu 5.1 upgrade, collision-free coverage, enhanced laf-intel & redqueen, AFLfast++ power schedules, MOpt mutators, unicorn_mode, and a lot more!
Moq - Repo for managing Moq 4.x [Moved to: https://github.com/moq/moq]
LibAFL - Advanced Fuzzing Library - Slot your Fuzzer together in Rust! Scales across cores and machines. For Windows, Android, MacOS, Linux, no_std, ...
MSTest - MSTest framework and adapter
libfuzzer - Rust bindings and utilities for LLVM’s libFuzzer
Bogus - :card_index: A simple fake data generator for C#, F#, and VB.NET. Based on and ported from the famed faker.js.
wtf - wtf is a distributed, code-coverage guided, customizable, cross-platform snapshot-based fuzzer designed for attacking user and / or kernel-mode targets running on Microsoft Windows and Linux user-mode (experimental!).
should - Should Assertion Library
Fuzzing101 - An step by step fuzzing tutorial. A GitHub Security Lab initiative
GenFu - GenFu is a library you can use to generate realistic test data. It is composed of several property fillers that can populate commonly named properties through reflection using an internal database of values or randomly created data. You can override any of the fillers, give GenFu hints on how to fill them.