Systems Correctness Practices at Amazon Web Services

1. loom

   1 21 2,726 3.3 Rust

   Concurrency permutation testing tool for Rust.

   

   Loom for Rust does this. We also adapted it for some C++ with good success (found actual bugs that slipped tests and reviewes).

   https://github.com/tokio-rs/loom

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. keploy

   2 180 17,613 9.6 Go

   Open-source platform for creating safe, isolated production sandboxes for API, integration, and E2E testing.

   

   Keploy is doing the same thing, in same space - https://github.com/keploy/keploy

4. coyote

   3 19 1,587 5.3 C#

   Coyote is a library and tool for testing concurrent C# code and deterministically reproducing bugs.

   

   Microsoft has a flavor of this for .NET called Coyote[0]

   [0] https://microsoft.github.io/coyote/#overview/how/

5. hermit

   4 10 1,382 8.7 Rust

   Hermit launches linux x86_64 programs in a special, hermetically isolated sandbox to control their execution. Hermit translates normal, nondeterministic behavior, into deterministic, repeatable behavior. This can be used for various applications, including replay-debugging, reproducible artifacts, chaos mode concurrency testing and bug analysis.

   

   This is what hermit does, although it's no longer actively developed.

   https://github.com/facebookexperimental/hermit

6. rr

   5 125 10,535 8.5 C++

   Record and Replay Framework

   

   https://rr-project.org/ for languages that can be debugged by gdb.

7. mgmt

   6 51 4,255 9.6 Go

   Next generation distributed, event-driven, parallel config management!

   

   It's very interesting (I applaud this) that one of the main goals seems to be to make it more approachable as compared to TLA+, but then they go in write it in C# which I consider to be an incredibly unapproachable community and language.

   I'm not trying to draw the ire of the Microsoft fan boys, and there are certainly smart people working on that, but it's just not going to happen for most people.

   Had this been in golang, or maybe java, I'm sure many more hands would be digging in! Having said that, I hope this helps bring correctness and validation more into the mainstream. I've been casually following the project for a while now.

   My long-term goal is to integrate model validation into https://github.com/purpleidea/mgmt/ so if this is an area of interest to you, please let me know!

8. P

   7 18 3,628 7.0 C#

   The P programming language.

   

9. turmoil

   8 2 1,206 8.2 Rust

   Add hardship to your tests

   

   For Rust, there is Turmoil, though that is mostly focused on networking instead of the full scope you mentioned. That was originally written by engineers at AWS to test their services.

   https://github.com/tokio-rs/turmoil

Suggest a related project