jfrunit VS jmh

I haven't had chance to use it properly yet, but I think JfrUnit[0][1] is a good option here to test non-functional behaviour like memory usage and garbage collection.

[0]: https://github.com/moditect/jfrunit

JfrUnit: Allows to assert JFR events in JUnit tests (details)

I do not know of any library that would particularly help here, except maybe this thingie might help with writing tests to assert your expected behaviour holds: https://github.com/gunnarmorling/jfrunit (A potentially relevant example here: https://twitter.com/gunnarmorling/status/1335326054496555008). However, there's no public release as of yet.

JMH for benchmarks

I would recommend using JMH instead.

Reflection is probably very roughly between 10 and 1000 times slower. Why don't you measure it yourself using JMH?

Aleksey Shipilev is another such leader, whom is especially knowledgeable about the internals of the JVM. His writings are invaluable. He is (was) the lead of the Java microbenchmark framework (JMH} which is how one would write small performance experiments in Java, and learn what really makes a difference or now.

In the last episode we implemented a parallelMap operation using streams, raw threads, a threadpool with futures, and coroutines. At first glance the raw threads was quickest, followed by futures, coroutines and then streams. In this, part 56 of an exploration of where a Test Driven Development implementation of the Gilded Rose stock control system might take us in Kotlin, we investigate the performance of the different functions further, in particular digging down into why coroutines seem to be slow and finding a way to speed them up. We also find a way to use a particular ForkJoinPool to run the streams code, making it as fast as the others (bar the raw threads). Frankly we only use very rough benchmarks here, with no statistical testing except 'it looks like'. That's OK for gross differences, but is highly suspect when deciding which of two similarly performant approaches is faster. For that check out JMH and you could watch my video from KotlinConf 2017

A few months ago, we started to use JMH in our project to test and find performance issues. The tool provides multiple modes and profilers, and we found this useful for our purposes.