Apache JMeter VS TestNG

Compare Apache JMeter vs TestNG and see what are their differences.

Apache JMeter

Apache JMeter (by apache)

TestNG

TestNG testing framework (by cbeust)
Our great sponsors
  • Scout APM - Truly a developer’s best friend
  • talent.io - Download talent.io’s Tech Salary Report
  • SonarQube - Static code analysis for 29 languages.
Apache JMeter TestNG
3 4
6,460 1,774
2.2% -
9.3 8.2
9 days ago 14 days ago
Java Java
Apache License 2.0 Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

Apache JMeter

Posts with mentions or reviews of Apache JMeter. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-05-16.
  • Discover issues with performance testing
    5 projects | dev.to | 16 May 2022
    There are many tools out there like Gatling, Locust, and K6, but here I'll explain just a bit of JMeter. It is totally visual and pretty easy to follow and understand 🤗; it also includes a module that generates dashboards that gives us an APDEX result, which is what we want. By default, I have it on my system; you can use the same idea or simply download it from the official website and run it afterward.

TestNG

Posts with mentions or reviews of TestNG. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-08-12.
  • Why does Rusts testing tools seem so much less polished compared to its other tooling?
    3 projects | reddit.com/r/rust | 12 Aug 2022
    Testing tools on the JVM stopped using reflection about twenty years ago, they all use annotations these days (e.g. https://testng.org, https://junit.org). Rust has annotations too, obviously.
  • Reassessing TestNG vs. Junit
    6 projects | reddit.com/r/java | 20 Sep 2021
    Recently though we've run across a few issues with the asserts in TestNG. In 7.3.0, some changes broke assertSame/assertNotSame that also broke some of our tests. This was partially fixed in 7.4.0, but some overloads of assertEquals were still broken. This is fixed, but I don't think the fix has been delivered in a release yet. Further investigation revealed that at least one overload of assertNotEquals has been broken, apparently since 6.9.5 or even earlier.
  • 9 Of The Best Java Testing Frameworks For 2021
    3 projects | dev.to | 14 May 2021
    TestNG is a Java-based open-source testing framework. The framework is inspired by JUnit and NUnit. You can also create an HTML report during testing implementation.

What are some alternatives?

When comparing Apache JMeter and TestNG you can also consider the following projects:

AssertJ - AssertJ is a library providing easy to use rich typed assertions

Karate - Test Automation Made Simple

Cucumber - Cucumber for the JVM

REST Assured - Java DSL for easy testing of REST services

WireMock - A tool for mocking HTTP services

Hamcrest - Java (and original) version of Hamcrest

Spock - The Enterprise-ready testing and specification framework.

MockServer - MockServer enables easy mocking of any system you integrate with via HTTP or HTTPS with clients written in Java, JavaScript and Ruby. MockServer also includes a proxy that introspects all proxied traffic including encrypted SSL traffic and supports Port Forwarding, Web Proxying (i.e. HTTP proxy), HTTPS Tunneling Proxying (using HTTP CONNECT) and SOCKS Proxying (i.e. dynamic port forwarding).

JUnit - A programmer-oriented testing framework for Java.

TestContainers - Testcontainers is a Java library that supports JUnit tests, providing lightweight, throwaway instances of common databases, Selenium web browsers, or anything else that can run in a Docker container.