Apache JMeter VS TestNG

Compare Apache JMeter vs TestNG and see what are their differences.

Apache JMeter

Apache JMeter open-source load testing tool for analyzing and measuring the performance of a variety of services (by apache)


TestNG testing framework (by testng-team)
Our great sponsors
  • InfluxDB - Collect and Analyze Billions of Data Points in Real Time
  • Onboard AI - Learn any GitHub repo in 59 seconds
  • SaaSHub - Software Alternatives and Reviews
Apache JMeter TestNG
22 4
7,555 1,904
1.4% 0.3%
9.3 8.0
4 days ago 6 days ago
Java Java
Apache License 2.0 Apache License 2.0
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.

Apache JMeter

Posts with mentions or reviews of Apache JMeter. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-10-27.
  • GC, hands off my data!
    6 projects | dev.to | 27 Oct 2023
    The test scenario consists of querying for descriptions of different offers. During the test, I will collect data on memory and GC parameters using jConsole. I will run the test scenario using jMeter, which additionally will allow me to measure response times.
  • Tell HN: Postman just wiped all my stuff
    15 projects | news.ycombinator.com | 6 Oct 2023
    FYI some of our people internally use Jmeter. https://jmeter.apache.org/

    It's not flashy so it probably wont get the standard "we are going to milk you for data" plan

  • Best Practices in Testing GraphQL APIs
    7 projects | dev.to | 3 Jul 2023
    Performance and load testing are essential parts of GraphQL API testing. It ensures APIs can handle expected traffic volumes and respond within acceptable timeframes. You can use tools like Apache JMeter or Gatling to generate realistic loads and evaluate the API's performance under different scenarios. Techniques like batched queries and caching can help mitigate this issue.
  • The 36 tools that SaaS can use to keep their product and data safe from criminal hackers (manual research)
    18 projects | /r/SaaS | 22 May 2023
  • How to Find Bottlenecks in MongoDB: Profiling and Load Testing Strategies with JMeter
    3 projects | dev.to | 22 May 2023
    Improving just one endpoint and a database query does not guarantee we can handle the load we are expecting. One effective tool for load testing is Apache JMeter, which can simulate multiple users accessing and making requests to the system simultaneously.
  • What tools you use for http load testing?
    6 projects | /r/linuxadmin | 14 Apr 2023
    Apache Jmeter https://jmeter.apache.org/ but I can't drop my infra and I have Java socket closed errors
    6 projects | /r/linuxadmin | 14 Apr 2023
    Good morning what tool do you use to test your infra in terms of http load ? A tool that works, I tested : - https://github.com/tsenart/vegeta but it returns 0 errors or a http_net error from Golang - LOIC (Low Orbit Ion Canon) https://github.com/NewEraCracker/LOIC but the requests do not appear in my nginx logs and I feel no slowdown - Apache Jmeter https://jmeter.apache.org/ but I can't drop my infra and I have Java socket closed errors - K6 https://k6.io/ but I can't bring down my infra with - wrk https://github.com/wg/wrk no matter what parameter I put it doesn't make enough requests per second, I put the same parameters as on a tutorial and I don't get the same result...
  • Latest Windows 11 update is causing slow SSDs & WiFi connections, BSoD, and more
    3 projects | /r/technology | 18 Mar 2023
    I think the apache program sites all give similar vibes, and they are used alllllllllllll the fuck over, even if ppl don't realize it. Apache libraries and tools are great. Jmeter is still the choice for a lot of load testing efforts, and it's site looks like this: https://jmeter.apache.org/
  • Load Testing with Ruby-JMeter
    2 projects | dev.to | 21 Dec 2022
    JMeter is a well-known tool for load or stress testing, it basically sends requests to your application within the given time, according to the behaviour plan you provided. The plans are designed to be detailedly configurable and focused on load-testing jargon. That makes the JMeter a comprehensive solution, however makes it a bit hard to understand & focus on the well written tests.
  • Deep Dive: Migrating from a Data Center to AWS
    3 projects | dev.to | 3 Nov 2022
    We set up staging environments in AWS to test our new infrastructure. Starting with some relatively modest capacity choices (1-2 t3.small instances per web app), we performed load tests on the most popular pages on each site. We built some simple load testing scripts that wrapped Apache JMeter commands:


Posts with mentions or reviews of TestNG. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-08-12.
  • Why does Rusts testing tools seem so much less polished compared to its other tooling?
    3 projects | /r/rust | 12 Aug 2022
    Testing tools on the JVM stopped using reflection about twenty years ago, they all use annotations these days (e.g. https://testng.org, https://junit.org). Rust has annotations too, obviously.
  • Reassessing TestNG vs. Junit
    6 projects | /r/java | 20 Sep 2021
    Recently though we've run across a few issues with the asserts in TestNG. In 7.3.0, some changes broke assertSame/assertNotSame that also broke some of our tests. This was partially fixed in 7.4.0, but some overloads of assertEquals were still broken. This is fixed, but I don't think the fix has been delivered in a release yet. Further investigation revealed that at least one overload of assertNotEquals has been broken, apparently since 6.9.5 or even earlier.
  • 9 Of The Best Java Testing Frameworks For 2021
    3 projects | dev.to | 14 May 2021
    TestNG is a Java-based open-source testing framework. The framework is inspired by JUnit and NUnit. You can also create an HTML report during testing implementation.

What are some alternatives?

When comparing Apache JMeter and TestNG you can also consider the following projects:

Karate - Test Automation Made Simple

AssertJ - AssertJ is a library providing easy to use rich typed assertions

Cucumber - Cucumber for the JVM

WireMock - A tool for mocking HTTP services

REST Assured - Java DSL for easy testing of REST services

JUnit - A programmer-oriented testing framework for Java.

Hamcrest - Java (and original) version of Hamcrest

Spock - The Enterprise-ready testing and specification framework.

MockServer - MockServer enables easy mocking of any system you integrate with via HTTP or HTTPS with clients written in Java, JavaScript and Ruby. MockServer also includes a proxy that introspects all proxied traffic including encrypted SSL traffic and supports Port Forwarding, Web Proxying (i.e. HTTP proxy), HTTPS Tunneling Proxying (using HTTP CONNECT) and SOCKS Proxying (i.e. dynamic port forwarding).

Testcontainers - Testcontainers is a Java library that supports JUnit tests, providing lightweight, throwaway instances of common databases, Selenium web browsers, or anything else that can run in a Docker container.