[Question] What did I just do?

• STATS-PAL

  7 23 0.0 Python

  A relatively simple but powerful heuristic that can automate performance test result analysis by using powerful statistics.

Thank you reply! Yes, I think what I have built really looks a lot Kolmogorov–Smirnov test I haven't gone through all the resources yet but going over it briefly really shows me the similarities. To clarify a bit what I am doing in step 2 at this point I have 2 arrays of bins that contain percentiles for samples A and B I then just calculate the difference in percentage between A and B. That number is then fed into the matrix which will output a score. below the matrix (the first column are percentages right column is the amount the score is reduced by if the percentage is higher than that number.): [2, 0.07688676], [4, 0.13395531], [8, 0.20272898], [16, 0.21770635], [32, 0.36872261], For some more details about my calculation, you could best check out my GitHub repo it contains the calculation written in Python. https://github.com/JoeyHendricks/StatisticalTesting/blob/master/regression.py Just to be clear on the lingo these "tests" like the Kolmogorov–Smirnov test can be called statistical tests correct? So in the correct language what I have built by myself is a statistical test right?

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

Suggest a related project