Benchmark

Top 23 Benchmark Open-Source Projects

  • hyperfine

    A command-line benchmarking tool

    Project mention: Faster tetranucleotide (k-mer) frequencies! | dev.to | 2024-03-15

    Search "benchmarking tools for linux" and decide that hyperfine is good for what I'm doing. Run Jennifer's new python script against my refactored perl and find that the python is 1.26 times faster for k=3 and 1.47 times faster for k=4. For the Covid-19 sequence, these are both on the order of hundreds of milliseconds.

  • fashion-mnist

    A MNIST-like fashion product database. Benchmark :point_down:

    Project mention: Logistic Regression for Image Classification Using OpenCV | news.ycombinator.com | 2023-12-31

    In this case there's no advantage to using logistic regression on an image other than the novelty. Logistic regression is excellent for feature explainability, but you can't explain anything from an image.

    Traditional classification algorithms but not deep learning such as SVMs and Random Forest perform a lot better on MNIST, up to 97% accuracy compared to the 88% from logistic regression in this post. Check the Original MNIST benchmarks here: http://fashion-mnist.s3-website.eu-central-1.amazonaws.com/#

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • awesome-semantic-segmentation

    :metal: awesome-semantic-segmentation

  • BenchmarkDotNet

    Powerful .NET library for benchmarking

    Project mention: Stop Guessing, Start Measuring: Transform Your Code with BenchmarkDotnet! | dev.to | 2024-02-13

    Let’s look at the first example you see, when you open up BenchmarkDotnet’s website, or Github page.

  • benchmark

    A microbenchmark support library

    Project mention: How can I check the execution time of a program rendered in SFML? | /r/cpp_questions | 2023-12-05
  • FrameworkBenchmarks

    Source for the TechEmpower Framework Benchmarks project

    Project mention: Why choose async/await over threads? | news.ycombinator.com | 2024-03-25

    Neat. Thanks for sharing!

    Interestingly, may-minihttp is faring very well in the TechEmpower benchmark [1], for whatever those benchmarks are worth. The code is also surprisingly straightforward [2].

    [1] https://www.techempower.com/benchmarks/

    [2] https://github.com/TechEmpower/FrameworkBenchmarks/blob/mast...

  • tianshou

    An elegant PyTorch deep reinforcement learning library.

    Project mention: Is it better to not use the Target Update Frequency in Double DQN or depends on the application? | /r/reinforcementlearning | 2023-07-05

    The tianshou implementation I found at https://github.com/thu-ml/tianshou/blob/master/tianshou/policy/modelfree/dqn.py is DQN by default.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  • web-frameworks

    Which is the fastest web framework?

  • sysbench

    Scriptable database and system performance benchmark

    Project mention: RDS MySQL Load Testing with Sysbench | dev.to | 2023-04-09

    Sometimes you need to do a load test on MySQL Database to test Auto-Scaling for example. I found a very useful tool called Sysbench that I will present in this article.

  • benchmark.js

    A benchmarking library. As used on jsPerf.com.

  • mmpose

    OpenMMLab Pose Estimation Toolbox and Benchmark.

  • ann-benchmarks

    Benchmarks of approximate nearest neighbor libraries in Python

    Project mention: ANN Benchmarks | news.ycombinator.com | 2024-01-25
  • criterion.rs

    Statistics-driven benchmarking library for Rust

    Project mention: How to benchmark in Rust with libtest bench | /r/bencher | 2023-12-03

    The three popular options for benchmarking in Rust are: libtest bench, Criterion, and Iai.

  • mmaction2

    OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

  • Baichuan2

    A series of large language models developed by Baichuan Intelligent Technology

    Project mention: Baichuan 2 | news.ycombinator.com | 2023-10-12
  • coost

    A tiny boost library in C++11.

    Project mention: Write C++ as easy as Golang with coost | news.ycombinator.com | 2023-09-09
  • oha

    Ohayou(おはよう), HTTP load generator, inspired by rakyll/hey with tui animation.

  • yet-another-bench-script

    YABS - a simple bash script to estimate Linux server performance using fio, iperf3, & Geekbench

    Project mention: Yet Another VPS Benchmark – Cloudfanatic, DigitalOcean, Linode, Vultr [Aug 2023] | news.ycombinator.com | 2023-08-26

    Interesting benchmark script [1], but the post really would benefit from a comparison table or graphs.

    https://github.com/masonr/yet-another-bench-script

  • awesome-http-benchmark

    HTTP(S) benchmark tools, testing/debugging, & restAPI (RESTful)

  • Baichuan-13B

    A 13B large language model developed by Baichuan Intelligent Technology

    Project mention: Baichuan IA de China | /r/techieHugui | 2023-07-22
  • Derailed Benchmarks

    Go faster, off the Rails - Benchmarks for your whole Rails app

  • XcodeBenchmark

    XcodeBenchmark measures the compilation time of a large codebase on iMac, MacBook, and Mac Pro

    Project mention: 2023 Mac Mini 10 Core M2 Pro – A Beast for Xcode Compilation | news.ycombinator.com | 2024-02-08
  • tsung

    Tsung is a high-performance benchmark framework for various protocols including HTTP, XMPP, LDAP, etc.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2024-03-25.

Benchmark related posts

Index

What are some of the best open-source Benchmark projects? This list will help you:

Project Stars
1 hyperfine 19,598
2 fashion-mnist 11,439
3 awesome-semantic-segmentation 10,220
4 BenchmarkDotNet 9,940
5 benchmark 8,325
6 FrameworkBenchmarks 7,342
7 tianshou 7,278
8 web-frameworks 6,879
9 sysbench 5,743
10 benchmark.js 5,488
11 mmpose 4,883
12 ann-benchmarks 4,484
13 criterion.rs 4,094
14 mmaction2 3,825
15 Baichuan2 3,820
16 coost 3,798
17 oha 3,665
18 yet-another-bench-script 3,592
19 awesome-http-benchmark 3,155
20 Baichuan-13B 2,940
21 Derailed Benchmarks 2,916
22 XcodeBenchmark 2,877
23 tsung 2,502
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com