Python Benchmarking

Open-source Python projects categorized as Benchmarking

Top 13 Python Benchmarking Projects

  • locust

    Scalable load testing tool written in Python

    Project mention: What server to pick for a good amount of consistent traffic? | | 2022-12-04
  • Merlion

    Merlion: A Machine Learning Framework for Time Series Intelligence

    Project mention: [podcast] Machine Learning for Time Series Intelligence | | 2022-08-25

    Aadyot Bhatnagar, is a Senior Research Engineer at Salesforce, and co-creator of Merlion an open source framework for applying machine learning on time series data.

  • InfluxDB

    Build time-series-based applications quickly and at scale.. InfluxDB is the Time Series Data Platform where developers build real-time applications for analytics, IoT and cloud-native services in less time with less code.

  • benchmark_VAE

    Unifying Generative Autoencoder implementations in Python

    Project mention: Researchers From INRIA France Propose ‘Pythae’: An Open-Source Python Library Unifying Common And State-of-the-Art Generative AutoEncoder (GAE) Implementations | | 2022-06-24

    Continue reading | Checkout the paper, github

  • pyperf

    Toolkit to run Python benchmarks

    Project mention: The Performance Benchmarks Comparing various combinations of GCC and Python | | 2022-08-05

    Finally, we use pyperf to compare the performance and generate Markdown tables.

  • ck

    Portable automation meta-framework to manage, describe, connect and reuse any artifacts, scripts, tools and workflows on any platform with any software and hardware in a non-intrusive way and with minimal effort. Try it using this tutorial to modularize and automate ML Systems benchmarking from the Student Cluster Competition at SC'22: (by mlcommons)

    Project mention: Sharing a tutorial to modularize ML Systems | | 2022-11-18
  • fastero

    Python timeit CLI for the 21st century! colored output, multi-line input with syntax highlighting and autocompletion and much more!

    Project mention: Fastero – Python timeit CLI for the 21st century | | 2022-04-29

    CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms (by carla-recourse)

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • ferret

    A python package for benchmarking interpretability techniques. (by g8a9)

    Project mention: Researchers From Italy Introduce ‘ferret’: A Novel Python Library for Benchmarking Explainers on Transformers | | 2022-08-08

    Continue reading | Check out the paper and github link.

  • python-benchmark-harness

    A micro/macro benchmark framework for the Python programming language that helps with optimizing your software.

    Project mention: Sprucing up my read me for my Python project | | 2022-02-01
  • ycecream

    Sweeter debugging and benchmarking Python programs.

  • toml-bench

    Which toml package to use in python?

    Project mention: Which toml package to use in Python? | | 2022-05-06
  • paragon

    A lightweight command line benchmarking utility (by terror)

  • ExpensiveOptimBenchmark

    Benchmarking Surrogate-based Optimisation Algorithms on Expensive Black-box Functions

    Project mention: 29 Python real world optimization tutorials | | 2022-07-14

    For the problems with continous decision variables it is not trivial to come up with faster approaches on a modern many-core CPU. But even with discrete input (scheduling and planning) new continous optimizers can compete. The trick is to utilize parallel optimization runs and numba to perform around 1E6 fitness evaluations each second. Advantage is that it is much easier to create a fitness function than for instance to implement incremental score calculation in Optaplanner. And it is more flexible if you have to handle non-standard problems. For very expensive optimizations (like parallelization of fitness evaluation is more important than to use surrogate models.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2022-12-04.

Python Benchmarking related posts


What are some of the best open-source Benchmarking projects in Python? This list will help you:

Project Stars
1 locust 20,225
2 Merlion 2,792
3 benchmark_VAE 1,103
4 pyperf 527
5 ck 501
6 fastero 204
7 CARLA 197
8 ferret 145
9 python-benchmark-harness 136
10 ycecream 42
11 toml-bench 15
12 paragon 12
13 ExpensiveOptimBenchmark 11
The context switching struggle is real
Zigi makes context switching a thing of the past. It monitors Jira and GitHub updates, pings you when PRs need approval and lets you take fast actions - all directly from Slack!