Top 23 Python hyperparameter-optimization Projects

• Ray

  42 30,879 10.0 Python

  Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

  

Project mention: Open Source Advent Fun Wraps Up! | dev.to | 2024-01-05

22. Ray | Github | tutorial

• d2l-en

  6 21,564 8.7 Python

  Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• nni

  5 13,708 6.7 Python

  An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

  

• optuna

  34 9,615 9.9 Python

  A hyperparameter optimization framework

  

Project mention: Optuna – A Hyperparameter Optimization Framework | news.ycombinator.com | 2024-04-06

I didn’t even know WandB did hyperparameter optimization, I figured it was a neural network visualizer based on 2 minute papers. Didn’t seem like many alternatives out there to Optuna with TPE + persistence in conditional continuous & discrete spaces.

Anyway, it’s doable to make a multi objective decide_to_prune function with Optuna, here’s an example https://github.com/optuna/optuna/issues/3450#issuecomment-19...

• wandb

  16 8,159 9.8 Python

  🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.

  

Project mention: A list of SaaS, PaaS and IaaS offerings that have free tiers of interest to devops and infradev | dev.to | 2024-02-05

Weights & Biases — The developer-first MLOps platform. Build better models faster with experiment tracking, dataset versioning, and model management. Free tier for personal projects only, with 100 GB of storage included.

• auto-sklearn

  3 7,394 1.8 Python

  Automated Machine Learning with scikit-learn

  

• autogluon

  8 7,050 9.6 Python

  AutoGluon: Fast and Accurate ML in 3 Lines of Code

  

Project mention: pip install remyxai - easiest way to create custom vision models | /r/computervision | 2023-04-25

This seems not very convincing. There are other popular frameworks that provide AutoML with existing datasets (eg https://github.com/autogluon/autogluon)

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• polyaxon

  9 3,476 8.8 Python

  MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

  

• mljar-supervised

  51 2,927 8.5 Python

  Python package for AutoML on Tabular Data with Feature Engineering, Hyper-Parameters Tuning, Explanations and Automatic Documentation

  

Project mention: Show HN: Web App with GUI for AutoML on Tabular Data | news.ycombinator.com | 2023-08-24

Web App is using two open-source packages that I've created:

- MLJAR AutoML - Python package for AutoML on tabular data https://github.com/mljar/mljar-supervised

- Mercury - framework for converting Jupyter Notebooks into Web App https://github.com/mljar/mercury

You can run Web App locally. What is more, you can adjust notebook's code for your needs. For example, you can set different validation strategies or evalutaion metrics or longer training times. The notebooks in the repo are good starting point for you to develop more advanced apps.

• keras-tuner

  4 2,821 8.1 Python

  A Hyperparameter Tuning Library for Keras

  

• rl-baselines3-zoo

  11 1,764 6.3 Python

  A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.

  

Project mention: Can't solve MountainCar-v0 with A2C algorithm (stable-baselines3) | /r/reinforcementlearning | 2023-06-27

I'm trying to solve MountainCar-v0 enviroment from gymnasium with the A2C algorithm and the agent doesn't find a solution. I checked this so I added import stable_baselines3.common.sb2_compat.rmsprop_tf_like as RMSpropTFLike. Also checked the rl-baselines3-zoo for the hyperparameter tuning. So my code is:

• vizier

  5 1,171 9.4 Python

  Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

  

• rl-baselines-zoo

  2 1,106 0.0 Python

  A collection of 100+ pre-trained RL agents using Stable Baselines, training and hyperparameter optimization included.

• Gradient-Free-Optimizers

  11 1,100 5.8 Python

  Simple and reliable optimization with local, global, population-based and sequential techniques in numerical discrete search spaces.

• SMAC3

  2 1,003 4.1 Python

  SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization

  

• OCTIS

  7 681 6.0 Python

  OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)

  

• FEDOT

  4 603 8.5 Python

  Automated modeling and machine learning framework FEDOT

  

• optuna-examples

  2 587 8.8 Python

  Examples for https://github.com/optuna/optuna

  

• AgileRL

  12 488 9.8 Python

  Streamlining reinforcement learning with RLOps. State-of-the-art RL algorithms and tools.

  

Project mention: [P] Introducing PPO and Rainbow DQN to our super fast evolutionary HPO reinforcement learning framework | /r/MachineLearning | 2023-10-15

• Hyperactive

  8 487 7.7 Python

  An optimization and data collection toolbox for convenient and fast prototyping of computationally expensive models.

Project mention: Hyperactive Version 4.5 Released | news.ycombinator.com | 2023-08-27

• archai

  3 451 8.3 Python

  Accelerate your Neural Architecture Search (NAS) through fast, reproducible and modular research.

  

• tuneta

  12 374 4.6 Python

  Intelligently optimizes technical indicators and optionally selects the least intercorrelated for use in machine learning models

• syne-tune

  1 363 8.5 Python

  Large scale and asynchronous Hyperparameter and Architecture Optimization at your fingertips.

  

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python hyperparameter-optimization related posts

• Optuna – A Hyperparameter Optimization Framework
  2 projects | news.ycombinator.com | 6 Apr 2024
• How to test optimal parameters
  2 projects | /r/algotrading | 9 Dec 2023
• Optuna – A Hyperparameter Optimization Framework
  1 project | news.ycombinator.com | 8 Dec 2023
• Exploring Methods to Improve Text Chunking in RAG Models (and other things...)
  1 project | /r/GPT3 | 22 Oct 2023
• Cubic Spline Interpolation
  1 project | news.ycombinator.com | 22 Oct 2023
• Hyperactive Version 4.5 Released
  1 project | news.ycombinator.com | 27 Aug 2023
• FOSS hyperparameter optimization framework to automate hyperparameter search
  1 project | news.ycombinator.com | 10 Aug 2023
• A note from our sponsor - InfluxDB
  www.influxdata.com | 19 Apr 2024

  Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!