Python hyperparameter-optimization

Open-source Python projects categorized as hyperparameter-optimization
Edit details
Topics: #Machine Learning #Deep Learning #Automl #hyperparameter-tuning #Python
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com
Sponsored

Top 23 Python hyperparameter-optimization Projects

  • Ray

    Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Project mention: Fine-Tuning Llama-2: A Comprehensive Case Study for Tailoring Custom Models | news.ycombinator.com | 2023-08-11

    Training times for GSM8k are mentioned here: https://github.com/ray-project/ray/tree/master/doc/source/te...

  • d2l-en

    Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.

    Project mention: which book to chose for deep learning :lan Goodfellow or francois chollet | /r/learnmachinelearning | 2023-04-07

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  • nni

    An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

    Project mention: Filter Pruning for PyTorch | /r/deeplearning | 2023-04-13

  • optuna

    A hyperparameter optimization framework

    Project mention: FOSS hyperparameter optimization framework to automate hyperparameter search | news.ycombinator.com | 2023-08-10

  • wandb

    🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.

    Project mention: Northlight makes Alan Wake 2 shine | news.ycombinator.com | 2023-11-07

  • auto-sklearn

    Automated Machine Learning with scikit-learn

  • autogluon

    AutoGluon: AutoML for Image, Text, Time Series, and Tabular Data

    Project mention: pip install remyxai - easiest way to create custom vision models | /r/computervision | 2023-04-25

    This seems not very convincing. There are other popular frameworks that provide AutoML with existing datasets (eg https://github.com/autogluon/autogluon)

  • Onboard AI

    Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  • polyaxon

    MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle

    Project mention: Any MLOps platform you use? | /r/selfhosted | 2023-02-25

    If you're not concerned about self-hosting, WandB is one of the more fully featured training monitoring tools (I've used it in the past without any issues but the lack of data and training privacy and lack of self-hosting possibilities makes it a hard no for anything that isn't scholastic). Polyaxon is an alternative but rewriting all your variable logging to conform to their requirements makes it very difficult to switch to it in the middle of a project so you have to commit to it from the get-go.

  • mljar-supervised

    Python package for AutoML on Tabular Data with Feature Engineering, Hyper-Parameters Tuning, Explanations and Automatic Documentation

    Project mention: Show HN: Web App with GUI for AutoML on Tabular Data | news.ycombinator.com | 2023-08-24

    Web App is using two open-source packages that I've created:

    - MLJAR AutoML - Python package for AutoML on tabular data https://github.com/mljar/mljar-supervised

    - Mercury - framework for converting Jupyter Notebooks into Web App https://github.com/mljar/mercury

    You can run Web App locally. What is more, you can adjust notebook's code for your needs. For example, you can set different validation strategies or evalutaion metrics or longer training times. The notebooks in the repo are good starting point for you to develop more advanced apps.

  • keras-tuner

    A Hyperparameter Tuning Library for Keras

  • rl-baselines3-zoo

    A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.

    Project mention: Can't solve MountainCar-v0 with A2C algorithm (stable-baselines3) | /r/reinforcementlearning | 2023-06-27

    I'm trying to solve MountainCar-v0 enviroment from gymnasium with the A2C algorithm and the agent doesn't find a solution. I checked this so I added import stable_baselines3.common.sb2_compat.rmsprop_tf_like as RMSpropTFLike. Also checked the rl-baselines3-zoo for the hyperparameter tuning. So my code is:

  • vizier

    Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

    Project mention: [N] Google Open Sources Vizier, Hyperparameter + Blackbox Optimization Service at Scale | /r/MachineLearning | 2023-02-03

  • rl-baselines-zoo

    A collection of 100+ pre-trained RL agents using Stable Baselines, training and hyperparameter optimization included.

  • Gradient-Free-Optimizers

    Simple and reliable optimization with local, global, population-based and sequential techniques in numerical discrete search spaces.

    Project mention: Show HN: Gradient-Free-Optimizers supports constrained optimization in v1.3 | news.ycombinator.com | 2023-04-11

  • SMAC3

    SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization

  • OCTIS

    OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)

  • FEDOT

    Automated modeling and machine learning framework FEDOT

  • optuna-examples

    Examples for https://github.com/optuna/optuna

  • Hyperactive

    An optimization and data collection toolbox for convenient and fast prototyping of computationally expensive models.

    Project mention: Hyperactive Version 4.5 Released | news.ycombinator.com | 2023-08-27

  • archai

    Accelerate your Neural Architecture Search (NAS) through fast, reproducible and modular research.

  • AgileRL

    Streamlining reinforcement learning with RLOps

    Project mention: [P] Introducing PPO and Rainbow DQN to our super fast evolutionary HPO reinforcement learning framework | /r/MachineLearning | 2023-10-15

  • tuneta

    Intelligently optimizes technical indicators and optionally selects the least intercorrelated for use in machine learning models

  • syne-tune

    Large scale and asynchronous Hyperparameter and Architecture Optimization at your fingertips.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-11-07.

Python hyperparameter-optimization related posts

Index

What are some of the best open-source hyperparameter-optimization projects in Python? This list will help you:

Project Stars
1 Ray 28,849
2 d2l-en 20,011
3 nni 13,426
4 optuna 8,960
5 wandb 7,538
6 auto-sklearn 7,226
7 autogluon 6,478
8 polyaxon 3,416
9 mljar-supervised 2,839
10 keras-tuner 2,783
11 rl-baselines3-zoo 1,579
12 vizier 1,122
13 rl-baselines-zoo 1,076
14 Gradient-Free-Optimizers 1,064
15 SMAC3 930
16 OCTIS 634
17 FEDOT 566
18 optuna-examples 513
19 Hyperactive 473
20 archai 438
21 AgileRL 435
22 tuneta 335
23 syne-tune 331

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com