optuna-examples
SMAC3
| optuna-examples | SMAC3 | |
|---|---|---|
| 2 | 2 | |
| 601 | 1,012 | |
| 4.3% | 2.7% | |
| 8.7 | 3.2 | |
| 7 days ago | 8 days ago | |
| Python | Python | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
optuna-examples
-
[D]How to optimize an ANN?
Check out the examples for Optuna, a popular hyper parameter tuning package. It has examples for most popular ML frameworks including Xgboost, so you can see how it compares to an ANN framework like Keras or PyTorch.
-
Data Scientists are dying out
That's still regular ML because you are in charge of the features. Optuna might make your life easier though: https://github.com/optuna/optuna-examples/blob/main/xgboost/xgboost_simple.py
SMAC3
-
[D]How to optimize an ANN?
You can use Optuna, SMAC or hyperopt
-
Finding the optimal parameter
Apart from the aforementioned comments noting that this is an optimization problem, ready-to-use python libraries for this kind of problem (accounting for evaluation time) include http://hyperopt.github.io/hyperopt/, https://github.com/automl/SMAC3, or https://www.ray.io/ray-tune
What are some alternatives?
tqdm - :zap: A Fast, Extensible Progress Bar for Python and CLI
hyperopt - Distributed Asynchronous Hyperparameter Optimization in Python
Hyperactive - An optimization and data collection toolbox for convenient and fast prototyping of computationally expensive models.
optuna - A hyperparameter optimization framework
syne-tune - Large scale and asynchronous Hyperparameter and Architecture Optimization at your fingertips.
auto-sklearn - Automated Machine Learning with scikit-learn
nni - An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
mljar-supervised - Python package for AutoML on Tabular Data with Feature Engineering, Hyper-Parameters Tuning, Explanations and Automatic Documentation
Ray - Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
OCTIS - OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)