tune-sklearn
auto-sklearn
tune-sklearn | auto-sklearn | |
---|---|---|
4 | 3 | |
462 | 7,409 | |
- | 0.4% | |
0.0 | 1.8 | |
6 months ago | 4 months ago | |
Python | Python | |
Apache License 2.0 | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tune-sklearn
-
LightGBM vs. XGBoost: Which distributed version is faster?
Of course not! :)
The Ray ecosystem is actually chalk full of integrations, from XGBoost Ray (https://docs.ray.io/en/master/xgboost-ray.html), to PyTorch on Ray (https://docs.ray.io/en/master/using-ray-with-pytorch.html), and of course hyperparameter search with Ray Tune for a variety of libraries, including Sklearn (https://github.com/ray-project/tune-sklearn).
-
[D] I'm new and scrappy. What tips do you have for better logging and documentation when training or hyperparameter training?
If you mainly use scikit-learn, you should consider using tune-sklearn.
-
[P] Bayesian Hyperparameter Optimization with tune-sklearn in PyCaret
Just wanted to share a not widely known feature of PyCaret. By default, PyCaret's tune_model uses the tried and tested RandomizedSearchCV from scikit-learn. However, not everyone knows about the various advanced options tune_model() currently allows you to use such as cutting edge hyperparameter tuning techniques like Bayesian Optimization through libraries such as tune-sklearn, Hyperopt, and Optuna.
-
[D] Here are 3 ways to Speed Up Scikit-Learn - Any suggestions?
You might want to try out tune-sklearn as it seems like it works for catboost as well. I am trying it use tune-sklearn to speed up my scikit-learn hyperparameter tuning.
auto-sklearn
-
Why not AutoML every tabular data?
Efficiency Ignoring the feature engineering aspects aside, a typical data scientist workflow involves trying out the different models. Some of the AutoML modules like H2O AutoML, AutoSklearn does this for you, and allow you to interpret your models. All these save so much time experimenting with the standard models.
- [R] Regularization is all you Need: Simple Neural Nets can Excel on Tabular Data
-
What free AutoML library do you recommend?
If you want a more stable AutoML library, i’ll suggest auto-sklearn which optimises performance of sklearn learning algorithms.
What are some alternatives?
guildai - Experiment tracking, ML developer tools
autogluon - Fast and Accurate ML in 3 Lines of Code
hummingbird - Hummingbird compiles trained ML models into tensor computation for faster inference.
Auto-PyTorch - Automatic architecture search and hyperparameter optimization for PyTorch
dvc - 🦉 ML Experiments and Data Management with Git
syne-tune - Large scale and asynchronous Hyperparameter and Architecture Optimization at your fingertips.
spock - spock is a framework that helps manage complex parameter configurations during research and development of Python applications
OCTIS - OCTIS: Comparing Topic Models is Simple! A python package to optimize and evaluate topic models (accepted at EACL2021 demo track)
labml - 🔎 Monitor deep learning model training and hardware usage from your mobile phone 📱
nni - An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
SMAC3 - SMAC3: A Versatile Bayesian Optimization Package for Hyperparameter Optimization
pymarl2 - Fine-tuned MARL algorithms on SMAC (100% win rates on most scenarios)