FedScale
automlbenchmark
FedScale | automlbenchmark | |
---|---|---|
4 | 3 | |
366 | 380 | |
1.4% | 2.4% | |
7.9 | 6.7 | |
5 months ago | 5 days ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
FedScale
-
University of Michigan Researchers Open-Source ‘FedScale’: a Federated Learning (FL) Benchmarking Suite with Realistic Datasets and a Scalable Runtime to Enable Reproducible FL Research on Privacy-Preserving Machine Learning
Continue reading | Checkout the paper, github link
- We created the most comprehensive benchmark datasets for federated learning to date!
- The most comprehensive benchmark datasets for federated learning to date!
-
The most comprehensive benchmark datasets for federated learning to date
We created FedScale, which has a diverse set of challenging and realistic benchmark datasets to facilitate scalable, comprehensive, and reproducible federated learning (FL) research. FedScale datasets are large-scale, encompassing a diverse range of important FL tasks, such as image classification, object detection, word prediction, and speech recognition. Our evaluation platform provides flexible APIs to implement new FL algorithms and includes new execution backends with minimal developer efforts. Check it out, and feel free to join the FedScale community via Slack(https://join.slack.com/t/fedscale/shared_invite/zt-uzouv5wh-ON8ONCGIzwjXwMYDC2fiKw)!
Paper: https://arxiv.org/abs/2105.11367 and Github repo: https://github.com/symbioticlab/fedscale
Cheers!
automlbenchmark
-
Show HN: Web App with GUI for AutoML on Tabular Data
Here is benchmark done by independent team of researchers https://openml.github.io/automlbenchmark/
I think most of overfitting is avoided with early stoppoing technique.
The underfitting can be avoidwd with using large training time.
-
Show HN: AutoAI
Your list excludes most of well-known open-source AutoML tools such as auto-sklearn, AutoGluon, LightAutoML, MLJarSupervised, etc. These tools have been very extensively benchmarked by the OpenML AutoML Benchmark (https://github.com/openml/automlbenchmark) and have papers published, so they are pretty well-known to the AutoML community.
Regarding H2O.ai: Frankly, you don't seem to understand H2O.ai's AutoML offerings.
I'm the creator of H2O AutoML, which is open source, and there's no "enterprise version" of H2O AutoML. The interface is simple -- all you need to specify is the training data and target. We have included DNNs in our set of models since the first release of the tool in 2017. Read more here: https://docs.h2o.ai/h2o/latest-stable/h2o-docs/automl.html We also offer full explainability for our models: https://docs.h2o.ai/h2o/latest-stable/h2o-docs/explain.html
H2O.ai develops another AutoML tool called Driverless AI, which is proprietary. You might be conflating the two. Neither of these tools need to be used on the H2O AI Cloud. Both tools pre-date our cloud by many years and can be used on a user's own laptop/server very easily.
Your Features & Roadmap list in the README indicates that your tool does not yet offer DNNs, so either you should update your post here or update your README if it's incorrect: https://github.com/blobcity/autoai/blob/main/README.md#featu...
Lastly, I thought I would mention that there's already an AutoML tool called "AutoAI" by IBM. Generally, it's not a good idea to have name collisions in a small space like the AutoML community. https://www.ibm.com/support/producthub/icpdata/docs/content/...
-
Show HN: Mljar Automated Machine Learning for Tabular Data (Explanation,AutoDoc)
I'm also curious how does it compare! The package will be included in the newest comparison done by OpenML people https://github.com/openml/automlbenchmark
I have some old comparison of closed-source old system
What are some alternatives?
flower - Flower: A Friendly Federated Learning Framework
autogluon - Fast and Accurate ML in 3 Lines of Code
FederatedScope - An easy-to-use federated learning platform
nni - An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
fedjax - FedJAX is a JAX-based open source library for Federated Learning simulations that emphasizes ease-of-use in research.
autokeras - AutoML library for deep learning
ORBIT-Dataset - The ORBIT dataset is a collection of videos of objects in clean and cluttered scenes recorded by people who are blind/low-vision on a mobile phone. The dataset is presented with a teachable object recognition benchmark task which aims to drive few-shot learning on challenging real-world data.
MindsDB - The platform for customizing AI from enterprise data
datasets - TFDS is a collection of datasets ready to use with TensorFlow, Jax, ...
adanet - Fast and flexible AutoML with learning guarantees.
FATE - An Industrial Grade Federated Learning Framework
mljar-supervised - Python package for AutoML on Tabular Data with Feature Engineering, Hyper-Parameters Tuning, Explanations and Automatic Documentation