FLAML
automl
Our great sponsors
FLAML | automl | |
---|---|---|
9 | 7 | |
3,671 | 6,154 | |
3.2% | 0.7% | |
8.3 | 5.0 | |
19 days ago | 25 days ago | |
Jupyter Notebook | Jupyter Notebook | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
FLAML
-
AutoGen: Enabling Next-Gen GPT-X Applications
I really like the simplicity of this framework, and they hit on a lot of common problems found in other agent-based frameworks. Most intrigued by the RAG improvements.
Seems like Microsoft was frustrated with the pace of movement in this space and the shitty results of agents (which admittedly kept my interest turned away from agents for the last few months). I'm interested again because it makes practical sense, and from looking at the example notebooks, seems fairly easy to integrate into existing applications.
Maybe this is the 'low code' approach that might actually work, and bridge together engineering and non-engineering resources.
This example was what caught my eye: https://github.com/microsoft/FLAML/blob/main/notebook/autoge...
-
Elevate Your Python Skills: Machine Learning Packages That Transformed My Journey as ML Engineer
4. FLAML
- Show HN: AutoML Python Package for Tabular Data with Automatic Documentation
- [D] If there’s one practical tip you wish should have been drilled deeply into you when you first started out learning about deep learning, what would it be?
-
what is the future of ML.NET?
Improved AutoML - Again, with collaboration from Microsoft Research, we used FLAML to update our existing AutoML solutions. What does this mean for you? You're using the latest techniques but all you need is a problem to solve and some data to get started.
-
Automated Machine Learning (AutoML) - 9 Different Ways with Microsoft AI
For a complete tutorial, navigate to this Jupyter Notebook: https://github.com/microsoft/FLAML/blob/main/notebook/flaml_automl.ipynb
-
[N] Fast AutoML with Microsoft's FLAML + Ray Tune
Microsoft Researchers have developed FLAML (Fast Lightweight AutoML) which can now utilize Ray Tune for distributed hyperparameter tuning to scale up FLAML’s resource-efficient & seamlessly parallelizable algorithms across a cluster.
-
[R] FLAML - Fast and Lightweight AutoML library
Looks nice but I wonder if this is practical for non-tiny problems. The papers are a bit hard to follow but it looks like training is restarted with every new architecture choice. As for the library itself, the only large neural net example is a finetune of an NLP model that only searches over ADAM's optimizer params - which could be useful but it's a stretch to call that AutoML.
- Flaml – Cost-effective hyperparameter optimization AutoML
automl
- Slowdown / normalization on the Front Lines
- Lion, a new Optimizer from Google, provides 3-5x speedup compared to AdamW
-
How do I increase the accuracy of small objects when training an object detector?
I'm using Google Brain's EfficientDet repo to train an object detector. What hyperparameters should I choose to increase accuracy for small objects.
-
Android QR Code Detection with TensorFlow Lite
EfficientDet-D0 has comparable accuracy as YOLOv3.
-
[R] Google AI Introduces Two New Families of Neural Networks Called ‘EfficientNetV2’ and ‘CoAtNet’ For Image Recognition
Code for https://arxiv.org/abs/2104.00298 found: https://github.com/google/automl/efficientnetv2
-
Google AI Introduces Two New Families of Neural Networks Called ‘EfficientNetV2’ and ‘CoAtNet’ For Image Recognition
7 Min Read | Paper (CoAtNet) | Paper (EfficientNetV2) | Google blog | Code
-
[R] EfficientNetV2: Smaller Models and Faster Training
Abstract: This paper introduces EfficientNetV2, a new family of convolutional networks that have faster training speed and better parameter efficiency than previous models. To develop this family of models, we use a combination of training-aware neural architecture search and scaling, to jointly optimize training speed and parameter efficiency. The models were searched from the search space enriched with new ops such as Fused-MBConv. Our experiments show that EfficientNetV2 models train much faster than state-of- the-art models while being up to 6.8x smaller. > Our training can be further sped up by progressively increasing the image size during training, but it often causes a drop in accuracy. To compensate for this accuracy drop, we propose to adaptively adjust regularization (e.g., dropout and data augmentation) as well, such that we can achieve both fast training and good accuracy. > With progressive learning, our EfficientNetV2 significantly outperforms previous models on ImageNet and CIFAR/Cars/Flowers datasets. By pretraining on the same ImageNet21k, our EfficientNetV2 achieves 87.3% top-1 accuracy on ImageNet ILSVRC2012, outperforming the recent ViT by 2.0% accuracy while training 5x-11x faster using the same computing resources. Code will be available at this https URL.
What are some alternatives?
autogluon - AutoGluon: Fast and Accurate ML in 3 Lines of Code
simple-faster-rcnn-pytorch - A simplified implemention of Faster R-CNN that replicate performance from origin paper
nni - An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
gpt-3 - GPT-3: Language Models are Few-Shot Learners
H2O - H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
TFLiteClassification - TensorFlow Lite Image Classification Python Implementation
ML-For-Beginners - 12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all
SipMask - SipMask: Spatial Information Preservation for Fast Image and Video Instance Segmentation (ECCV2020)
Made-With-ML - Learn how to design, develop, deploy and iterate on production-grade ML applications.
efficientdet-pytorch - A PyTorch impl of EfficientDet faithful to the original Google impl w/ ported weights
nitroml - NitroML is a modular, portable, and scalable model-quality benchmarking framework for Machine Learning and Automated Machine Learning (AutoML) pipelines.
mlkit - A collection of sample apps to demonstrate how to use Google's ML Kit APIs on Android and iOS