ffcv
apex
ffcv | apex | |
---|---|---|
8 | 5 | |
2,747 | 8,050 | |
0.8% | 1.0% | |
3.5 | 8.0 | |
13 days ago | 9 days ago | |
Python | Python | |
Apache License 2.0 | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ffcv
- Question: TIFF image dataset - size in RAM.
-
[P] Composer: a new PyTorch library to train models ~2-4x faster with better algorithms
PyTorch Lightning is also very slow compared to Composer. You don't have to believe us: our friends who wrote the FFCV library benchmarked us against PTL (see the lower left plot in the first cluster of graphs) , and you can see the difference for yourself. For the same accuracy, the FFCV folks found that Composer is about 5x faster than PTL on ResNet-50 on ImageNet.
- FFCV: Fast Forward Computer Vision
-
Does anyone know where I can find research papers for preprocessing large image datasets?
maybe something like this? https://github.com/libffcv/ffcv
- Ffcv: Train models at a fraction of the cost with accelerated data loading
- Show HN: FFCV – Accelerated machine learning via fast data loading
-
[P] FFCV: Accelerated Model Training via Fast Data Loading
Hi! You can join the slack directly from the link on the homepage! (ffcv.io)
apex
- Nvidia 2:4 Sparsity
-
[P] Composer: a new PyTorch library to train models ~2-4x faster with better algorithms
I have been using their ASP package (ASP) and I have found it working well though as you said I would like to see support during the training phase as well
- Nvidia APEX on Colab
- AMPD Announces ‘Machine Learning Cloud’ Initiative Built Around AMD Instinct (TM) MI100 accelerators - the World’s Fastest HPC GPU for Scientific Research
What are some alternatives?
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
composer - Supercharge Your Model Training
best-of-ml-python - 🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
array_storage_benchmark - Compare some methods of array storage in Python (numpy)
open_lth - A repository in preparation for open-sourcing lottery ticket hypothesis code.
ffcv-imagenet - Train ImageNet *fast* in 500 lines of code with FFCV
pillow-simd - The friendly PIL fork
pytorch-lightning - Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.