ffcv
array_storage_benchmark
| ffcv | array_storage_benchmark | |
|---|---|---|
| 8 | 1 | |
| 2,747 | 161 | |
| 0.8% | - | |
| 3.5 | 10.0 | |
| 13 days ago | about 4 years ago | |
| Python | Python | |
| Apache License 2.0 | - |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ffcv
- Question: TIFF image dataset - size in RAM.
-
[P] Composer: a new PyTorch library to train models ~2-4x faster with better algorithms
PyTorch Lightning is also very slow compared to Composer. You don't have to believe us: our friends who wrote the FFCV library benchmarked us against PTL (see the lower left plot in the first cluster of graphs) , and you can see the difference for yourself. For the same accuracy, the FFCV folks found that Composer is about 5x faster than PTL on ResNet-50 on ImageNet.
- FFCV: Fast Forward Computer Vision
-
Does anyone know where I can find research papers for preprocessing large image datasets?
maybe something like this? https://github.com/libffcv/ffcv
- Ffcv: Train models at a fraction of the cost with accelerated data loading
- Show HN: FFCV – Accelerated machine learning via fast data loading
-
[P] FFCV: Accelerated Model Training via Fast Data Loading
Hi! You can join the slack directly from the link on the homepage! (ffcv.io)
array_storage_benchmark
What are some alternatives?
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
best-of-ml-python - 🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
composer - Supercharge Your Model Training
apex - A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch
ffcv-imagenet - Train ImageNet *fast* in 500 lines of code with FFCV
pillow-simd - The friendly PIL fork
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
pytorch-lightning - Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
open_lth - A repository in preparation for open-sourcing lottery ticket hypothesis code.
webdataset - A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.