DALI
ocaml-torch
| DALI | ocaml-torch | |
|---|---|---|
| 5 | 1 | |
| 4,917 | 400 | |
| 1.1% | - | |
| 9.6 | 4.5 | |
| 2 days ago | 12 months ago | |
| C++ | OCaml | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
DALI
-
[D] Will data augmentations work faster on TPUs?
Another option is DALI https://github.com/NVIDIA/DALI For my project while training EfficientNet2, it was a game changer. But it a way harder to implement in code than TorchVision or Kornia.
-
DirectStorage - Loading data to GPU *directly* from the SSD drive, almost without using CPU
Check out https://github.com/nvidia/DALI
-
mmap_ninja: Speedup your training dramatically by using memory-mapped files for your dataset
Small question if you are using GPU: How to this compare to GPUDirect Storage from Nvidia? can you have even more speedup by using both? I never toy with it, but the DALI project from Nvidia seem to tackle the same data loading problem.
- [D] Efficiently loading videos in PyTorch without extracting frames
ocaml-torch
What are some alternatives?
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
norse - Deep learning with spiking neural networks (SNNs) in PyTorch.
Blurry - Blurry is an easy blur library for Android
DiffSharp - DiffSharp: Differentiable Functional Programming
vision - Datasets, Transforms and Models specific to Computer Vision
mini_dalle - mini-dalle in OCaml
executorch - On-device AI across mobile, embedded and edge for PyTorch
hyperlearn - 2-2000x faster ML algos, 50% less memory usage, works on all hardware - new and old.
DREAMPlace - Deep learning toolkit-enabled VLSI placement
lamp - deep learning and scientific computing framework with native CPU and GPU backend for the Scala programming language
MegEngine - MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架