PyTorch-Guide
halutmatmul
PyTorch-Guide | halutmatmul | |
---|---|---|
2 | 3 | |
23 | 202 | |
- | - | |
1.8 | 9.4 | |
over 2 years ago | 5 months ago | |
Python | Python | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
PyTorch-Guide
- Useful Tools and Programs for Deep Learning with PyTorch
-
Cool PyTorch Guide/Wiki
PyTorch Guide/Wiki: https://github.com/mikeroyal/PyTorch-Guide
halutmatmul
- Show HN: Stella Nera – Maddness Hardware Accelerator
-
10x faster matrix and vector operations
This master's thesis sort of does it, but it doesn't have any fine-tuning yet so it completely wrecks the accuracy: https://github.com/joennlae/halutmatmul.
If someone worked on contributing this to Composer [1] I'd be down to help out. I can't justify building it all on my own right now since we're 100% focused on training speedup, but I could definitely meet and talk through it, help code tricky parts, review PRs, etc.
[1] https://github.com/mosaicml/composer
What are some alternatives?
NeuralCDE - Code for "Neural Controlled Differential Equations for Irregular Time Series" (Neurips 2020 Spotlight)
QualityScaler - QualityScaler - image/video deeplearning upscaling for any GPU
cog - Containers for machine learning
kernel_tuner - Kernel Tuner
bittensor - Internet-scale Neural Networks
3d-ken-burns - an implementation of 3D Ken Burns Effect from a Single Image using PyTorch
TransformerEngine - A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
composer - Supercharge Your Model Training
bolt - 10x faster matrix and vector operations
caer - High-performance Vision library in Python. Scale your research, not boilerplate.