composer
pytorch-forecasting
| composer | pytorch-forecasting | |
|---|---|---|
| 19 | 9 | |
| 5,015 | 3,635 | |
| 2.1% | - | |
| 9.8 | 8.6 | |
| 6 days ago | 9 days ago | |
| Python | Python | |
| Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
composer
- Composer – A PyTorch Library for Efficient Neural Network Training
- Train neural networks up to 7x faster
-
How to Train Large Models on Many GPUs?
Mosaic's open source library is excellent: Composer https://github.com/mosaicml/composer.
* It gives you PyTorch DDP for free. Makes FSDP about as easy as can be, and provides best in class performance monitoring tools. https://docs.mosaicml.com/en/v0.12.1/notes/distributed_train...
Here's a nice intro to using Huggingface models: https://docs.mosaicml.com/en/v0.12.1/examples/finetune_huggi...
I'm just a huge fan of their developer experience. It's up there with Transformers and Datasets as the nicest tools to use.
-
[D] Am I stupid for avoiding high level frameworks?
You may consider using Composer Composer by MosaicML.
-
[P] Farewell, CUDA OOM: Automatic Gradient Accumulation
Which is why I'm excited to announce that we (MosaicML) just released an automatic way to avoid these errors. Namely, we just added automatic gradient accumulation to Composer, our open source library for faster + easier neural net training.
-
I highly and genuinely recommend Fast.ai course to beginners
I would love to know your thoughts on PyTorch Lightning vs. other, even more lightweight libraries, if you have the time. PL strikes me as being less idiosyncratic than FastAI, but I'm still not sure whether it would be better in engineering work to go even more lightweight (when I'm not just writing the code myself) -- something that offers up just optimizations and a trainer, a la MosaicML's [Composer](https://github.com/mosaicml/composer) or Chris Hughes's [pytorch-accelerated](https://github.com/Chris-hughes10/pytorch-accelerated) .
-
10x faster matrix and vector operations
This master's thesis sort of does it, but it doesn't have any fine-tuning yet so it completely wrecks the accuracy: https://github.com/joennlae/halutmatmul.
If someone worked on contributing this to Composer [1] I'd be down to help out. I can't justify building it all on my own right now since we're 100% focused on training speedup, but I could definitely meet and talk through it, help code tricky parts, review PRs, etc.
[1] https://github.com/mosaicml/composer
-
[D] Is anyone working on interesting ML libraries and looking for contributors?
We're always looking for contributors for Composer. tl;dr it speeds up neural net training by a lot (e.g., 7x faster ResNet-50).
-
[R] Blazingly Fast Computer Vision Training with the Mosaic ResNet and Composer
Looking at this: https://github.com/mosaicml/composer
- [D] Where do we currently stand at in lottery ticket hypothesis research?
pytorch-forecasting
- FLaNK Stack Weekly for 14 Aug 2023
-
Pytorch Lstm
Source: Conversation with Bing, 4/5/2023 (1) jdb78/pytorch-forecasting: Time series forecasting with PyTorch - GitHub. https://github.com/jdb78/pytorch-forecasting. (2) Time Series Prediction with LSTM Using PyTorch - Colaboratory. https://colab.research.google.com/github/dlmacedo/starter-academic/blob/master/content/courses/deeplearning/notebooks/pytorch/Time_Series_Prediction_with_LSTM_Using_PyTorch.ipynb. (3) time-series-classification · GitHub Topics · GitHub. https://github.com/topics/time-series-classification. (4) PyTorch: Dataloader for time series task - Stack Overflow. https://stackoverflow.com/questions/57893415/pytorch-dataloader-for-time-series-task.
-
[D] What is the best approach to create embeddings for time series with additional historical events to use with Transformers model?
Temporal fusion transformer https://github.com/jdb78/pytorch-forecasting
-
LSTM/CNN architectures for time series forecasting[Discussion]
Pytorch-forecasting
- Can someone help me with this? It's been days that i struggle with this problem, Forecasting w DeepAR
- Can someone help me with this? it's been days that i struggle with this problem
-
[P] Beware of false (FB-)Prophets: Introducing the fastest implementation of auto ARIMA [ever].
To name a few: https://github.com/jdb78/pytorch-forecasting, https://github.com/unit8co/darts, https://github.com/Nixtla/neuralforecast
-
When to go for an 'easy' time-series model vs. using a complex deep learning model (when having experience with the latter)
I'm a data trainee at this organisation. I wrote my master thesis about using an event clustering mechanism to enrich an existing dataset to improve short-term demand predictions, using Pytorch Forecasting using the temporal fusion transformer component, and LightGBM (and compare the models with and w/o the event feature, so 4 runs in total).
-
A python library for easy manipulation and forecasting of time series.
Darts is a pretty nice one. I've recently been using pytorch-forecasting for larger models like the Temporal Fusion Transformer. https://github.com/jdb78/pytorch-forecasting
What are some alternatives?
pytorch-lightning - Build high-performance AI models with PyTorch Lightning (organized PyTorch). Deploy models with Lightning Apps (organized Python to build end-to-end ML systems). [Moved to: https://github.com/Lightning-AI/lightning]
darts - A python library for user-friendly forecasting and anomaly detection on time series.
pytorch-lightning - Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.
Prophet - Tool for producing high quality forecasts for time series data that has multiple seasonality with linear or non-linear growth.
ffcv - FFCV: Fast Forward Computer Vision (and other ML workloads!)
neuralforecast - Scalable and user friendly neural :brain: forecasting algorithms.
Pytorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration
Lime-For-Time - Application of the LIME algorithm by Marco Tulio Ribeiro, Sameer Singh, Carlos Guestrin to the domain of time series classification
cifar10-fast
pytorch-tutorial - PyTorch Tutorial for Deep Learning Researchers
tslearn - The machine learning toolkit for time series analysis in Python