Practical_RL
webdataset
Our great sponsors
| Practical_RL | webdataset | |
|---|---|---|
| 2 | 7 | |
| 5,702 | 1,924 | |
| 1.0% | 5.6% | |
| 6.5 | 8.9 | |
| 6 days ago | 5 days ago | |
| Jupyter Notebook | Python | |
| The Unlicense | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Practical_RL
- [D] implementation of MCTS in Python
-
Alternatives to OpenAI’s spinning up?
there is this great github repo where there are lectures and other resources, and have a week by week jupyter notebooks where they explain and code with homeworks at the very end of it. is basics and deepRL, but just dqn and DDPG/ppo but i think will give you good start in the topic for later star working on your own.
webdataset
-
How to use data stored in a (private) S3 Bucket for training?
As an alternative, I've looked into using WebDataset, but couldn't figure out how to access data that is stored in a private bucket.
- [D] Title: Best tools and frameworks for working with million-billion image datasets?
-
[D] Training networks on extremely large datasets (10+TB)?
You can try webdataset (https://github.com/webdataset/webdataset).
- Question: TIFF image dataset - size in RAM.
-
How to upload large amounts of data to a server?
compress it to .tar format and then load it as a webdataset
-
Does mit 6.824 help for distributed deep learning?
Would guess not but there should be some good niche resources: check out the introductory videos here https://github.com/webdataset/webdataset
-
How to effectively load a large text dataset with PyTorch?
I found a pretty good solution that is similar to the TFRecord from Tensorflow. You just need to load the data, tokenized it, and save the arrays in shards with webdataset package.
What are some alternatives?
FunMatch-Distillation - TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.
NYU-DLSP20 - NYU Deep Learning Spring 2020
awesome-rl - Reinforcement learning resources curated
Made-With-ML - Learn how to design, develop, deploy and iterate on production-grade ML applications.
labml - 🔎 Monitor deep learning model training and hardware usage from your mobile phone 📱
ffcv - FFCV: Fast Forward Computer Vision (and other ML workloads!)
alpha-zero-general - A clean implementation based on AlphaZero for any game in any framework + tutorial + Othello/Gobang/TicTacToe/Connect4 and more
fastai - The fastai deep learning library
redisai-examples - RedisAI showcase
ModelNet40-C - Repo for "Benchmarking Robustness of 3D Point Cloud Recognition against Common Corruptions" https://arxiv.org/abs/2201.12296
TensorFlow-Tutorials - TensorFlow Tutorials with YouTube Videos
PySyft - Perform data science on data that remains in someone else's server