garage
A toolkit for reproducible reinforcement learning research. (by rlworkgroup)
lightning-hydra-template
PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡ (by ashleve)
| garage | lightning-hydra-template | |
|---|---|---|
| 5 | 9 | |
| 1,813 | 3,674 | |
| 0.4% | - | |
| 0.0 | 5.1 | |
| almost 1 year ago | about 2 months ago | |
| Python | Python | |
| MIT License | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
garage
Posts with mentions or reviews of garage.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2022-01-22.
- Are there any follow-up studies of RL^2 algorithms?
- Which python library to pick for RL as a beginner
-
Actor-critic reinforce-style gradient with entropy regularization vs soft actor-critic
max: https://github.com/rlworkgroup/garage/blob/62bbc5cec70480e3bf2039cea7f130befecbef10/src/garage/torch/algos/vpg.py#L158 regularized: https://github.com/rlworkgroup/garage/blob/62bbc5cec70480e3bf2039cea7f130befecbef10/src/garage/torch/algos/vpg.py#L343
-
Do you have any recommendation on a Reinforcement Learning library for Python?
TF-Agents and Garage look interesting and would be my first stop. Unfortunately I picked OpenAI baselines (not stable baselines) but it isn't supported any more.
- How to do unit testing for reinforcement learning
lightning-hydra-template
Posts with mentions or reviews of lightning-hydra-template.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-07-19.
- User-friendly PyTorch Lightning and Hydra template for ML experimentation
-
Best practice for saving logits/activation values of model in PyTorch Lightning
I've been trying to learn PyTorch Lightning and Hydra in order to use/create my own custom deep learning template (e.g. like this) as it would greatly help with my research workflow. A lot of the work I do requires me to analyse metrics based on the logits/activations of the model.
-
[D] Is Pytorch Lightning + Wandb a good combination for research?
I can't say for sure whether it is the best combination for research in the long run, but if you do go down that route I have found this template very useful
-
How research scientists structure their code ?
lightning-hydra-template
-
[D] Any research specific PyTorch based boilerplate code?
This lightning + hydra template is quite complete. Great for learning best practices.
-
Typing and testing for torch
A good example is this project template https://github.com/ashleve/lightning-hydra-template. It uses a lot of cool things such as
-
Our template to kickstart your pytorch projects, with list of best practices. Minimal boilerplate code. Leverages Lightning + Hydra. Focused on scalability, reproducibility and fast experimentation.
and many more! (checkout the #Your Superpowers section of the readme)
-
General and feature-rich PyTorch/Hydra project template for rapid and scalable ML experimentation, with a list of best practices
I write a LightningDatamodule. I found it to be an intuitive way to encapsulate any dataset. LightningDatamodule is a simple abstraction providing methods for data download, split, transforms and exposing dataloaders. Would love to see more researchers try out this concept, even in projects which don't use pytorch lightning. Reading LightningDatamodule makes me immedietely see how the dataset is prepared, while it seems like most data science projects throw around data logic across different parts of the pipeline, making it hard to understand what's going on. You can see example of such datamodule here
-
[P] General and feature-rich PyTorch/Hydra template for rapid and scalable ML research/experimentation, with a list of best practices
I feel like most ML people don't use those tools because they simply don't realize all the advantages (especially Hydra seems like a very useful addition to any deep learning project). I focused on structuring the readme in a way, which (I hope) will give you a quick overview - my hope is it can help to spread the word about those frameworks in a broaded community. It incorporates best practices and tricks I gathered over the last couple of months of playing around with it.
What are some alternatives?
When comparing garage and lightning-hydra-template you can also consider the following projects:
Metaworld - Collections of robotics environments geared towards benchmarking multi-task and meta reinforcement learning
lightning-hydra-template - Deep Learning project template best practices with Pytorch Lightning, Hydra, Tensorboard.
metaworld - Collections of robotics environments geared towards benchmarking multi-task and meta reinforcement learning [Moved to: https://github.com/Farama-Foundation/Metaworld]
pytorch_tempest - My repo for training neural nets using pytorch-lightning and hydra
VMAgent - Our VMAgent is a platform for exploiting Reinforcement Learning (RL) on Virtual Machine (VM) scheduling tasks.
neptune-client - 📘 The MLOps stack component for experiment tracking
nn-template - Generic template to bootstrap your PyTorch project.
lightning-transformers - Flexible components pairing 🤗 Transformers with :zap: Pytorch Lightning
rl_lib - Series of deep reinforcement learning algorithms 🤖
traingenerator - 🧙 A web app to generate template code for machine learning
agents - TF-Agents: A reliable, scalable and easy to use TensorFlow library for Contextual Bandits and Reinforcement Learning.
neptune-contrib - This library is a location of the LegacyLogger for PyTorch Lightning.
garage vs Metaworld
lightning-hydra-template vs lightning-hydra-template
garage vs metaworld
lightning-hydra-template vs pytorch_tempest
garage vs VMAgent
lightning-hydra-template vs neptune-client
garage vs nn-template
lightning-hydra-template vs lightning-transformers
garage vs rl_lib
lightning-hydra-template vs traingenerator
garage vs agents
lightning-hydra-template vs neptune-contrib