autonomous-learning-library
Meta-SAC
| autonomous-learning-library | Meta-SAC | |
|---|---|---|
| 2 | 1 | |
| 639 | 28 | |
| - | - | |
| 7.6 | 0.0 | |
| 2 months ago | almost 3 years ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
autonomous-learning-library
-
What's the best "Non-Black Box" framework for SOTA algorithms?
I find Autonomous Learning Library well-designed and clean, despite its modularity to some degree.
-
Where do people get their algorithm implementations from?
I very strongly recommend the autonomous learning library: https://github.com/cpnota/autonomous-learning-library
Meta-SAC
-
Do policy gradient methods also require some mechanism for exploration?
A simple approach that can help is a linear entropy schedule: Start at a high value to explore early, decay over time to learn a more optimal policy. Some variants of SAC autotune the entropy over time. A more advanced approach is AGAC, which does something like a GAN to encourage the PPO/A2C policy to explore by forcing it to be less predictable. There are many approaches, these are just a sample
What are some alternatives?
pytorch-a2c-ppo-acktr-gail - PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).
f-IRL - Inverse Reinforcement Learning via State Marginal Matching, CoRL 2020
PPO-PyTorch - Minimal implementation of clipped objective Proximal Policy Optimization (PPO) in PyTorch
tianshou - An elegant PyTorch deep reinforcement learning library.
deep_rl_zoo - A collection of Deep Reinforcement Learning algorithms implemented with PyTorch to solve Atari games and classic control tasks like CartPole, LunarLander, and MountainCar.
learning-to-drive-in-5-minutes - Implementation of reinforcement learning approach to make a car learn to drive smoothly in minutes
Tetris-deep-Q-learning-pytorch - Deep Q-learning for playing tetris game
Fleet-AI - Using Reinforcement Learning to play Battleship
turtlebot3_ddpg_collision_avoidance - Mapless Collision Avoidance of Turtlebot3 Mobile Robot Using DDPG and Prioritized Experience Replay
skrl - Modular reinforcement learning library (on PyTorch and JAX) with support for NVIDIA Isaac Gym, Isaac Orbit and Omniverse Isaac Gym
deep_control - Deep Reinforcement Learning for Continuous Control in PyTorch