pytorch-a2c-ppo-acktr-gail
Super-mario-bros-PPO-pytorch
Our great sponsors
pytorch-a2c-ppo-acktr-gail | Super-mario-bros-PPO-pytorch | |
---|---|---|
3 | 1 | |
3,423 | 970 | |
- | - | |
0.0 | 0.0 | |
almost 2 years ago | almost 3 years ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
pytorch-a2c-ppo-acktr-gail
-
How does advantage estimation is done when episodes are of variable length in PPO?
As an example look at "compute_returns" function here (and pay attention to how self.masks is used): https://github.com/ikostrikov/pytorch-a2c-ppo-acktr-gail/blob/master/a2c_ppo_acktr/storage.py
-
How to pretrain a model on expert data?
Try using an imitation learning algorithm. Two popular options are MaxEnt IRL and GAIL. This repository has GAIL implementation and this repository has MaxEnt IRL and GAIL implementation. There are other implementations too that you can check out.
-
Trying to Train PPO Agent for Pendulum-v0 from Pixel Inputs
For the PPO, I used this repo, which includes most tricks including GAE, normalized rewards, etc. I have verified this repo works for the traditional Pendulum-v0 task and Atari games (Pong and Breakout).
Super-mario-bros-PPO-pytorch
-
[AI application] AI agent plays Contra
if you are interested in Super mario bros, here you are https://github.com/uvipen/Super-mario-bros-PPO-pytorch
What are some alternatives?
soft-actor-critic - Implementation of the Soft Actor Critic algorithm using Pytorch.
stable-baselines3 - PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.
dm_control - Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.
muzero-general - MuZero
tensorforce - Tensorforce: a TensorFlow library for applied reinforcement learning
pytorch-learn-reinforcement-learning - A collection of various RL algorithms like policy gradients, DQN and PPO. The goal of this repo will be to make it a go-to resource for learning about RL. How to visualize, debug and solve RL problems. I've additionally included playground.py for learning more about OpenAI gym, etc.
TensorFlow2.0-for-Deep-Reinforcement-Learning - TensorFlow 2.0 for Deep Reinforcement Learning. :octopus:
stable-baselines - A fork of OpenAI Baselines, implementations of reinforcement learning algorithms
PCGrad - Code for "Gradient Surgery for Multi-Task Learning"
pybullet-gym - Open-source implementations of OpenAI Gym MuJoCo environments for use with the OpenAI Gym Reinforcement Learning Research Platform.
DI-engine - OpenDILab Decision AI Engine
chess - Program for playing chess in the console against AI or human opponents