Top 9 Python actor-critic Projects

cleanrl

41 4,459 6.3 Python

High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

Project mention: [P] PettingZoo 1.24.0 has been released (including Stable-Baselines3 tutorials) | /r/reinforcementlearning | 2023-08-24

PettingZoo 1.24.0 is now live! This release includes Python 3.11 support, updated Chess and Hanabi environment versions, and many bugfixes, documentation updates and testing expansions. We are also very excited to announce 3 tutorials using Stable-Baselines3, and a full training script using CleanRL with TensorBoard and WandB.

pytorch-a2c-ppo-acktr-gail

3 3,423 0.0 Python

PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
chainerrl

3 1,141 0.0 Python

ChainerRL is a deep reinforcement learning library built on top of Chainer.
pytorch-A3C

3 568 0.0 Python

Simple A3C implementation with pytorch + multiprocessing
episodic-transformer-memory-ppo

5 108 0.0 Python

Clean baseline implementation of PPO using an episodic TransformerXL memory

Project mention: Question about Transformer model input in RL | /r/reinforcementlearning | 2023-06-17

Check out this implementation https://github.com/MarcoMeter/episodic-transformer-memory-ppo

deep_rl_zoo

1 90 3.6 Python

A collection of Deep Reinforcement Learning algorithms implemented with PyTorch to solve Atari games and classic control tasks like CartPole, LunarLander, and MountainCar.
deep_control

1 87 1.8 Python

Deep Reinforcement Learning for Continuous Control in PyTorch
InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
actorch

2 12 2.5 Python

Deep reinforcement learning framework for fast prototyping based on PyTorch
soft-actor-critic

1 6 0.0 Python

Implementation of the Soft Actor Critic algorithm using Pytorch. (by thomashirtz)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python actor-critic related posts

How does advantage estimation is done when episodes are of variable length in PPO?
1 project | /r/reinforcementlearning | 7 Apr 2022
Help on what could be wrong on my TD3?
1 project | /r/reinforcementlearning | 6 Jun 2021
Soft Actor Critic Implementation
1 project | /r/reinforcementlearning | 12 May 2021
Trying to Train PPO Agent for Pendulum-v0 from Pixel Inputs
1 project | /r/reinforcementlearning | 10 Apr 2021

Index

What are some of the best open-source actor-critic projects in Python? This list will help you:

	Project	Stars
1	cleanrl	4,459
2	pytorch-a2c-ppo-acktr-gail	3,423
3	chainerrl	1,141
4	pytorch-A3C	568
5	episodic-transformer-memory-ppo	108
6	deep_rl_zoo	90
7	deep_control	87
8	actorch	12
9	soft-actor-critic	6