Top 21 Python Ppo Projects

• tianshou

  8 7,356 9.5 Python

  An elegant PyTorch deep reinforcement learning library.

  

  Project mention: Is it better to not use the Target Update Frequency in Double DQN or depends on the application? | /r/reinforcementlearning | 2023-07-05

  The tianshou implementation I found at https://github.com/thu-ml/tianshou/blob/master/tianshou/policy/modelfree/dqn.py is DQN by default.

• cleanrl

  41 4,414 6.7 Python

  High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

  Project mention: [P] PettingZoo 1.24.0 has been released (including Stable-Baselines3 tutorials) | /r/reinforcementlearning | 2023-08-24

  PettingZoo 1.24.0 is now live! This release includes Python 3.11 support, updated Chess and Hanabi environment versions, and many bugfixes, documentation updates and testing expansions. We are also very excited to announce 3 tutorials using Stable-Baselines3, and a full training script using CleanRL with TensorBoard and WandB.

• InfluxDB

  www.influxdata.com

  sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• pytorch-a2c-ppo-acktr-gail

  3 3,423 0.0 Python

  PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).

• ElegantRL

  6 3,420 7.4 Python

  Massively Parallel Deep Reinforcement Learning. 🔥

  

• minimalRL

  5 2,725 1.6 Python

  Implementations of basic RL algorithms with minimal lines of codes! (pytorch based)

• PPO-PyTorch

  2 1,441 2.8 Python

  Minimal implementation of clipped objective Proximal Policy Optimization (PPO) in PyTorch

• on-policy

  12 1,114 5.4 Python

  This is the official implementation of Multi-Agent PPO (MAPPO).

  

• WorkOS

  workos.com

  sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• Super-mario-bros-PPO-pytorch

  1 950 0.0 Python

  Proximal Policy Optimization (PPO) algorithm for Super Mario Bros

• PPO-for-Beginners

  1 637 4.2 Python

  A simple and well styled PPO implementation. Based on my Medium series: https://medium.com/@eyyu/coding-ppo-from-scratch-with-pytorch-part-1-4-613dfc1b14c8.

• autonomous-learning-library

  2 637 7.6 Python

  A PyTorch library for building deep reinforcement learning agents.

• DeepRL-TensorFlow2

  2 573 0.0 Python

  🐋 Simple implementations of various popular Deep Reinforcement Learning algorithms using TensorFlow2

• HALOs

  1 518 8.6 Python

  A library with extensible implementations of DPO, KTO, PPO, and other human-aware loss functions (HALOs).

  

  Project mention: On Sleeper Agent LLMs | news.ycombinator.com | 2024-01-13

  If you are using no-code solutions, increasing an "idea" in a dataset will make that idea more likely to appear.

  If you are fine-tuning your own LLM, there are other ways to get your idea to appear. In the literature this is sometimes called RLHF or preference optimization, and here are a few approaches:

  Direct Preference Optimization

  This uses Elo-scores to learn pairwise preferences. Elo is used in chess and basketball to rank individuals who compete in pairs.

  @argilla_io on X.com has been doing some work in evaluating DPO.

  Here is a decent thread on this: https://x.com/argilla_io/status/1745057571696693689?s=20

  Identity Preference Optimization

  IPO is research from Google DeepMind. It removes the reliance of Elo scores to address overfitting issues in DPO.

  Paper: https://x.com/kylemarieb/status/1728281581306233036?s=20

  Kahneman-Tversky Optimization

  KTO is an approach that uses mono preference data. For example, it asks if a response is "good or not." This is helpful for a lot of real word situations (e.g. "Is the restaurant well liked?").

  Here is a brief discussion on it:

  https://x.com/ralphbrooks/status/1744840033872330938?s=20

  Here is more on KTO:

  * Paper: https://github.com/ContextualAI/HALOs/blob/main/assets/repor...

  * Code: https://github.com/ContextualAI/HALOs

• machin

  2 381 1.8 Python

  Reinforcement learning library(framework) designed for PyTorch, implements DQN, DDPG, A2C, PPO, SAC, MADDPG, A3C, APEX, IMPALA ...

• pytorch-learn-reinforcement-learning

  3 139 0.0 Python

  A collection of various RL algorithms like policy gradients, DQN and PPO. The goal of this repo will be to make it a go-to resource for learning about RL. How to visualize, debug and solve RL problems. I've additionally included playground.py for learning more about OpenAI gym, etc.

• Contra-PPO-pytorch

  7 128 0.0 Python

  Proximal Policy Optimization (PPO) algorithm for Contra

• episodic-transformer-memory-ppo

  5 106 0.0 Python

  Clean baseline implementation of PPO using an episodic TransformerXL memory

  Project mention: Question about Transformer model input in RL | /r/reinforcementlearning | 2023-06-17

  Check out this implementation https://github.com/MarcoMeter/episodic-transformer-memory-ppo

• deep_rl_zoo

  1 89 3.6 Python

  A collection of Deep Reinforcement Learning algorithms implemented with PyTorch to solve Atari games and classic control tasks like CartPole, LunarLander, and MountainCar.

• ai-traineree

  1 24 0.0 Python

  PyTorch agents and tools for (Deep) Reinforcement Learning

• actorch

  2 12 2.5 Python

  Deep reinforcement learning framework for fast prototyping based on PyTorch

• Simple-MADRL-Chess

  1 10 7.2 Python

  MADRL project solving chess environment using PPO with two different methods: 2 agents/networks and a single agent/network.

• Fleet-AI

  1 3 0.0 Python

  Using Reinforcement Learning to play Battleship

• SaaSHub

  www.saashub.com

  sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

Python Ppo related posts

• Using transformers in RL?
  1 project | /r/reinforcementlearning | 9 Apr 2023
• What RL library supports custom LSTM and Transformer neural networks to use with algorithms such as PPO?
  4 projects | /r/reinforcementlearning | 25 Mar 2023
• Trained a Transformer Decoder architecture with PPO, best way to maximize the entropy?
  1 project | /r/reinforcementlearning | 22 Mar 2023
• Does “massively parallel simulation” help advance Reinforcement Learning?
  1 project | news.ycombinator.com | 9 Dec 2022
• ElegantRL: Cloud-Native Deep Reinforcement Learning
  1 project | news.ycombinator.com | 1 Sep 2022
• I need suggestions to improve my project
  3 projects | /r/github | 6 Sep 2021
• My implementations of RL algorithms + demo and tutorial
  1 project | /r/deeplearning | 6 Sep 2021
• A note from our sponsor - SaaSHub
  www.saashub.com | 18 Apr 2024

  SaaSHub helps you find the best software and product alternatives Learn more →

Index

Sponsored

SaaSHub - Software Alternatives and Reviews

SaaSHub helps you find the best software and product alternatives

www.saashub.com

Do not miss the trending Python projects with our weekly report!