Ppo

Open-source projects categorized as Ppo
Edit details
Language: + Python + Jupyter Notebook
Topics: reinforcement-learning Pytorch deep-reinforcement-learning Deep Learning Ddpg
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
Sponsored

Top 23 Ppo Open-Source Projects

  • tianshou

    An elegant PyTorch deep reinforcement learning library.

    • Project mention: Is it better to not use the Target Update Frequency in Double DQN or depends on the application? | /r/reinforcementlearning | 2023-07-05

    The tianshou implementation I found at https://github.com/thu-ml/tianshou/blob/master/tianshou/policy/modelfree/dqn.py is DQN by default.

  • cleanrl

    High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

    • Project mention: [P] PettingZoo 1.24.0 has been released (including Stable-Baselines3 tutorials) | /r/reinforcementlearning | 2023-08-24

    PettingZoo 1.24.0 is now live! This release includes Python 3.11 support, updated Chess and Hanabi environment versions, and many bugfixes, documentation updates and testing expansions. We are also very excited to announce 3 tutorials using Stable-Baselines3, and a full training script using CleanRL with TensorBoard and WandB.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • Reinforcement-Learning

    Learn Deep Reinforcement Learning in 60 days! Lectures & Code in Python. Reinforcement Learning + Deep Learning (by andri27-ts)

  • ElegantRL

    Massively Parallel Deep Reinforcement Learning. 🔥

  • pytorch-a2c-ppo-acktr-gail

    PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).

  • minimalRL

    Implementations of basic RL algorithms with minimal lines of codes! (pytorch based)

  • FinRL-Trading

    For trading. Please star.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo

  • PPO-PyTorch

    Minimal implementation of clipped objective Proximal Policy Optimization (PPO) in PyTorch

  • on-policy

    This is the official implementation of Multi-Agent PPO (MAPPO).

  • Super-mario-bros-PPO-pytorch

    Proximal Policy Optimization (PPO) algorithm for Super Mario Bros

  • PPO-for-Beginners

    A simple and well styled PPO implementation. Based on my Medium series: https://medium.com/@eyyu/coding-ppo-from-scratch-with-pytorch-part-1-4-613dfc1b14c8.

  • autonomous-learning-library

    A PyTorch library for building deep reinforcement learning agents.

  • Deep-Reinforcement-Learning-Algorithms

    32 projects in the framework of Deep Reinforcement Learning algorithms: Q-learning, DQN, PPO, DDPG, TD3, SAC, A2C and others. Each project is provided with a detailed training log.

  • DeepRL-TensorFlow2

    🐋 Simple implementations of various popular Deep Reinforcement Learning algorithms using TensorFlow2

  • HALOs

    A library with extensible implementations of DPO, KTO, PPO, and other human-aware loss functions (HALOs).

    • Project mention: On Sleeper Agent LLMs | news.ycombinator.com | 2024-01-13

    If you are using no-code solutions, increasing an "idea" in a dataset will make that idea more likely to appear.

    If you are fine-tuning your own LLM, there are other ways to get your idea to appear. In the literature this is sometimes called RLHF or preference optimization, and here are a few approaches:

    Direct Preference Optimization

    This uses Elo-scores to learn pairwise preferences. Elo is used in chess and basketball to rank individuals who compete in pairs.

    @argilla_io on X.com has been doing some work in evaluating DPO.

    Here is a decent thread on this: https://x.com/argilla_io/status/1745057571696693689?s=20

    Identity Preference Optimization

    IPO is research from Google DeepMind. It removes the reliance of Elo scores to address overfitting issues in DPO.

    Paper: https://x.com/kylemarieb/status/1728281581306233036?s=20

    Kahneman-Tversky Optimization

    KTO is an approach that uses mono preference data. For example, it asks if a response is "good or not." This is helpful for a lot of real word situations (e.g. "Is the restaurant well liked?").

    Here is a brief discussion on it:

    https://x.com/ralphbrooks/status/1744840033872330938?s=20

    Here is more on KTO:

    * Paper: https://github.com/ContextualAI/HALOs/blob/main/assets/repor...

    * Code: https://github.com/ContextualAI/HALOs

  • machin

    Reinforcement learning library(framework) designed for PyTorch, implements DQN, DDPG, A2C, PPO, SAC, MADDPG, A3C, APEX, IMPALA ...

  • pytorch-learn-reinforcement-learning

    A collection of various RL algorithms like policy gradients, DQN and PPO. The goal of this repo will be to make it a go-to resource for learning about RL. How to visualize, debug and solve RL problems. I've additionally included playground.py for learning more about OpenAI gym, etc.

  • gym-continuousDoubleAuction

    A custom MARL (multi-agent reinforcement learning) environment where multiple agents trade against one another (self-play) in a zero-sum continuous double auction. Ray [RLlib] is used for training.

  • Contra-PPO-pytorch

    Proximal Policy Optimization (PPO) algorithm for Contra

  • episodic-transformer-memory-ppo

    Clean baseline implementation of PPO using an episodic TransformerXL memory

    • Project mention: Question about Transformer model input in RL | /r/reinforcementlearning | 2023-06-17

    Check out this implementation https://github.com/MarcoMeter/episodic-transformer-memory-ppo

  • recurrent-ppo-truncated-bptt

    Baseline implementation of recurrent PPO using truncated BPTT

  • deep_rl_zoo

    A collection of Deep Reinforcement Learning algorithms implemented with PyTorch to solve Atari games and classic control tasks like CartPole, LunarLander, and MountainCar.

  • rl_lib

    Series of deep reinforcement learning algorithms 🤖

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Ppo related posts

Index

What are some of the best open-source Ppo projects? This list will help you:

Project Stars
1 tianshou 7,406
2 cleanrl 4,459
3 Reinforcement-Learning 4,091
4 ElegantRL 3,436
5 pytorch-a2c-ppo-acktr-gail 3,423
6 minimalRL 2,725
7 FinRL-Trading 1,875
8 PPO-PyTorch 1,453
9 on-policy 1,125
10 Super-mario-bros-PPO-pytorch 970
11 PPO-for-Beginners 639
12 autonomous-learning-library 638
13 Deep-Reinforcement-Learning-Algorithms 580
14 DeepRL-TensorFlow2 573
15 HALOs 525
16 machin 381
17 pytorch-learn-reinforcement-learning 139
18 gym-continuousDoubleAuction 136
19 Contra-PPO-pytorch 128
20 episodic-transformer-memory-ppo 108
21 recurrent-ppo-truncated-bptt 105
22 deep_rl_zoo 90
23 rl_lib 27

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com