Best PyTorch RL library for doing research

This page summarizes the projects mentioned and recommended in the original post on /r/reinforcementlearning

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • cleanrl

    High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)

  • cleanrl is the repo I base my code on, lots of single file implementations.

  • sample-factory

    High throughput synchronous and asynchronous reinforcement learning

  • I borrow a lot of performance tricks from sample factory, which is awesome but hard to modify from its original APPO algorithm. rlpyt was more modular, and I borrowed more ideas from it (namedarraytuple), but still too limited.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • rlpyt

    Reinforcement Learning in PyTorch

  • I borrow a lot of performance tricks from sample factory, which is awesome but hard to modify from its original APPO algorithm. rlpyt was more modular, and I borrowed more ideas from it (namedarraytuple), but still too limited.

  • tianshou

    An elegant PyTorch deep reinforcement learning library.

  • I tried tianshou and thought it was well-designed for modularity, but it was early in development when I tried and missing some basic features

  • stable-baselines3

    PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.

  • stable baselines 3 is really starting to shape up, but I personally think it's better as a reference guide, there's a bit too much abstraction for the sake of ease of first plot, I wouldn't want to have to modify it.

  • Deep-Reinforcement-Learning-Algorithms-with-PyTorch

    PyTorch implementations of deep reinforcement learning algorithms and environments

  • mbrl-lib

    Library for Model Based RL

  • MBRL-Lib for model-based RL

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • mtrl

    Discontinued Multi Task RL Baselines

  • MTRL for multi-task RL

  • machin

    Reinforcement learning library(framework) designed for PyTorch, implements DQN, DDPG, A2C, PPO, SAC, MADDPG, A3C, APEX, IMPALA ...

  • Machin is really nice, it is very easy to use and to try different things, although it’s developed by one person and maybe not appropriately tested yet.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts