RL Agent Library to use graph in spaces

This page summarizes the projects mentioned and recommended in the original post on /r/reinforcementlearning

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • gym

    A toolkit for developing and comparing reinforcement learning algorithms.

  • graph_nets

    Build Graph Nets in Tensorflow

  • I don't know if any RL library includes an already implemented agent that can process graphs. However there are a number of deep learning frameworks that can help with the implementation of graph neural networks, especially Graph Nets (based on Tensorflow) and PyTorch Geometric. You might need to modify an existing RL agent to make use of one of these frameworks. If you are not familiar with GNNs you can look up these surveys. This article may also be of interest to you: it tackles graph-based environments, and the paper's code is available (it has a custom implementation of A2C and uses PyTorch Geometric -- btw it doesn't use Gym's space.graph since this feature is very recent in Gym).

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • pytorch_geometric

    Graph Neural Network Library for PyTorch

  • I don't know if any RL library includes an already implemented agent that can process graphs. However there are a number of deep learning frameworks that can help with the implementation of graph neural networks, especially Graph Nets (based on Tensorflow) and PyTorch Geometric. You might need to modify an existing RL agent to make use of one of these frameworks. If you are not familiar with GNNs you can look up these surveys. This article may also be of interest to you: it tackles graph-based environments, and the paper's code is available (it has a custom implementation of A2C and uses PyTorch Geometric -- btw it doesn't use Gym's space.graph since this feature is very recent in Gym).

  • sr-drl

    Implementation of Symbolic Relational Deep Reinforcement Learning based on Graph Neural Networks

  • I don't know if any RL library includes an already implemented agent that can process graphs. However there are a number of deep learning frameworks that can help with the implementation of graph neural networks, especially Graph Nets (based on Tensorflow) and PyTorch Geometric. You might need to modify an existing RL agent to make use of one of these frameworks. If you are not familiar with GNNs you can look up these surveys. This article may also be of interest to you: it tackles graph-based environments, and the paper's code is available (it has a custom implementation of A2C and uses PyTorch Geometric -- btw it doesn't use Gym's space.graph since this feature is very recent in Gym).

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts