Recomendations of framework/library for MARL

This page summarizes the projects mentioned and recommended in the original post on /r/reinforcementlearning

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • Mava

    🦁 A research-friendly codebase for fast experimentation of multi-agent reinforcement learning in JAX

  • I'm new to MARL and I'm looking for some open source implementations that I could use in a project. I have some previous experience in single agent RL, mainly with SB3 and gym, but just now started reading some MARL papers. I'm mainly looking for a good balance between performance, good documentation and ease of use. So far, I've taken look at Mava and RLlib. Mava seems like a very complete option, though I'm not at all familiar with the API and it maybe something simpler could also do the trick. As for the environment library, I was considering PettingZoo, since it has a very similar api to gym. Thought I might as well ask here first, as people can suggest other options for me to investigate or even give me some pros and cons they have learned from past experience.

  • epymarl

    An extension of the PyMARL codebase that includes additional algorithms and environment support

  • If you're thinking of pettingzoo, you should try https://github.com/uoe-agents/epymarl. I use it actively for my work.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • acme

    A library of reinforcement learning components and agents

  • Recently dm-acme also added support for multi-agent environments. Acme: https://github.com/deepmind/acme

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts