SaaSHub helps you find the best software and product alternatives Learn more →
Top 23 Python Gym Projects
-
stable-baselines3
PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
Gymnasium
A standard API for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)
-
cleanrl
High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)
-
Project mention: RepDB Exercise Dataset alternatives - free-exercise-db, exercises-dataset, exercises.json, exercisedb-api, and wger | libhunt.com/r/exercise-dataset | 2026-10-27
-
-
PettingZoo
A standard API for multi-agent reinforcement learning environments, with popular reference environments and related utilities
-
rl-baselines3-zoo
A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.
-
-
-
gym-pybullet-drones
PyBullet Gymnasium environments for single and multi-agent reinforcement learning of quadcopter control
-
LightZero
[NeurIPS 2023 Spotlight] LightZero: A Unified Benchmark for Monte Carlo Tree Search in General Sequential Decision Scenarios (awesome MCTS)
-
reasoning-gym
[NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
-
Project mention: Reinforcement Learning Infrastructure for LLM Agents | news.ycombinator.com | 2025-12-17
-
-
skrl
Modular Reinforcement Learning (RL) library (implemented in PyTorch, JAX, and NVIDIA Warp) with support for Gymnasium/Gym, NVIDIA Isaac Lab, MuJoCo Playground and other environments
-
AgileRL
The complete post-training stack for LLMs, plus RL for any problem. SFT, DPO and multi-turn agentic RL, with evolutionary hyperparameter optimization built in.
-
safe-control-gym
PyBullet CartPole and Quadrotor environments—with CasADi symbolic a priori dynamics—for learning-based control and RL
-
deepdrive
Deepdrive is a simulator that allows anyone with a PC to push the state-of-the-art in self-driving
-
stable-baselines3-contrib
Contrib package for Stable-Baselines3 - Experimental reinforcement learning (RL) code
-
-
-
GoBigger
[ICLR 2023] Come & try Decision-Intelligence version of "Agar"! Gobigger could also help you with multi-agent decision intelligence study.
-
Python Gym discussion
Python Gym related posts
-
Gymnasium Release v1.0
-
Show HN: Ghidra Plays Mario
-
[P] PettingZoo 1.24.0 has been released (including Stable-Baselines3 tutorials)
-
[Question] Why there is so few algorithms implemented in SB3?
-
Show HN: Workout.lol – a web app to easily create a workout routine
-
PPO agent for "2048": help requested
-
Stable baselines! Where my people at?
-
A note from our sponsor - SaaSHub
www.saashub.com | 9 Nov 2026
Index
What are some of the best open-source Gym projects in Python? This list will help you:
| # | Project | Stars |
|---|---|---|
| 1 | stable-baselines3 | 13,966 |
| 2 | Gymnasium | 12,791 |
| 3 | cleanrl | 10,624 |
| 4 | wger | 7,242 |
| 5 | stable-baselines | 4,331 |
| 6 | PettingZoo | 3,552 |
| 7 | rl-baselines3-zoo | 2,908 |
| 8 | muzero-general | 2,864 |
| 9 | Minigrid | 2,541 |
| 10 | gym-pybullet-drones | 2,199 |
| 11 | LightZero | 1,660 |
| 12 | reasoning-gym | 1,545 |
| 13 | Gym | 1,321 |
| 14 | Super-mario-bros-PPO-pytorch | 1,306 |
| 15 | skrl | 1,104 |
| 16 | AgileRL | 964 |
| 17 | safe-control-gym | 932 |
| 18 | deepdrive | 926 |
| 19 | stable-baselines3-contrib | 744 |
| 20 | pytorch-A3C | 659 |
| 21 | ma-gym | 635 |
| 22 | GoBigger | 503 |
| 23 | Gym-Trading-Env | 500 |