space-gym VS rl-baselines3-zoo

In case you want to take a look the envs are published here https://github.com/MIMUW-RL/space-gym

I'm trying to solve MountainCar-v0 enviroment from gymnasium with the A2C algorithm and the agent doesn't find a solution. I checked this so I added import stable_baselines3.common.sb2_compat.rmsprop_tf_like as RMSpropTFLike. Also checked the rl-baselines3-zoo for the hyperparameter tuning. So my code is:

RL Zoo3 (training framework): https://github.com/DLR-RM/rl-baselines3-zoo

I'm still new to the domain but wanted to shared some experimental data I've gathered from massive amount of experimentation. I don't have a strong understanding of the theory as I'm more of a software engineer than data scientist, but perhaps this will help other implementers. These notes are based on Stable Baselines 3 and RL Baselines3 Zoo with using PPO+LSTM (should apply generally to all the algos for the most part)

Try hyperparameter search. It's implemented here: https://github.com/DLR-RM/rl-baselines3-zoo for stable-baselines3. Hyperparameters make a huge difference in RL, much more than in supervised learning.

Integrating RL-baselines3-zoo

Hello, I've been running some tests of Double DQN with Stable Baselines 3 Zoo and to compare I'm using the graphs provided by Noisy Networks For Exploration.

- you can find tuned hyperparameters for DDPG, SAC, PPO in https://github.com/DLR-RM/rl-baselines3-zoo

For more complete implementation: https://github.com/DLR-RM/rl-baselines3-zoo

https://github.com/DLR-RM/rl-baselines3-zoo (PyTorch based, using https://github.com/DLR-RM/stable-baselines3)

We also release 100+ trained models in our experimental framework, the rl zoo: https://github.com/DLR-RM/rl-baselines3-zoo