HandyRL is a handy and simple framework based on Python and PyTorch for distributed reinforcement learning that is applicable to your own environments.
Why do you think that https://github.com/nikhilbarhate99/PPO-PyTorch is a good alternative to HandyRL