procgen VS RustyNEAT

Is there a single-task, multi-scene environment using continuous action spaces? Single-task and multi-scene envs are similar to gym-super-mario-bros and CoinRun in procgen .But they are all discrete action spaces. Thank you!!!!!

And now "bigfish" from the procgen Gym environments, tested on Stable Baselines 3. (No success)

It's not exactly a tutorial, but OpenSpiel has C++ environments ported to Python that are relatively simple and easy to understand. Procgen would be a more complicated reference to check out as well.

If you want to really speed up your environment several orders of magnitude, you can implement it in cuda/vulkan /opencl. Here is an example of what I did in vulkan https://mobile.twitter.com/MendozaDrosik It allows me to stimulate thousands of agents in parallel. Works wonders especially if you want to use genetic algorithms. If you're interested, I might make python bindings to my minecraft environment. If you write in rust (like I do), then you can add python bindings very easily with PyO3. This is what I did here https://github.com/aleksander-mendoza/RustyNEAT/blob/main/rusty_neat_quick_guide.py (it's GPU accelerated implementation of NEAT algorithm)