pybullet-gym VS reinforcement-learning-discord-wiki

And when something like "RL/Fortnite Racing" comes out, with shared inventory, it may work as the pilot "beta test" of RL finally working in UE5. At least the game's physics engine (pybullet.org) is independent of the graphics. https://x.com/CactousMan/status/1690437803711320064

From what I know in pybullet you define the system of the environment loading an urdf file. So if you check the InvertedPendulum environment of pybullet I think you could create your desired urdf without a problem. I have not used mujoco, but it seems strange that it could not do what you want to do... Maybe there is a parameter of the joints or some kind of tolerance for the initial position?

So far I found PyBullet, RobotPy, RobotDK, SOFA, and some others, but I wonder if there is something that is comparable or better than Unity 3D for this specific use case.

yeah, i guess compared to modeling tools like tinkercad, blender is not intuitive and hard to learn. im not aware of any FEM with blender but there's bullet, basis of https://pybullet.org/. blender has an omniverse connector now so it could probably be used in a pipeline with nvidia's isaac. https://developer.nvidia.com/isaac-sim https://developer.nvidia.com/blog/introducing-omniverse-usd-support-for-blender/

Programming is also really important when learning anything about machine learning and I would start out with the OpenAI Gym and its derivative for learning some of the simpler algorithms on toy environments that doesn't require a whole lot of computing power. Then you can move on to the more hardware constrained simulators that I mentioned in the previous comment (MuJoCo, PyBullet, NVIDIA Isaac Gym).

shout-out to the open-source clones of the mujoco gym environments here

There are a few good subreddits that I could recommend. If you want to go in the direction of RL then /r/reinforcementlearning is the one and I would highly suggest that you join the Discord server as well. People are really friendly there and provide a lot of help if you have questions.

This discord is pretty good https://github.com/andyljones/reinforcement-learning-discord-wiki/wiki

This is also a good resource if you are facing other problems.

We've got an active Discord here. Isn't explicitly a study group, but has plenty of other newbies asking questions.

Thank you for the kind words! I am also quite excited about the new points in game design space that RL will unlock and am planning write another blogpost on that topic.

I quite like https://karpathy.github.io/2016/05/31/rl/ as an introduction to some of the ideas behind modern RL. Beyond that, I just recently found out about https://github.com/andyljones/reinforcement-learning-discord... which lists a lot of other high-quality resources.

CodeCraft is a programming which you can "play" by writing a Scala/Java program that controls the game units. It's not actively developed anymore but still functional: http://codecraftgame.org/

This article is a collection of debugging advice that has served me well over the past few years. It's collated both from my personal experiences, and from several months of discussion in the RL Discord. It is intended as compliment to the other excellent advice that can be found elsewhere.

Every Saturday on the RL Discord we host a talk in the voice channel by a server regular. The talk is typically 10-30 mins long with questions and open discussion afterwards.

We've collated some recommendations on the RL Discord wiki.

There's a selection of popular resources on the RL Discord wiki.