orbit
IsaacGymEnvs
orbit | IsaacGymEnvs | |
---|---|---|
3 | 8 | |
822 | 1,642 | |
19.5% | 5.9% | |
9.5 | 3.9 | |
6 days ago | 10 days ago | |
Python | Python | |
GNU General Public License v3.0 or later | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
orbit
- NVIDIA Orbit - Unified framework for robot learning
- Nvidia-Omniverse/Orbit: Unified framework for robot learning
-
What is the limit on parallel environments?
Although Gym/Gymnasium allows you to generate vectorized parallel environments, if you want to train in hundreds or thousands of environments you will need to use the NVIDIA simulator repertoire (Isaac Gym, Isaac Orbit or Omniverse Isaac Gym).
IsaacGymEnvs
-
What is the limit on parallel environments?
Although Gym/Gymnasium allows you to generate vectorized parallel environments, if you want to train in hundreds or thousands of environments you will need to use the NVIDIA simulator repertoire (Isaac Gym, Isaac Orbit or Omniverse Isaac Gym).
-
How to optimize custom gym environment for GPU
Otherwise, I'd suggest checking out the Isaac Gym paper and the Isaac Gym Envs repo.
-
Showing the "good" values does not help the PPO algorithm?
in the given environment (https://github.com/NVIDIA-Omniverse/IsaacGymEnvs/blob/main/isaacgymenvs/tasks/franka_cabinet.py), the task for the robot is to open a cabinet. The action values, which are the output of the agent, are the target velocity values for the robot's joints.
-
Has anyone experience using/implementing "masking action" in Isaac Gym?
can it be implemented in the task-level scripts (i.e. ant.py, FrankaCabinet.py etc.) like this?
-
[Material advice] Learn reinforcement leanring
IsaacGymEnvs
-
Simulating robotic arm for object manipulation
And here are some reinforcment learning examples.
-
What Happened to OpenAI + RL?
Gym has been great at standardizing API and providing a baseline set of environments. However, parallelizing environments with original Gym interface is cumbersome, and new simulators are being introduced with their own ways of doing things. It's not clear to me that Gym is still useful today, from a research perspective.
-
[D] MuJoCo vs PyBullet? (esp. for custom environment)
If you already have experience in PyBullet then its probably not worth switching to Mujoco for creating custom environments. However, if you have the GPU compute for it, I'd recommend checking out Isaac Gym. GPU acceleration is great for spawning a bunch of envs for domain randomization, and it's already been used by recent research to get some great results that have previously taken a ridiculous amount of CPU compute.
What are some alternatives?
OmniIsaacGymEnvs - Reinforcement Learning Environments for Omniverse Isaac Gym
MuJoCo_RL_UR5 - A MuJoCo/Gym environment for robot control using Reinforcement Learning. The task of agents in this environment is pixel-wise prediction of grasp success chances.
stable-baselines3 - PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.
dm_control - Google DeepMind's software stack for physics-based simulation and Reinforcement Learning environments, using MuJoCo.
skrl - Modular reinforcement learning library (on PyTorch and JAX) with support for NVIDIA Isaac Gym, Isaac Orbit and Omniverse Isaac Gym
robo-gym - An open source toolkit for Distributed Deep Reinforcement Learning on real and simulated robots.
PythonRobotics - Python sample codes for robotics algorithms.
Unity-Robotics-Hub - Central repository for tools, tutorials, resources, and documentation for robotics simulation in Unity.
gym3 - Vectorized interface for reinforcement learning environments
awesome-isaac-gym - A curated list of awesome NVIDIA Issac Gym frameworks, papers, software, and resources