pytorch_geometric VS gym

https://github.com/pyg-team/pytorch_geometric/tree/master/examples any of the scripts ending in _segmentation.py can be used for semantic segmentation of point clouds

Here the code I'm referring to: https://github.com/pyg-team/pytorch_geometric/blob/master/examples/hetero/metapath2vec.py

Today version 2.3 got released: https://github.com/pyg-team/pytorch_geometric/releases/tag/2.3.0

Here is a working example for semantic segmentation with pointnet++ using PyTorch geometric. There are equivalent scripts for dgcnn, randlanet, point transformer in the same folder https://github.com/pyg-team/pytorch_geometric/blob/master/examples/pointnet2_segmentation.py

I don't know if any RL library includes an already implemented agent that can process graphs. However there are a number of deep learning frameworks that can help with the implementation of graph neural networks, especially Graph Nets (based on Tensorflow) and PyTorch Geometric. You might need to modify an existing RL agent to make use of one of these frameworks. If you are not familiar with GNNs you can look up these surveys. This article may also be of interest to you: it tackles graph-based environments, and the paper's code is available (it has a custom implementation of A2C and uses PyTorch Geometric -- btw it doesn't use Gym's space.graph since this feature is very recent in Gym).

Meanwhile, PyTorch-Geometric is 3 years old and 13K stars on Github.

https://github.com/pyg-team/pytorch_geometric

A pytorch implementation: https://github.com/rusty1s/pytorch_geometric

A co-founder announced they disbanded their robots team a couple years ago: https://venturebeat.com/business/openai-disbands-its-robotic...

That was the same time they depreciated OpenAI Gym: https://github.com/openai/gym

This includes single-agent Gymnasium wrappers for DM Control, DM Lab, Behavior Suite, Arcade Learning Environment, OpenAI Gym V21 & V26. Multi-agent PettingZoo wrappers support DM Control Soccer, OpenSpiel and Melting Pot. For more information, read the release notes here:

When I browse fetch_env.py, I have a question about the following code snippet:

Nvm, this works for me '!pip install setuptools==65.5.0' Source: https://github.com/openai/gym/issues/3176

how would this interact/compare with https://github.com/openai/gym?

If you'd like to learn more about reinforcement learning or play with a number of samples in controlled environments, I highly recommend you look at the documentation for OpenAI's Gym library and particularly the basic usage page. OpenAI's Gym provides a standardized environment for performing reinforcement learning on classic Atari games and a few other platforms and should be an educational resource. If you'd like a more detailed example, check out this tutorial on Paperspace's blog.

Frozen Lake is an OpenAI Gym environment in which an agent is rewarded for traversing a frozen surface from a start position to a goal position without falling through any perilous holes in the ice.

typically a more relaxed approach is taken via reinforcement learning, but it requires that you can simulate the game via a given gamestate. take a look at e.g. https://www.gymlibrary.dev/