popgym
Partially Observable Process Gym (by proroklab)
ml-agents
The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning. (by Unity-Technologies)
| popgym | ml-agents | |
|---|---|---|
| 4 | 60 | |
| 147 | 16,416 | |
| 8.8% | 1.4% | |
| 6.1 | 8.0 | |
| about 1 month ago | 9 days ago | |
| Python | C# | |
| MIT License | GNU General Public License v3.0 or later |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
popgym
Posts with mentions or reviews of popgym.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-25.
-
What RL library supports custom LSTM and Transformer neural networks to use with algorithms such as PPO?
POPGym is based on RLlib and has two linear transformers and five or six RNN variants, including LSTM. I've found that transformers tend to perform pretty poorly in RL when compared to RNNs.
-
POPGym: Partially Observable Reinforcement Learning
Code: https://github.com/proroklab/popgym
-
TransformerXL + PPO Baseline + MemoryGym
Have you seen this other ICLR paper, POPGym? Paper: https://openreview.net/forum?id=chDrutUTs0K Code: https://github.com/smorad/popgym
-
Partially observable Continuous Control Gym Environment
https://github.com/smorad/popgym contains 15 partially observable gym environments, but they use discrete actino spaces. I've verified that memoryless models (e.g. PPO+MLP) cannot solve these tasks, except for the navigation ones.
ml-agents
Posts with mentions or reviews of ml-agents.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-08.
- How do I change the maximum number of steps for training
- are the install steps update to date?
-
Help with regenerating new worker id
I am a beginner to using ML Agents to simulate an environment for DL i am trying to trial runs by tinkering through different values between the action space and keep encountering this issue when attempting to run a new trial. I've tried mlagents-learn --force and mlagents-learn --run-id=newtest but both prompt the same error message. Using linux, I am aware of a similar bug occuring in older versions (https://github.com/Unity-Technologies/ml-agents/issues/1505) but solutions didn't fix it.
-
Trying to get into AI
The Github page for ML-Agents has a fairly straight forward example.
- Implement API to allow AI/ML to play your game, or is it not needed?
-
Is there a good alternative to Unity ML Agents?
Very few commits in the last year and not many new features (https://github.com/Unity-Technologies/ml-agents/commits/develop)
-
At least I put effort into the AI prompt to generate some code that people can refer to, whereas you do absolutely nothing to contribute to the community.
and PR content: https://github.com/Unity-Technologies/ml-agents/commit/ed212103e451449bf84711a4a8f7bf11dfb1211a
-
I have some questions as an absolute beginner.
Unity can build a stand-alone application or be used as a library. Javascript is deprecated, and Boo along with it although it was never really supported to begin with. Various types of machine learning are supported through the ML-Agent Toolkit and pretty well documented. The toolkit has a Python API but you should be careful about doing anything too unusual in Unity because the documentation tends to have a lot of dead-ends.
-
Could Somebody please help me figure this out ? been struggling with it for a week now
Op, I'd just pull the repo again to a new folder from https://github.com/Unity-Technologies/ml-agents (use SourceTree for simplicity if you don't know git).
-
Unity ML-Agents documentation is wrong, I can't build an executable and run training as the docs state
My github issue on their documentation: https://github.com/Unity-Technologies/ml-agents/issues/5899
What are some alternatives?
When comparing popgym and ml-agents you can also consider the following projects:
recurrent-ppo-truncated-bptt - Baseline implementation of recurrent PPO using truncated BPTT
gym - A toolkit for developing and comparing reinforcement learning algorithms.
brain-agent - Brain Agent for Large-Scale and Multi-Task Agent Learning
AirSim - Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research
episodic-transformer-memory-ppo - Clean baseline implementation of PPO using an episodic TransformerXL memory
carla - Open-source simulator for autonomous driving research.
ppo-implementation-details - The source code for the blog post The 37 Implementation Details of Proximal Policy Optimization
AssetStudio - AssetStudio is a tool for exploring, extracting and exporting assets and assetbundles.
adaptive-transformers-in-rl - Adaptive Attention Span for Reinforcement Learning
unity-avatar-generation - A minimal example of how to use Unity's AvatarBuilder.BuildHumanAvatar API.
DI-engine - OpenDILab Decision AI Engine
ultimate-volleyball - 3D RL Volleyball environment built on Unity ML-Agents
popgym vs recurrent-ppo-truncated-bptt
ml-agents vs gym
popgym vs brain-agent
ml-agents vs AirSim
popgym vs episodic-transformer-memory-ppo
ml-agents vs carla
popgym vs ppo-implementation-details
ml-agents vs AssetStudio
popgym vs adaptive-transformers-in-rl
ml-agents vs unity-avatar-generation
popgym vs DI-engine
ml-agents vs ultimate-volleyball