machin
rlpyt
machin | rlpyt | |
---|---|---|
2 | 4 | |
389 | 2,197 | |
- | - | |
1.8 | 0.0 | |
almost 3 years ago | over 3 years ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
machin
-
Best PyTorch RL library for doing research
Machin is really nice, it is very easy to use and to try different things, although it’s developed by one person and maybe not appropriately tested yet.
-
Is there a consensus about RL frameworks?
I found this repo very helpful to get started: https://github.com/iffiX/machin
rlpyt
-
About Prior Action Distribution in Entropy Regularized Actor-Critic Methods
The above example is from rlpyt library's SAC algorithm.
-
Best PyTorch RL library for doing research
I borrow a lot of performance tricks from sample factory, which is awesome but hard to modify from its original APPO algorithm. rlpyt was more modular, and I borrowed more ideas from it (namedarraytuple), but still too limited.
-
Spec for RL agent implementation?
rlpyt also has abstractions for additional things besides environments: https://github.com/astooke/rlpyt
-
PPO+LSTM Implementation
rlpyt is a library I’m studying right now, could be worth a shot; the code base is somewhat complex but after some reading it’s not so bad :)
What are some alternatives?
stable-baselines3 - PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.
cleanrl - High-quality single file implementation of Deep Reinforcement Learning algorithms with research-friendly features (PPO, DQN, C51, DDPG, TD3, SAC, PPG)
gym - A toolkit for developing and comparing reinforcement learning algorithms.
Apache Impala - Apache Impala
tianshou - An elegant PyTorch deep reinforcement learning library.
RL-Adventure - Pytorch Implementation of DQN / DDQN / Prioritized replay/ noisy networks/ distributional values/ Rainbow/ hierarchical RL
minimalRL - Implementations of basic RL algorithms with minimal lines of codes! (pytorch based)
acme - A library of reinforcement learning components and agents
ElegantRL - Massively Parallel Deep Reinforcement Learning. 🔥
sample-factory - High throughput synchronous and asynchronous reinforcement learning