web-rwkv
RWKV-infctx-trainer
| web-rwkv | RWKV-infctx-trainer | |
|---|---|---|
| 1 | 1 | |
| 192 | 123 | |
| - | 6.5% | |
| 9.6 | 9.7 | |
| 11 days ago | 16 days ago | |
| Rust | Jupyter Notebook | |
| GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
web-rwkv
RWKV-infctx-trainer
What are some alternatives?
RWKV-LM - RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
faster-rwkv
RWKV-CUDA - The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )
RWKV-LM-LoRA - RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
ai00_server - A localized open-source AI server that is better than ChatGPT.
ChatRWKV - ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.