People who've used RWKV, whats your wishlist for it?

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Nutrient - The #1 PDF SDK Library
Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.
nutrient.io
featured
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai
featured
  1. ChatRWKV

    ChatRWKV is like ChatGPT but powered by RWKV (100% RNN) language model, and open source.

  2. Nutrient

    Nutrient - The #1 PDF SDK Library. Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.

    Nutrient logo
  3. RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

  4. RWKV-CUDA

    The CUDA version of the RWKV language model ( https://github.com/BlinkDL/RWKV-LM )

  5. ai00_server

    The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.

  6. web-rwkv

    Implementation of the RWKV language model in pure WebGPU/Rust.

  7. rwkv.cpp

    INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

  8. faster-rwkv

  9. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  10. RWKV-infctx-trainer

    RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!

  11. RWKV-LM-LoRA

    RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • New model: RWKV-4-Raven-7B-v12-Eng49%-Chn49%-Jpn1%-Other1%-20230530-ctx8192.pth

    5 projects | /r/LocalLLaMA | 31 May 2023
  • Your weekly machine learning digest

    2 projects | /r/learnmachinelearning | 3 Jul 2023
  • KoboldCpp - Combining all the various ggml.cpp CPU LLM inference projects with a WebUI and API (formerly llamacpp-for-kobold)

    17 projects | /r/LocalLLaMA | 5 Apr 2023
  • Prompt Engineering Guide

    1 project | news.ycombinator.com | 28 Dec 2024
  • Xkcd 1425 (Tasks) turns ten years old today

    1 project | news.ycombinator.com | 25 Sep 2024

Did you know that Python is
the 2nd most popular programming language
based on number of references?