block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch (by lucidrains)

Block-recurrent-transformer-pytorch Alternatives

Similar projects and alternatives to block-recurrent-transformer-pytorch

lucidrains
block-recurrent-transformer-pytorch
  1. RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. iris

    Transformers are Sample-Efficient World Models. ICLR 2023, notable top 5%. (by eloialonso)

  4. heinsen_routing

    Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.

  5. flash-attention-jax

    Implementation of Flash Attention in Jax

  6. Sentient

    Proactive intelligence across your apps (by existence-master)

  7. recurrent-memory-transformer-pytorch

    Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

  8. Stream

    Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

    Stream logo
  9. musiclm-pytorch

    Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

  10. PaLM-rlhf-pytorch

    Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

  11. audiolm-pytorch

    Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better block-recurrent-transformer-pytorch alternative or higher similarity.

block-recurrent-transformer-pytorch discussion

Log in or Post with

block-recurrent-transformer-pytorch reviews and mentions

Posts with mentions or reviews of block-recurrent-transformer-pytorch. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-04-09.
  • From Deep to Long Learning
    6 projects | news.ycombinator.com | 9 Apr 2023
    that line of research is still going. https://github.com/lucidrains/block-recurrent-transformer-py... i think it is worth continuing research on both fronts.

Stats

Basic block-recurrent-transformer-pytorch repo stats
1
220
3.3
11 months ago

Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Python is
the 2nd most popular programming language
based on number of references?