- block-recurrent-transformer-pytorch VS iris
- block-recurrent-transformer-pytorch VS heinsen_routing
- block-recurrent-transformer-pytorch VS flash-attention-jax
- block-recurrent-transformer-pytorch VS block-recurrent-transformer-py
- block-recurrent-transformer-pytorch VS Sentient
- block-recurrent-transformer-pytorch VS recurrent-memory-transformer-pytorch
- block-recurrent-transformer-pytorch VS RWKV-LM
- block-recurrent-transformer-pytorch VS musiclm-pytorch
- block-recurrent-transformer-pytorch VS PaLM-rlhf-pytorch
- block-recurrent-transformer-pytorch VS audiolm-pytorch
Block-recurrent-transformer-pytorch Alternatives
Similar projects and alternatives to block-recurrent-transformer-pytorch
-
RWKV-LM
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
-
InfluxDB
InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
-
-
heinsen_routing
Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.
-
-
-
recurrent-memory-transformer-pytorch
Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
-
Stream
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
-
musiclm-pytorch
Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch
-
PaLM-rlhf-pytorch
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
-
audiolm-pytorch
Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch
block-recurrent-transformer-pytorch discussion
block-recurrent-transformer-pytorch reviews and mentions
-
From Deep to Long Learning
that line of research is still going. https://github.com/lucidrains/block-recurrent-transformer-py... i think it is worth continuing research on both fronts.
Stats
lucidrains/block-recurrent-transformer-pytorch is an open source project licensed under MIT License which is an OSI approved license.
The primary programming language of block-recurrent-transformer-pytorch is Python.