Block-recurrent-transformer-py Alternatives

Similar projects and alternatives to block-recurrent-transformer-py

RWKV-LM

84 11,657 8.8 Python block-recurrent-transformer-py VS RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.
iris

8 756 1.9 Python block-recurrent-transformer-py VS iris

Transformers are Sample-Efficient World Models. ICLR 2023, notable top 5%. (by eloialonso)
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
heinsen_routing

7 160 2.7 Python block-recurrent-transformer-py VS heinsen_routing

Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.
block-recurrent-transformer-pytorch

1 204 5.0 Python block-recurrent-transformer-py VS block-recurrent-transformer-pytorch

Implementation of Block Recurrent Transformer - Pytorch

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better block-recurrent-transformer-py alternative or higher similarity.

Suggest an alternative to block-recurrent-transformer-py

block-recurrent-transformer-py reviews and mentions

Posts with mentions or reviews of block-recurrent-transformer-py. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-04-09.

From Deep to Long Learning
6 projects | news.ycombinator.com | 9 Apr 2023

that line of research is still going. https://github.com/lucidrains/block-recurrent-transformer-py... i think it is worth continuing research on both fronts.