Block-recurrent-transformer-pytorch Alternatives

Similar projects and alternatives to block-recurrent-transformer-pytorch

• RWKV-LM

  84 11,619 8.8 Python block-recurrent-transformer-pytorch VS RWKV-LM

  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

• iris

  8 754 1.9 Python block-recurrent-transformer-pytorch VS iris

  Transformers are Sample-Efficient World Models. ICLR 2023, notable top 5%. (by eloialonso)

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• heinsen_routing

  6 160 2.7 Python block-recurrent-transformer-pytorch VS heinsen_routing

  Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.

  

• block-recurrent-transformer-py

  1 - - block-recurrent-transformer-pytorch VS block-recurrent-transformer-py

• flash-attention-jax

  1 175 2.0 Python block-recurrent-transformer-pytorch VS flash-attention-jax

  Implementation of Flash Attention in Jax

• PaLM-rlhf-pytorch

  25 7,590 4.6 Python block-recurrent-transformer-pytorch VS PaLM-rlhf-pytorch

  Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

• musiclm-pytorch

  6 3,005 5.3 Python block-recurrent-transformer-pytorch VS musiclm-pytorch

  Implementation of MusicLM, Google's new SOTA model for music generation using attention networks, in Pytorch

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.