LongNet

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens" (by kyegomez)

LongNet Alternatives

Similar projects and alternatives to LongNet

  • unilm

    40 LongNet VS unilm

    Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

  • long_llama

    LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transformer (FoT) method.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • Transformer-in-Transformer

    An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches (by Rishit-dagli)

  • PromptBroker

    Discontinued 🦊 The ONLY AI Prompts Broker you will ever need.

  • a-PyTorch-Tutorial-to-Transformers

    Attention Is All You Need | a PyTorch Tutorial to Transformers

  • Play-Billing-v6-For-Unity

    A Plugin for Unity which implements Google Play Billing Library v6.0.1 for in app products, made (mostly) by ChatGPT and GPT-4.

  • swarms

    1 LongNet VS swarms

    Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Real World Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  • nn

    26 LongNet VS nn

    🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better LongNet alternative or higher similarity.

LongNet reviews and mentions

Posts with mentions or reviews of LongNet. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-07-07.

Stats

Basic LongNet repo stats
16
651
9.0
4 months ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com