longformer

Longformer: The Long-Document Transformer (by allenai)

Longformer Alternatives

Similar projects and alternatives to longformer

  • Pytorch

    Tensors and Dynamic neural networks in Python with strong GPU acceleration

  • ChatGPTCLIBot

    ChatGPT Bot in CLI with long term memory support using Embeddings.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better longformer alternative or higher similarity.

longformer reviews and mentions

Posts with mentions or reviews of longformer. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-03-17.
  • NLP use case?
    1 project | /r/LanguageTechnology | 6 Jul 2023
    Not sure how you can do this with longer documents but one approach, semantic textual similarity, is to embed the texts into a set of vectors and compute for their distance using some metric (usually cosine similarity). The embeddings are usually based on a transformer network, you might be able to swap to a Longformer for longer texts.
  • [D] PyTorch 2.0 Native Flash Attention 32k Context Window
    4 projects | /r/MachineLearning | 17 Mar 2023
    This approach has been shown to work. Longformer even provided a script that did this for you: https://github.com/allenai/longformer/blob/master/scripts/convert_model_to_long.ipynb

Stats

Basic longformer repo stats
2
1,979
10.0
about 1 year ago

allenai/longformer is an open source project licensed under Apache License 2.0 which is an OSI approved license.

The primary programming language of longformer is Python.


Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com