Top 7 Python long-context Projects
-
MEGABYTE-pytorch
Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
recurrent-memory-transformer-pytorch
Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
-
InfLLM
The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"
-
InfiniteBench
Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
-
perceiver-ar-pytorch
Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: Ask HN: AI/ML papers to catch up with current state of AI? | news.ycombinator.com | 2023-12-15LongAlpaca / One of many ways to extend context, and a useful dataset / https://arxiv.org/abs/2309.12307
Project mention: [R] MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers | /r/MachineLearning | 2023-05-15
Project mention: Blockwise Parallel Transformer for Long Context Large Models | /r/LocalLLaMA | 2023-06-05
Project mention: InfLLM: LLMs for Understanding Long Sequences with Training-Free Memory | news.ycombinator.com | 2024-04-12
Python long-context related posts
Index
What are some of the best open-source long-context projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | LongLoRA | 2,454 |
2 | MEGABYTE-pytorch | 591 |
3 | RingAttention | 513 |
4 | recurrent-memory-transformer-pytorch | 381 |
5 | InfLLM | 206 |
6 | InfiniteBench | 189 |
7 | perceiver-ar-pytorch | 85 |
Sponsored