RingAttention Alternatives

Similar projects and alternatives to RingAttention based on common topics and language

• LongLoRA

  4 2,473 9.1 Python RingAttention VS LongLoRA

  Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

  

• Blockwise-Parallel-Transformer

  1 33 5.9 Python RingAttention VS Blockwise-Parallel-Transformer

  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers. (by kyegomez)

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• chatgpt_academic

  1 31,116 10.0 Python RingAttention VS chatgpt_academic

  Discontinued 为GPT/GLM提供图形交互界面，特别优化论文阅读润色体验，模块化设计支持自定义快捷按钮&函数插件，支持代码块表格显示，Tex公式双显示，新增Python和C++项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持清华chatglm等本地模型 [Moved to: https://github.com/binary-husky/gpt_academic]

• gpt_academic

  2 57,516 9.8 Python RingAttention VS gpt_academic

  为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

• InfLLM

  1 209 8.0 Python RingAttention VS InfLLM

  The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"

  

• InfiniteBench

  2 192 8.3 Python RingAttention VS InfiniteBench

  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718