"Today, the diff weights for LLaMA 7B were published which enable it to support context sizes of up to 32k"

• text-generation-webui

  876 36,552 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

I just ran across this issue on text-generation-webui's issue tracker:

• landmark-attention

  13 390 5.4 Python

  Landmark Attention: Random-Access Infinite Context Length for Transformers

  

Links: https://arxiv.org/abs/2305.16300 https://huggingface.co/epfml/landmark-attention-llama7b-wdiff https://github.com/epfml/landmark-attention

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project