Landmark Attention Oobabooga Support + GPTQ Quantized Models!

• landmark-attention-qlora

  3 124 5.6 Python

  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA

We need more effort put into properly evaluating these models. It is still very early days and we are looking for some feedback on their performance/any issues you run into. Please feel free to chat with us! You can find a link in my QLoRA Repo. https://github.com/eugenepentland/landmark-attention-qlora

• landmark-attention

  13 390 5.4 Python

  Landmark Attention: Random-Access Infinite Context Length for Transformers

  

Thanks again to the team who worked on the original landmark paper for making this possible! https://github.com/epfml/landmark-attention They made an update to the repo and the code I wrote 4 days ago is now marked legacy so I'm in the process of updating it again...

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project