100K Context Windows

• contriever

  2 476 10.0 Python

  Discontinued Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning

  

• lora

  83 6,616 0.0 Jupyter Notebook

  Using Low-rank adaptation to quickly fine-tune diffusion models. (by cloneofsimo)

Open-source LLM projects have largely solved this using Low-Rank Adaptation of Large Language Models (LoRA): https://arxiv.org/abs/2106.09685

Apparently an RTX 4090 running overnight is sufficient to produce a fine-tuned model that can spit out new Harry Potter stories, or whatever...

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• finetune-transformer-lm

  4 2,068 10.0 Python

  Code and model for the paper "Improving Language Understanding by Generative Pre-Training"

  

[2] Original GPT Paper - https://s3-us-west-2.amazonaws.com/openai-assets/research-co...

• DocGPT

  7 35 10.0 Python

  Discontinued 💻📚💡 DoctorGPT provides advanced LLM prompting for PDFs and webpages. [Moved to: https://github.com/FeatureBaseDB/DoctorGPT] (by FeatureBaseDB)

  

Hey! Try this: https://github.com/featurebasedb/DocGPT

Holler if you want help with it. I have some more code I'm adding to it this week.

Suggest a related project