Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Lit-gpt Alternatives
Similar projects and alternatives to lit-gpt
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
-
h2ogpt
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
lit-llama
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
-
ollama
Discontinued Get up and running with Llama 2, Mistral, Gemma, and other large language models. [Moved to: https://github.com/ollama/ollama] (by jmorganca)
-
QLoRA-LLM
A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.
lit-gpt reviews and mentions
-
LLMs on your local Computer (Part 1)
git clone --depth=1 https://github.com/Lightning-AI/lit-gpt cd lit-gpt pip install -r requirements.txt pip install bitsandbytes==0.41.0 huggingface_hub python scripts/download.py --repo_id stabilityai/stablelm-zephyr-3b --from_safetensors=True python scripts/convert_hf_checkpoint.py --checkpoint_dir checkpoints/stabilityai/stablelm-zephyr-3b --dtype float32
- LoRA from Scratch implementation for LLM finetuning
-
My experience on starting with fine tuning LLMs with custom data
I'm also working on the finetuning of models for Q&A and I've finetuned llama-7b, falcon-40b, and oasst-pythia-12b using HuggingFace's SFT, H2OGPT's finetuning script and lit-gpt.
- finetune Falcon 40B in 30 minutes using LLaMA adapter
-
A note from our sponsor - InfluxDB
www.influxdata.com | 3 May 2024
Stats
Lightning-AI/lit-gpt is an open source project licensed under Apache License 2.0 which is an OSI approved license.
The primary programming language of lit-gpt is Python.
Sponsored