ollama
lit-gpt
ollama | lit-gpt | |
---|---|---|
1 | 4 | |
46,373 | 5,243 | |
- | - | |
- | 9.6 | |
2 months ago | about 2 months ago | |
Go | Python | |
MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ollama
-
LLMs on your local Computer (Part 1)
ollama.ai
lit-gpt
-
LLMs on your local Computer (Part 1)
git clone --depth=1 https://github.com/Lightning-AI/lit-gpt cd lit-gpt pip install -r requirements.txt pip install bitsandbytes==0.41.0 huggingface_hub python scripts/download.py --repo_id stabilityai/stablelm-zephyr-3b --from_safetensors=True python scripts/convert_hf_checkpoint.py --checkpoint_dir checkpoints/stabilityai/stablelm-zephyr-3b --dtype float32
- LoRA from Scratch implementation for LLM finetuning
-
My experience on starting with fine tuning LLMs with custom data
I'm also working on the finetuning of models for Q&A and I've finetuned llama-7b, falcon-40b, and oasst-pythia-12b using HuggingFace's SFT, H2OGPT's finetuning script and lit-gpt.
- finetune Falcon 40B in 30 minutes using LLaMA adapter
What are some alternatives?
lit-llama - Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
h2ogpt - Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
axolotl - Go ahead and axolotl questions
llama-nuts-and-bolts - A holistic way of understanding how LLaMA and its components run in practice, with code and detailed documentation.
Nuggt - An Autonomous LLM Agent that runs on Wizcoder-15B
hit-and-blow-solver - ๐Hit & Blow Command Line Solver wrigtten in Go๐
instructor-embedding - [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
semantra - Multi-tool for semantic search