lit-gpt
semantra
lit-gpt | semantra | |
---|---|---|
4 | 17 | |
5,243 | 2,287 | |
- | - | |
9.6 | 4.9 | |
2 months ago | 7 days ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
lit-gpt
-
LLMs on your local Computer (Part 1)
git clone --depth=1 https://github.com/Lightning-AI/lit-gpt cd lit-gpt pip install -r requirements.txt pip install bitsandbytes==0.41.0 huggingface_hub python scripts/download.py --repo_id stabilityai/stablelm-zephyr-3b --from_safetensors=True python scripts/convert_hf_checkpoint.py --checkpoint_dir checkpoints/stabilityai/stablelm-zephyr-3b --dtype float32
- LoRA from Scratch implementation for LLM finetuning
-
My experience on starting with fine tuning LLMs with custom data
I'm also working on the finetuning of models for Q&A and I've finetuned llama-7b, falcon-40b, and oasst-pythia-12b using HuggingFace's SFT, H2OGPT's finetuning script and lit-gpt.
- finetune Falcon 40B in 30 minutes using LLaMA adapter
semantra
- Semantra: Multi-Tool for Semantic Search
-
Show HN: SeaGOAT – local, “AI-based” grep for semantic code search
Semantra! Shared it yesterday on HN https://github.com/freedmand/semantra
- Show HN: Semantra – local, private semantic search engine for your files
-
Serverless Semantic Search, Free tier only
[2] https://github.com/freedmand/semantra (author of this tool)
-
My experience on starting with fine tuning LLMs with custom data
Yep, same. This works decently well: https://github.com/freedmand/semantra
-
Document digest & oobabooga
I've been wondering how long it'd take this project to add support for something like Semantra so I'm glad you're into it.
-
Instruct-guided novel writing using WizardLM-30B-Uncensored (with SillyTavern)
It's kind of like a more more applicable version of Semantra for content generation.
-
ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
That's a big part of the reason I built the open source tool Semantra[1]. I only really trust the semantic search part of this problem as it is constrained by context, so I tried to make the user experience good on top of simpler semantic search without any chatbot capabilities.
[1] https://github.com/freedmand/semantra
-
Best model to act as info hub for preppers?
My dream assistant would be one that can search through these offline files and bring back relevant information. I think the closest we have to this is the Semantra project.
-
VRAM limitations
Here, I'll be very blunt: I don't see any of these "The quick brown WizardLM jumps over the lazy Vicuna (Matata)" etc exciting much more people than just the member count of this subreddit any more than the already practically usable (and runs on even the low end iGPUs) kinda tools like Semantra.
What are some alternatives?
h2ogpt - Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
SeaGOAT - local-first semantic code search engine
axolotl - Go ahead and axolotl questions
uniteai - Your AI Stack in Your Editor
Nuggt - An Autonomous LLM Agent that runs on Wizcoder-15B
terraform-aws-lambd
instructor-embedding - [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
GPTQ-for-LLaMa - 4 bits quantization of LLaMa using GPTQ
chatdocs - Chat with your documents offline using AI.
SillyTavern - LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern]
SillyTavern - LLM Frontend for Power Users.
terraform-aws-lambda - Terraform module, which takes care of a lot of AWS Lambda/serverless tasks (build dependencies, packages, updates, deployments) in countless combinations 🇺🇦