semantra
Multi-tool for semantic search (by freedmand)
GPTQ-for-LLaMa
4 bits quantization of LLaMa using GPTQ (by iwalton3)
| semantra | GPTQ-for-LLaMa | |
|---|---|---|
| 17 | 2 | |
| 2,287 | 8 | |
| - | - | |
| 4.9 | 7.5 | |
| 5 days ago | about 1 year ago | |
| Python | Python | |
| MIT License | - |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
semantra
Posts with mentions or reviews of semantra.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-09-20.
- Semantra: Multi-Tool for Semantic Search
-
Show HN: SeaGOAT – local, “AI-based” grep for semantic code search
Semantra! Shared it yesterday on HN https://github.com/freedmand/semantra
- Show HN: Semantra – local, private semantic search engine for your files
-
Serverless Semantic Search, Free tier only
[2] https://github.com/freedmand/semantra (author of this tool)
-
My experience on starting with fine tuning LLMs with custom data
Yep, same. This works decently well: https://github.com/freedmand/semantra
-
Document digest & oobabooga
I've been wondering how long it'd take this project to add support for something like Semantra so I'm glad you're into it.
-
Instruct-guided novel writing using WizardLM-30B-Uncensored (with SillyTavern)
It's kind of like a more more applicable version of Semantra for content generation.
-
ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
That's a big part of the reason I built the open source tool Semantra[1]. I only really trust the semantic search part of this problem as it is constrained by context, so I tried to make the user experience good on top of simpler semantic search without any chatbot capabilities.
[1] https://github.com/freedmand/semantra
-
Best model to act as info hub for preppers?
My dream assistant would be one that can search through these offline files and bring back relevant information. I think the closest we have to this is the Semantra project.
-
VRAM limitations
Here, I'll be very blunt: I don't see any of these "The quick brown WizardLM jumps over the lazy Vicuna (Matata)" etc exciting much more people than just the member count of this subreddit any more than the already practically usable (and runs on even the low end iGPUs) kinda tools like Semantra.
GPTQ-for-LLaMa
Posts with mentions or reviews of GPTQ-for-LLaMa.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-05-23.
-
Instruct-guided novel writing using WizardLM-30B-Uncensored (with SillyTavern)
The backend for SillyTavern is provided by oobabooga's text-generation-webui, the GPTQ implementation is iwalton3's GPTQ-for-LLaMa fork providing support for act-order.
-
Fastest Inference Branch of GPTQ-for-LLaMA and Oobabooga (Linux and NVIDIA only)
Mh .. im using this fork: https://github.com/iwalton3/GPTQ-for-LLaMa. https://github.com/oobabooga/text-generation-webui/issues/1884 Im to lazy to compare speed, would soneone? :(
What are some alternatives?
When comparing semantra and GPTQ-for-LLaMa you can also consider the following projects:
SeaGOAT - local-first semantic code search engine
SillyTavern - LLM Frontend for Power Users.
uniteai - Your AI Stack in Your Editor
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
terraform-aws-lambd
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
chatdocs - Chat with your documents offline using AI.
SillyTavern - LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern]
terraform-aws-lambda - Terraform module, which takes care of a lot of AWS Lambda/serverless tasks (build dependencies, packages, updates, deployments) in countless combinations 🇺🇦
TALIS - Simple and fast server for GPTQ-quantized LLaMA inference
semantic-code-search - Search your codebase with natural language • CLI • No data leaves your computer
semantra vs SeaGOAT
GPTQ-for-LLaMa vs SillyTavern
semantra vs uniteai
GPTQ-for-LLaMa vs text-generation-webui
semantra vs terraform-aws-lambd
GPTQ-for-LLaMa vs GPTQ-for-LLaMa
semantra vs chatdocs
semantra vs SillyTavern
semantra vs SillyTavern
semantra vs terraform-aws-lambda
semantra vs TALIS
semantra vs semantic-code-search