PrivateGPT4Linux
langchain
PrivateGPT4Linux | langchain | |
---|---|---|
23 | 152 | |
15 | 56,526 | |
- | - | |
4.1 | 10.0 | |
8 days ago | 9 months ago | |
Shell | Python | |
GNU General Public License v3.0 only | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
PrivateGPT4Linux
- PrivateGPT: Interact with your documents using the power of GPT, 100% privately, no data leaks
-
Need guidance in this sea of information on how to set up a local AI
I found things like this dataset and LocalAI and I followed the article to get PrivateGPT and the GPT4ALL groovy.bin but I'm completely lost and it feels like the more I research the internet or ask BingAI for answers, the more questions I get instead. At this stage I don't know what goes where, if there's a difference between source documents and datasets, should I run this from my 2tb SSD? Should I have the data on my 8tb HDD? Will all this even work on my PC?
-
Several newb questions
No, as the same as the last question, It does not have access to anything except the model data itself. However, there are some approaches that can let LLMs have access LOCAL documents, which means if you can have a program that extracts data from the database into a local folder which contains TEXT files. This could also work for 2(I didn't mention it in 2 because online datas are REALLY big. It would take the model hours to give an answer. If the database is not large then there might be a shot. Check https://github.com/imartinez/privateGPT(Must be GPT4all compatible models sadly).
-
What solution would best suite a SaaS - for reading and answering data from PDF files uploaded by users
I've been doing exactly this with an open source repository called PrivateGPT imartinez/privateGPT: Interact privately with your documents using the power of GPT, 100% privately, no data leaks (github.com)
- How to run an open source AI model, offline, on my own computer?
- Check out my script which installs privateGPT for Linux!
-
are there anytools or frameworks similar to "langchain" or "llamaindexbut implemented or designed in a language other than python?
Not really, you will probably need to change the data location and the LLM provider in the example code to get it running. But you don't have to implement that yourself there are a couple projects that already do that like privateGPT. I use it for searching datasheets, got it up an running in a few hours and I'm pretty happy with it so far.
-
Intern tasked to make a "local" version of chatGPT for my work
PrivateGPT can do that.
- I've made privateGPT work for Linux check it out (documents)
- I've made privateGPT work for Linux check it out
langchain
-
🗣️🤖 Ask to your Neo4J knowledge base in NLP & get KPIs
Langchain and the implementation of Custom Tools also is a great (and very efficient) way to setup a dedicated Q&A (for example for chat purpose) agent.
- LangChain – Some quick, high level thoughts on improvements/changes
-
Claude 2 Internal API Client and CLI
We're using it via langchain talking to Amazon Bedrock which is hosting Claude 1.x. It's comparable to GPT3.x, not bad. The integration doesn't seem to be fully there though, I think langchain is expecting "Human:" and "AI:", but Claude uses "Assistant:".
https://github.com/hwchase17/langchain/issues/2638
-
Any better alternatives to fine-tuning GPT-3 yet to create a custom chatbot persona based on provided knowledge for others to use?
Depending on how much work you want to put into it, you can get started at HuggingFace with their models and datasets, but you'd need compute power, multiple MLOps, etc. I was introduced to the concept in this video, since Google has their Vertex AI tools on Google Cloud, and there's always LangChain but I'm not sure about anything recent.
-
langchain VS griptape - a user suggested alternative
2 projects | 11 Jul 20232 projects | 9 Jul 2023
-
Vector storage is coming to Meilisearch to empower search through AI
a documentation chatbot proof of concept using GPT3.5 and LangChain
-
ChatPDF: What ChatGPT Can't Do, This Can!
I encourage everyone to pay attention to the Langchain open-source project and leverage it to achieve tasks that ChatGPT cannot handle.
- LangChain Arbitrary Command Execution - CVE-2023-34541
-
Langchain Is Pointless
Yeah I never know where memory goes exactly in langchain, it's not exactly clear all the time. But sure, the main insight I remember is this, take a look at their MULTI_PROMPT_ROUTER_TEMPLATE: https://github.com/hwchase17/langchain/blob/560c4dfc98287da1...
It's a lot of instructions for an LLM, they seem to forget an LLM is an auto-completion machine, and which data it is trained on. Using <<>> for sections is not a normal thing, it's not markdown, which probably the thing read way more often on the internet, instead of open json comments, why not type signatures, instead of so many rules, why not give it examples? It is an autocomplete machine!
They are relying too much on the LLM being smart because they probably only test stuff in GPT-4 and 3.5, but with GPT4All models this prompt was not working at all, so I had to rewrite it, for simple routing, we don't even need json, carying the `next_inputs` here is weird if you don't need it.
So this is my version of it: https://gist.github.com/rogeriochaves/b67676977eebb1936b9b5c...
It's so basic it's dumb, yet it is more powerful, as it does not rely on GPT-4 level intelligence, it's just what I needed
What are some alternatives?
private-gpt - Interact with your documents using the power of GPT, 100% privately, no data leaks
semantic-kernel - Integrate cutting-edge LLM technology quickly and easily into your apps
nanoGPT - The simplest, fastest repository for training/finetuning medium-sized GPTs.
llama_index - LlamaIndex is a data framework for your LLM applications
Voyager - An Open-Ended Embodied Agent with Large Language Models
llama - Inference code for Llama models
llm - An ecosystem of Rust libraries for working with large language models
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
llm-chain - `llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
gpt_index - LlamaIndex (GPT Index) is a project that provides a central interface to connect your LLM's with external data. [Moved to: https://github.com/jerryjliu/llama_index]
gorilla - Gorilla: An API store for LLMs
AutoGPT - AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.