localGPT VS gpt4-pdf-chatbot-langchain

I think local LLMs are great for tinkerers, and with quantization can run on most modern PCs. I am not comfortable sending over my personal data over to OpenAI/Anthropic, so I've been playing around with https://github.com/PromtEngineer/localGPT/, GPT4All, etc. which keep the data all local.

Sliding window chunking, RAG, etc. seem more sophisticated than the other document LLM tools, so I would love to try this out if you ever add the ability to run LLMs locally!

localGPT can parse PDF into embeddings, see <https://github.com/PromtEngineer/localGPT>.

This is going so fast that it feels like a new thing pops up every day. LocalGPT seems to have gotten a lot of traction though: https://github.com/PromtEngineer/localGPT

i am currently trying to use localGPT (https://github.com/PromtEngineer/localGPT) for a project and i encountered a problem.

I tinker a lot with electronics. I have put datasheets for components, documentation for development boards, documentation for software libraries, etc into a database with localGPT.

There are a bunch of other methods to improve quality and performance like tree-of-thought-llm, connecting a LLM to a database or have it review its own output.

Check out local gpt on git hub. I tried but it had slow response for me. Other developers are fine. https://github.com/PromtEngineer/localGPT

I am playing around with this github project, which takes a user question as input and immediately runs a vector search on it to find relevant storied information before delivering an answer.

I am using this https://github.com/mayooear/gpt4-pdf-chatbot-langchain as a reference to ingest PDFs into pinecone and chat with a document, but my results aren’t good. Since it’s looking for related documents, there’s no good relation to the meta question: “What questions were asked in this interview?”

Anyone can already do this locally with their own API keys for free, with no technical knowledge by cloning a github repo (e.g. https://github.com/mayooear/gpt4-pdf-chatbot-langchain - this one can also chat with multiple pdfs which is much better). Even with gpt-4, I just don't find the responses useful usually. I find the model doesn't do great with scientific stuff aside from asking very basic things. Might have to wait for gpt-5.

https://github.com/mayooear/gpt4-pdf-chatbot-langchain this repo uses gpt-3.5/4 which uses OpenAI API. Is there any work donw with free/open-source LLMs

Follow this guide https://github.com/mayooear/gpt4-pdf-chatbot-langchain

I am using this one on windows 10. Took 2 evenings to set up: https://github.com/mayooear/gpt4-pdf-chatbot-langchain

Thanks for your take on the subject. I agree that starting from scratch would be too much. I think my post above might be misleading in regard to training. I wouldn't suggest to start from scratch but to provide additional data to a pretrained AI. But you can use GPT-4 (through API) in combination with pinecone to provide data. Here is a project, where someone implemented this to work with large PDF files. I don't think it would be too hard, to start from there and adapt the project to the requirements of OP. Obviously this would require paid for API keys. LLama could be also a good starting point, with a lot of resources available.

I'm currently developing a chatbot application that interacts with PDF documents using GPT API, Langchain, and a Pinecone vector database. The project is built on this repository: mayooear/gpt4-pdf-chatbot-langchain.