gpt4-pdf-chatbot-langchain VS BrainChulo

I am playing around with this github project, which takes a user question as input and immediately runs a vector search on it to find relevant storied information before delivering an answer.

I am using this https://github.com/mayooear/gpt4-pdf-chatbot-langchain as a reference to ingest PDFs into pinecone and chat with a document, but my results aren’t good. Since it’s looking for related documents, there’s no good relation to the meta question: “What questions were asked in this interview?”

Anyone can already do this locally with their own API keys for free, with no technical knowledge by cloning a github repo (e.g. https://github.com/mayooear/gpt4-pdf-chatbot-langchain - this one can also chat with multiple pdfs which is much better). Even with gpt-4, I just don't find the responses useful usually. I find the model doesn't do great with scientific stuff aside from asking very basic things. Might have to wait for gpt-5.

https://github.com/mayooear/gpt4-pdf-chatbot-langchain this repo uses gpt-3.5/4 which uses OpenAI API. Is there any work donw with free/open-source LLMs

Follow this guide https://github.com/mayooear/gpt4-pdf-chatbot-langchain

I am using this one on windows 10. Took 2 evenings to set up: https://github.com/mayooear/gpt4-pdf-chatbot-langchain

Thanks for your take on the subject. I agree that starting from scratch would be too much. I think my post above might be misleading in regard to training. I wouldn't suggest to start from scratch but to provide additional data to a pretrained AI. But you can use GPT-4 (through API) in combination with pinecone to provide data. Here is a project, where someone implemented this to work with large PDF files. I don't think it would be too hard, to start from there and adapt the project to the requirements of OP. Obviously this would require paid for API keys. LLama could be also a good starting point, with a lot of resources available.

I'm currently developing a chatbot application that interacts with PDF documents using GPT API, Langchain, and a Pinecone vector database. The project is built on this repository: mayooear/gpt4-pdf-chatbot-langchain.

On BrainChulo, we’re going 100% guidance mode, see for instance an implementation of Chain of Thoughts on top of a thin guidance wrapper: https://github.com/ChuloAI/BrainChulo/blob/main/app/guidance_tooling/guidance_agent/agent.py

Awesome resource! If I may suggest that you'd add one, some friends and I are working on data retrieval with llm project as well, with our differentiating marker being that we are trying to implement guidance in order to improve the agent efficiency. If you guys wanna take a look :) https://github.com/ChuloAI/BrainChulo

Plug: https://github.com/iGavroche/BrainChulo - BrainChulo currently works on top of Ooba but uses its own UI interface. Its first goal is to provide a production-level way to do Retrieveal Augmentation on Open Source LLMs via vector stores and good prompt engineering.

Regarding this, I've joined a project that is doing some nice progress on this front. Still WIP but we're getting there, checkout BrainChulo :)

This is exactly what BrainChulo aims to do. You should check it out: https://github.com/CryptoRUSHGav/BrainChulo/ and feel free to drop on the discord to give us your feedback, your use-case, or if you need help getting started.

The download script is broken. I posted a working version on my repo: https://github.com/CryptoRUSHGav/BrainChulo

I'm hoping that many of you brilliant people can join me in our common quest to add long-term memory to our favorite camelid, Vicuna. The repository is called BrainChulo, and it's just waiting for your contributions.