private-gpt VS AGiXT

PrivateGPT is a nice tool for this. It's not exactly what you're asking for, but it gets part of the way there.

https://github.com/zylon-ai/private-gpt

Further details available at: https://docs.privategpt.dev/api-reference/api-reference/ingestion

Run https://github.com/imartinez/privateGPT

Then

make ingest /path/to/folder/with/files

Then chat to the LLM.

Done.

Docs: https://docs.privategpt.dev/overview/welcome/quickstart

PrivateGPT repository in case anyone's interested: https://github.com/imartinez/privateGPT . It doesn't seem to be linked from their official website.

I’m preparing a small internal tool for my work to search documents and provide answers (with references), I’m thinking of using GPT4All [0], Danswer [1] and/or privateGPT [2].

The RAG technique is very close to what I have in mind, but I don’t want the LLM to “hallucinate” and generate answers on its own by synthesizing the source documents. As stated by many others, we’re living in interesting times.

[0] https://gpt4all.io/index.html

[1] https://www.danswer.ai/

[2] https://github.com/imartinez/privateGPT

https://www.reddit.com/r/LocalLLaMA/comments/14niv66/using_a...

https://github.com/imartinez/privateGPT

I've been playing around with https://github.com/imartinez/privateGPT and https://github.com/simonw/llm and wanted to create a simple Python package that made it easier to run ChatGPT-like LLMs on your own machine, use them with non-public data, and integrate them into practical applications.

This resulted in Python package I call OnPrem.LLM.

In the documentation, there are examples for how to use it for information extraction, text generation, retrieval-augmented generation (i.e., chatting with documents on your computer), and text-to-code generation: https://amaiya.github.io/onprem/

Enjoy!

If you are more interested in AI assistants check out AGiXT. It has some really cool features but it is under heavy development. Not everything works jet and updates break sometimes already working functions. But it is still far better than babyAGI and other proof of concepts.

That's exactly my goal right now too! I have been trying to figure out how to use AGiXT agents to read and write to an "Adventurer's Log" text file to try to mimic a long term memory but honestly I'm not good enough with any of this to get it working yet. The idea I've got rn is that there'd be a DM agent which takes your input and then there'd be "memory" agents which would check text files such as "Adventurer's Log" and "Character Interactions/Relationships" to keep a contiguous understanding of what each character has done, who they've met, what they've been told/haven't been told by certain characters about their motivations. I'm sure there's someone *much* more talented than me working on this already, at this point I've sort of given up on the idea and I'm just waiting for someone to come out with a Tavern style interface where I can paste in world details and character details and just get going!

AGiXT: A Python package for AGI research.

Even if my (for example, privateGPT) LLM is glacially slow I'd still love to be able to say "Mr Holmes, have Mrs Doubtfire verb the data object in order to verb a product for me, please." (eg: analyse the wikipedia article on the peace of westfalia in order to ELI5 a short summary of it). Hopefully she'd crunch away at the data, and at my convenience, I could have her brief me on her conclusions. I'm sure folks here would do something more clever using AGiXT, or having the old girl prepare lesson-plans for Mycroft to deliver (I just think that sort of thing is world-changing-bonkers for anyone wanting to learn anything, perhaps for kids one day), but I'd have to work up to that.

Keep an eye on this project as well. https://github.com/Josh-XT/AGiXT

File upload and automatic agents. It exists it is just buggy. They are working at an insane pace building it. It is practically broke 90% of the time. Maybe it's working better right now. I had success with v1.1.31 as well. https://github.com/Josh-xt/AGiXT

Maybe you want to check out josh-xt/AGiXT it has its roots in langchain so you can see what the prompts look like and the code. They have made a lot of tools as well although you are going to have issues getting it to work. The newest version kinda works and version 1.1.31 I had the fast API backend working. Maybe you can help them out. They need more people to show them bugs. https://github.com/Josh-XT/AGiXT

https://github.com/Josh-XT/AGiXT I have tested this one and it is pretty much the same as AgentGPT, supports many providers + many local models (you can even make it work with oobabooga api which is pretty easy), don’t wait for insane results, the problem right now is context length with the local models, probably going to be an old issue in a few weeks we hope ;)