privateGPT
AGiXT
privateGPT | AGiXT | |
---|---|---|
1 | 26 | |
50,198 | 2,456 | |
- | - | |
- | 9.9 | |
about 2 months ago | 6 days ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
privateGPT
-
PrivateGPT exploring the Documentation
# install developer tools xcode-select --install # create python sandbox mkdir PrivateGTP cd privateGTP/ python3 -m venv . # actiavte local context source bin/activate # privateGTP uses poetry for python module management privateGTP> pip install poetry # sync privateGTP project privateGTP> git clone https://github.com/imartinez/privateGPT # enable MPS for model loading and processing privateGTP> CMAKE_ARGS="-DLLAMA_METAL=on" pip install --force-reinstall --no-cache-dir llama-cpp-python privateGTP> cd privateGPT # Import configure python dependencies privateGTP> poetry run python3 scripts/setup # launch web interface to confirm operational on default model privateGTP> python3 -m private_gpt # navigate safari browser to http://localhost:8001/ # To bulk import documentation needed to stop the web interface as vector database not in multi-user mode privateGTP> [control] + "C" # import some PDFs privateGTP> curl "https://docs.intersystems.com/irislatest/csp/docbook/pdfs.zip" -o /tmp/pdfs.zip privateGTP> unzip /tmp/pdfs.zip -d /tmp # took a few hours to process privateGTP> make ingest /tmp/pdfs/pdfs/ # launch web interface again for query documentation privateGTP> python3 -m private_gpt
AGiXT
-
Conversational "memory loss"?
If you are more interested in AI assistants check out AGiXT. It has some really cool features but it is under heavy development. Not everything works jet and updates break sometimes already working functions. But it is still far better than babyAGI and other proof of concepts.
-
Microsoft Research proposes new framework, LongMem, allowing for unlimited context length along with reduced GPU memory usage and faster inference speed. Code will be open-sourced
That's exactly my goal right now too! I have been trying to figure out how to use AGiXT agents to read and write to an "Adventurer's Log" text file to try to mimic a long term memory but honestly I'm not good enough with any of this to get it working yet. The idea I've got rn is that there'd be a DM agent which takes your input and then there'd be "memory" agents which would check text files such as "Adventurer's Log" and "Character Interactions/Relationships" to keep a contiguous understanding of what each character has done, who they've met, what they've been told/haven't been told by certain characters about their motivations. I'm sure there's someone *much* more talented than me working on this already, at this point I've sort of given up on the idea and I'm just waiting for someone to come out with a Tavern style interface where I can paste in world details and character details and just get going!
- AGiXT: A local automation platform with memories and SmartGPT-like prompting. Works with Ooba/LCPP/GPT4All, and more
-
What are the best AI tools you've ACTUALLY used?
AGiXT: A Python package for AGI research.
-
?Best LLM service for a tiny home server
Even if my (for example, privateGPT) LLM is glacially slow I'd still love to be able to say "Mr Holmes, have Mrs Doubtfire verb the data object in order to verb a product for me, please." (eg: analyse the wikipedia article on the peace of westfalia in order to ELI5 a short summary of it). Hopefully she'd crunch away at the data, and at my convenience, I could have her brief me on her conclusions. I'm sure folks here would do something more clever using AGiXT, or having the old girl prepare lesson-plans for Mycroft to deliver (I just think that sort of thing is world-changing-bonkers for anyone wanting to learn anything, perhaps for kids one day), but I'd have to work up to that.
-
LlamaCPP and LangChain Agent Quality
Keep an eye on this project as well. https://github.com/Josh-XT/AGiXT
- Using the right prompt format makes responses so much better
-
How big of a jump is 13B Vicuna Uncensored vs 30B Vicuna Uncensored?
File upload and automatic agents. It exists it is just buggy. They are working at an insane pace building it. It is practically broke 90% of the time. Maybe it's working better right now. I had success with v1.1.31 as well. https://github.com/Josh-xt/AGiXT
-
Langchain, Langchain.js, vs AutoGPT for local agent development
Maybe you want to check out josh-xt/AGiXT it has its roots in langchain so you can see what the prompts look like and the code. They have made a lot of tools as well although you are going to have issues getting it to work. The newest version kinda works and version 1.1.31 I had the fast API backend working. Maybe you can help them out. They need more people to show them bugs. https://github.com/Josh-XT/AGiXT
-
Is there an alternative to AgentGPT that I can run on my CPU with 32 GB of RAM?
https://github.com/Josh-XT/AGiXT I have tested this one and it is pretty much the same as AgentGPT, supports many providers + many local models (you can even make it work with oobabooga api which is pretty easy), don’t wait for insane results, the problem right now is context length with the local models, probably going to be an old issue in a few weeks we hope ;)
What are some alternatives?
localGPT - Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.
AgentOoba - An autonomous AI agent extension for Oobabooga's web ui
anything-llm - The all-in-one Desktop & Docker AI application with full RAG and AI Agent capabilities.
private-gpt - Interact with your documents using the power of GPT, 100% privately, no data leaks
gpt4all - gpt4all: run open-source LLMs anywhere
AgentGPT - 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.
h2ogpt - Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
babyagi
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
vault-ai - OP Vault ChatGPT: Give ChatGPT long-term memory using the OP Stack (OpenAI + Pinecone Vector Database). Upload your own custom knowledge base files (PDF, txt, epub, etc) using a simple React frontend.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]