llama.cpp
AutoGPT
Our great sponsors
llama.cpp | AutoGPT | |
---|---|---|
769 | 180 | |
56,891 | 161,405 | |
- | 2.0% | |
10.0 | 9.9 | |
1 day ago | 1 day ago | |
C++ | JavaScript | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama.cpp
-
Phi-3 Weights Released
well https://github.com/ggerganov/llama.cpp/issues/6849
- Lossless Acceleration of LLM via Adaptive N-Gram Parallel Decoding
- Llama.cpp Working on Support for Llama3
-
Embeddings are a good starting point for the AI curious app developer
Have just done this recently for local chat with pdf feature in https://recurse.chat. (It's a macOS app that has built-in llama.cpp server and local vector database)
Running an embedding server locally is pretty straightforward:
- Get llama.cpp release binary: https://github.com/ggerganov/llama.cpp/releases
- Mixtral 8x22B
- Llama.cpp: Improve CPU prompt eval speed
-
Ollama 0.1.32: WizardLM 2, Mixtral 8x22B, macOS CPU/GPU model split
Ah, thanks for this! I can't edit my parent comment that you replied to any longer unfortunately.
As I said, I only compared the contributors graphs [0] and checked for overlaps. But those apparently only go back about year and only list at most 100 contributors ranked by number of commits.
[0]: https://github.com/ollama/ollama/graphs/contributors and https://github.com/ggerganov/llama.cpp/graphs/contributors
-
KodiBot - Local Chatbot App for Desktop
KodiBot is a desktop app that enables users to run their own AI chat assistants locally and offline on Windows, Mac, and Linux operating systems. KodiBot is a standalone app and does not require an internet connection or additional dependencies to run local chat assistants. It supports both Llama.cpp compatible models and OpenAI API.
-
Mixture-of-Depths: Dynamically allocating compute in transformers
There are already some implementations out there which attempt to accomplish this!
Here's an example: https://github.com/silphendio/sliced_llama
A gist pertaining to said example: https://gist.github.com/silphendio/535cd9c1821aa1290aa10d587...
Here's a discussion about integrating this capability with ExLlama: https://github.com/turboderp/exllamav2/pull/275
And same as above but for llama.cpp: https://github.com/ggerganov/llama.cpp/issues/4718#issuecomm...
-
The lifecycle of a code AI completion
For those who might not be aware of this, there is also an open source project on GitHub called "Twinny" which is an offline Visual Studio Code plugin equivalent to Copilot: https://github.com/rjmacarthy/twinny
It can be used with a number of local model services. Currently for my setup on a NVIDIA 4090, I'm running both the base and instruct model for deepseek-coder 6.7b using 5_K_M Quantization GGUF files (for performance) through llama.cpp "server" where the base model is for completions and the instruct model for chat interactions.
llama.cpp: https://github.com/ggerganov/llama.cpp/
deepseek-coder 6.7b base GGUF files: https://huggingface.co/TheBloke/deepseek-coder-6.7B-base-GGU...
deepseek-coder 6.7b instruct GGUF files: https://huggingface.co/TheBloke/deepseek-coder-6.7B-instruct...
AutoGPT
- Accessible AI for Everyone
-
AGI has, in some sense, been achieved: Tell me why I am wrong
Define agency. Does AutoGPT or BabyAGI fit the definition?
-
The Emergence of Autonomous Agents
This leap is evident in projects like BabyAGI and AutoGPT, showcasing how such agents can prioritize and execute tasks based on a pre-defined objective and the results of previous actions, such as sales prospecting or ordering pizza.
- An experimental open-source attempt to make GPT-4 autonomous
-
[Long read] Deep dive into AutoGPT: A comprehensive and in-depth step-by-step guide to how it works
A system and a user message are constructed from the task given by the user in code and passed to the LLM as input.
-
1000 Member Celebration and FAQ
A: How much do you know? If you can easily read code (in this example Python, but this will still benefit anyone who can read code), you should check out Auto-GPT. If you are looking to explore different options, check out this doc on AI Agents.
-
Agents: An Open-source Framework for Autonomous Language Agents - AIWaves Inc 2023
Also I think most agents I have seen have implemented some form of long-short term memory. Why does it say autogpt doesnt support it? https://github.com/Significant-Gravitas/Auto-GPT/tree/master/autogpts/autogpt/autogpt/memory
-
MetaGPT: The Next Evolution or Just More Hype?
In my newest experiment, I try out MetaGPT, which is supposed to be better than AutoGPT according to MetaGPT's paper.
-
List of Awesome AI Agents like AutoGPT and BabyAGI / Many open-source Agents with code included!
In my opinion the most interesting Agents: Auto-GPT Github: https://github.com/Significant-Gravitas/Auto-GPT BabyAGI Github: https://github.com/yoheinakajima/babyagi Voyager Github: https://github.com/MineDojo/Voyager / Paper: https://arxiv.org/abs/2305.16291 I would also add: ChemCrow: Augmenting large-language models with chemistry tools Github: https://github.com/ur-whitelab/chemcrow-public/ Paper: https://arxiv.org/abs/2304.05376
-
We've released Auto-GPT v0.4.5!
Check out the new Re-Arch README and ARCHITECTURE_NOTES.
What are some alternatives?
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
langchain - ⚡ Building applications with LLMs through composability ⚡ [Moved to: https://github.com/langchain-ai/langchain]
gpt4all - gpt4all: run open-source LLMs anywhere
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
Auto-Vicuna
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
JARVIS - JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
ggml - Tensor library for machine learning
SuperAGI - <⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM
AgentGPT - 🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.