MAGIC
Auto-GPT
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
MAGIC
-
What if TTI was ran backwards? Like showing an image and asking what prompt it would need and conditions (temperature, top_k, etc) to generate that image. This might give us a better glimpse at how it wants to receive prompts.
yeah you could force a model to try to fill in a provided prompt template like that. Check this out: https://github.com/yxuansu/MAGIC
-
Cambridge AI Researchers Propose ‘MAGIC’: A Training-Free Framework That Plugs Visual Controls Into The Generation Of A Language Model
Github: https://github.com/yxuansu/magic
Auto-GPT
What are some alternatives?
OFA - Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework
mPLUG-Owl - mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model
CLIP-Caption-Reward - PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)
tree-of-thoughts - Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
GPT2-Chinese - Chinese version of GPT2 training code, using BERT tokenizer.
pautobot - 🔥 Your private task assistant with GPT 🔥 (1) Ask questions about your documents. (2) Automate tasks.
cappr - Completion After Prompt Probability. Make your LLM make a choice
YiVal - Your Automatic Prompt Engineering Assistant for GenAI Applications
CapDec - CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
igogpt - AutoGPT and other GPT and AI tools written in Golang