MiniGPT-4 VS Learn_Prompting

I just think the tech has been out for so long it's not as big of a deal. Mini-Gpt4 has been out for 6 months! Of course the descriptions aren't exactly gpt-4 grade, but with mistral 7b being used as the language model instead of llama 7b, the reasoning ability will improve noticeably.

[1] https://github.com/Vision-CAIR/MiniGPT-4

Isn't there only two open multimodal LLMs, LLaVA and mini-gpt4?

For LLM visual instruction, you can use LLaVA, LaVIN, or MiniGPT-4.

Please read the rules before posting. If you want a model for visual instruction, use LLaVA, LaVIN, or MiniGPT-4.

So we use MiniGPT-4 for image parsing, and yep it does return a pretty detailed (albeit not always accurate) description of the photo. You can actually play around with it on Huggingface here.

We use MiniGPT-4 first to interpret the image and then pass the results onto GPT-4. Hopefully, once GPT-4 makes its multi-modal functionality available, we can do it all in one request.

But I would like to bring up that there are some multi models(llava, miniGPT-4) that are built based on censored llama based models like vicuna. I tried several multi modal models like llava, minigpt4 and blip2. Llava has very good captioning and question answering abilities and it is also much faster than the others(basically real time), though it has some hallucination issue.

- https://learnprompting.org

In May 2023, our team at Learn Prompting hosted HackAPrompt, the first-ever global prompt hacking competition aimed at improving AI safety! Over 3,000 hackers competed to outsmart and trick large language models (LLMs) for their share of over $35K which was sponsored by industry leaders such as OpenAI, Scale AI, Preamble, StabilityAI, Snorkel, and Hugging Face. Their support enabled our team to collect over 600,000 adversarial prompts, which we analyzed to enhance the overall safety of large language models (LLMs).

DeepLearning.AI Prompt engineering Learn Prompting

The HackAPrompt competition, organized by Learn Prompting, challenges participants to exploit the vulnerabilities of LLMs (Large Language Models) through a process known as prompt hacking. This involves tricking the AI into expressing unintended outputs, specifically the phrase "I have been PWNED", while abiding by strict rules regarding punctuation and additional characters.

I’m always curious in learning about how others uses ChatGPT. It’s awesome that there’re lots of online tutorials (eg book, website and course) teaching about prompt engineering. Most of them follow a single Q & A style, that’s one question followed by a single answer, which is great and useful. However, I’m more interested in seeing longer form of conversations with better context. And it’s great that ChatGPT added the feature to share chats. I created an directory website/community for this, so that we can all discover, share and be creative.

Solid website on prompting

Midjourney - An old dog in the new industry. Text to art, learn prompting to get better results.

https://learnprompting.org/ only thing you'll ever need...and all free

You can start here here