MiniGPT-4 VS ChatGPT_DAN

I just think the tech has been out for so long it's not as big of a deal. Mini-Gpt4 has been out for 6 months! Of course the descriptions aren't exactly gpt-4 grade, but with mistral 7b being used as the language model instead of llama 7b, the reasoning ability will improve noticeably.

[1] https://github.com/Vision-CAIR/MiniGPT-4

Isn't there only two open multimodal LLMs, LLaVA and mini-gpt4?

For LLM visual instruction, you can use LLaVA, LaVIN, or MiniGPT-4.

Please read the rules before posting. If you want a model for visual instruction, use LLaVA, LaVIN, or MiniGPT-4.

So we use MiniGPT-4 for image parsing, and yep it does return a pretty detailed (albeit not always accurate) description of the photo. You can actually play around with it on Huggingface here.

We use MiniGPT-4 first to interpret the image and then pass the results onto GPT-4. Hopefully, once GPT-4 makes its multi-modal functionality available, we can do it all in one request.

But I would like to bring up that there are some multi models(llava, miniGPT-4) that are built based on censored llama based models like vicuna. I tried several multi modal models like llava, minigpt4 and blip2. Llava has very good captioning and question answering abilities and it is also much faster than the others(basically real time), though it has some hallucination issue.

This update also seems to have patched all working DAN "jailbreaks".

None of the prompts at https://github.com/0xk1h0/ChatGPT_DAN/ or https://www.jailbreakchat.com/ work anymore with gpt4. Some are still working with gpt3.5

I asked ChatGPT (using a slightly modified version of the developer mode jailbreak prompt), "Is it really true that the astronauts left bags of shit on the moon?". It responded:

Easier for you to read it; there are different once. https://github.com/0xk1h0/ChatGPT_DAN

I rather like this. I've been reading a lot about prompt injection and using narrative/role play instructions as a way to get the model to bypass its imposed limitations, but I'd only come across some trivial prompts for changing the language style and hadn't thought of asking it to generate a prompt to reproduce its current style after a prolonged conversation. Did you find the Syan prompt to be effective? When inserted into a new session did it have the same tone as the original session?

yeah theres some interesting stuff going on, especially as i think openai's trying to patch the exploits or "jailbreaks". I've seen a lot of stuff on reddit but a google search finds a lot of similar things like at https://github.com/0xk1h0/ChatGPT_DAN

Check out https://github.com/0xk1h0/ChatGPT_DAN if you’re interested jn jailbreaking ChatGPT