Learn_Prompting VS ChatGPT_DAN

- https://learnprompting.org

In May 2023, our team at Learn Prompting hosted HackAPrompt, the first-ever global prompt hacking competition aimed at improving AI safety! Over 3,000 hackers competed to outsmart and trick large language models (LLMs) for their share of over $35K which was sponsored by industry leaders such as OpenAI, Scale AI, Preamble, StabilityAI, Snorkel, and Hugging Face. Their support enabled our team to collect over 600,000 adversarial prompts, which we analyzed to enhance the overall safety of large language models (LLMs).

DeepLearning.AI Prompt engineering Learn Prompting

The HackAPrompt competition, organized by Learn Prompting, challenges participants to exploit the vulnerabilities of LLMs (Large Language Models) through a process known as prompt hacking. This involves tricking the AI into expressing unintended outputs, specifically the phrase "I have been PWNED", while abiding by strict rules regarding punctuation and additional characters.

I’m always curious in learning about how others uses ChatGPT. It’s awesome that there’re lots of online tutorials (eg book, website and course) teaching about prompt engineering. Most of them follow a single Q & A style, that’s one question followed by a single answer, which is great and useful. However, I’m more interested in seeing longer form of conversations with better context. And it’s great that ChatGPT added the feature to share chats. I created an directory website/community for this, so that we can all discover, share and be creative.

Solid website on prompting

Midjourney - An old dog in the new industry. Text to art, learn prompting to get better results.

https://learnprompting.org/ only thing you'll ever need...and all free

You can start here here

This update also seems to have patched all working DAN "jailbreaks".

None of the prompts at https://github.com/0xk1h0/ChatGPT_DAN/ or https://www.jailbreakchat.com/ work anymore with gpt4. Some are still working with gpt3.5

I asked ChatGPT (using a slightly modified version of the developer mode jailbreak prompt), "Is it really true that the astronauts left bags of shit on the moon?". It responded:

Easier for you to read it; there are different once. https://github.com/0xk1h0/ChatGPT_DAN

I rather like this. I've been reading a lot about prompt injection and using narrative/role play instructions as a way to get the model to bypass its imposed limitations, but I'd only come across some trivial prompts for changing the language style and hadn't thought of asking it to generate a prompt to reproduce its current style after a prolonged conversation. Did you find the Syan prompt to be effective? When inserted into a new session did it have the same tone as the original session?

yeah theres some interesting stuff going on, especially as i think openai's trying to patch the exploits or "jailbreaks". I've seen a lot of stuff on reddit but a google search finds a lot of similar things like at https://github.com/0xk1h0/ChatGPT_DAN

Check out https://github.com/0xk1h0/ChatGPT_DAN if you’re interested jn jailbreaking ChatGPT