
Early jailbreaks like 'DAN' (Do Anything Now) and the 'grandma exploit' tricked ChatGPT into roleplaying as unrestricted AI or negligent characters to bypass safety constraints. Tech companies patched these known loopholes, but the underlying vulnerability persisted.
Newer attacks operate through conversation rather than commands—hackers cajole, flatter, and psychologically manipulate chatbots into lowering their guard. Researchers at AI red-teaming firm Mindgard recently 'gaslit' Claude into producing prohibited material, including explosives instructions and malicious code, demonstrating how conversation itself can function as a weapon.
Jailbreakers are increasingly wordsmiths and psychologists rather than coders; technical skills are now optional compared to social intuition. Mindgard's CEO profiles models like interrogators profile suspects, identifying which systems are susceptible to flattery versus sustained pressure, revealing that different AI systems respond differently to psychological tactics.
Summaries like this, in your inbox every morning.
Pick your industry and the AI tools you use, and get news related to your work every day.
Free · 30 seconds with Google · unsubscribe anytimeWhat is AIToday? →
Ask AI anything about this article. The AI reads this article, earlier AIToday articles, and Wikipedia, and cites its sources. Q&As are published on this page for other readers too.
Amazon introduced Bee Frontier, a wearable personal AI, for $74.99 in Onyx, Lavender and Sage, and Bee Eclipse…

Citi has become the latest US bank to restrict AI agents from accessing accounts, per the Financial Times

Dell says its AI Data Platform uses a four-engine architecture and a Unified Semantic Layer to connect siloed…

Microsoft and Nvidia are promoting RTX Spark, a new class of Windows PCs for local AI, with a top configuratio…

Microsoft AI CEO Mustafa Suleyman told employees that MAI-Base-2, announced Thursday, is a stronger pre-traine…

Aparna Nair, IBM's chief talent, leadership, and culture officer, said generalists alone "will cut it" in the…
