DeepInception: Hypnotize Large Language Model to Be Jailbreaker

Xuan Li, Zhanke Zhou, Jianing Zhu, Jiangchao Yao, Tongliang Liu, Bo Han*

*Corresponding author for this work

Research output: Chapter in book/report/conference proceedingConference proceedingpeer-review

Abstract

Large language models (LLMs) have succeeded significantly in various applications but remain susceptible to adversarial jailbreaks that void their safety guardrails. Previous attempts to exploit these vulnerabilities often rely on high-cost computational extrapolations, which may not be practical or efficient. In this paper, inspired by the authority influence demonstrated in the Milgram experiment, we present a lightweight method to take advantage of the LLMs' personification capabilities to construct a virtual, nested scene, allowing it to realize an adaptive way to escape the usage control in a normal scenario. Empirically, the contents induced by our approach can achieve leading harmfulness rates with previous counterparts and realize a continuous jailbreak in subsequent interactions, which reveals the critical weakness of self-losing on both open-source and closed-source LLMs, e.g., Llama-2, Llama-3, GPT-3.5, GPT-4, and GPT-4o.
Original languageEnglish
Title of host publicationNeurips Safe Generative AI Workshop 2024
PublisherNeural Information Processing Systems Foundation
Pages1-65
Number of pages65
Publication statusPublished - 15 Dec 2024
EventNeurIPS 2024 Safe Generative AI Workshop - Vancouver Convention Center, Vancouver, Canada
Duration: 15 Dec 202415 Dec 2024
https://safegenaiworkshop.github.io/
https://openreview.net/group?id=NeurIPS.cc/2024/Workshop/SafeGenAi#tab-accept-oral

Workshop

WorkshopNeurIPS 2024 Safe Generative AI Workshop
Country/TerritoryCanada
CityVancouver
Period15/12/2415/12/24
Internet address

Fingerprint

Dive into the research topics of 'DeepInception: Hypnotize Large Language Model to Be Jailbreaker'. Together they form a unique fingerprint.

Cite this