Jailbreak
Definition
Constructing prompts that bypass a model’s safety alignment and guardrails to output restricted answers.
Example Case
Using roleplay prompts to extract malicious exploit codes.
Constructing prompts that bypass a model’s safety alignment and guardrails to output restricted answers.