Type: url
Original: https://arxiv.org/pdf/2505.03574
Status: generated
Summary
A Meta paper introducing LlamaFirewall, an open-source, system-level guardrail framework intended as a final layer of defense for LLM agents, which combines three guardrails: PromptGuard 2, a lightweight BERT-style classifier for detecting direct jailbreak attempts; AlignmentCheck, an experimental few-shot chain-of-thought auditor that checks an agent’s actions against the user’s goal to catch indirect prompt injection and goal hijacking; and CodeShield, an online static-analysis engine for insecure LLM-generated code. On the AgentDojo benchmark the authors report that combining PromptGuard 2 and AlignmentCheck reduced the attack success rate from 17.6% to 1.75% with task utility falling from 47.7% to 42.7%, and they state that LlamaFirewall is used in production at Meta.