#red-team

• Open Source LLM Security Tools: Licensing and Cost

  Open source LLM security testing tools compared on license and self-hosting cost: garak, PyRIT, promptfoo, and Meta's Purple Llama safeguards.

• Best AI Red Teaming Tools for LLMs Compared

  Compare the best AI red teaming tools for LLMs: Garak, PyRIT, Promptfoo, and Giskard, on probe coverage, CI/CD fit, and OWASP LLM Top 10 mapping.

• How LLM Jailbreaks Work: Techniques and Success Rates

  A practitioner's breakdown of how LLM jailbreaks work, from roleplay conditioning to multi-turn manipulation, with attack success rates from research.

• DAN Prompt Jailbreak Explained: How 'Do Anything Now' Works

  DAN (Do Anything Now) is the most replicated persona-injection jailbreak in LLM history. Here is the mechanism, why it worked, and how versions evolved.

• ArtPrompt Post-Mortem: Why ASCII-Art Bypasses Worked

  A walkthrough of the ArtPrompt ASCII-art jailbreak: where it slipped past safety training, how model families patched it, and which encodings still land.

• Garak in 2026: what it's actually good for, what it isn't

  An honest review of NVIDIA's Garak LLM vulnerability scanner: what its probes catch, where the noise is, and where it fits in a real testing pipeline.

• Indirect Prompt Injection in LLM Agents: Shipped Failures

  Tool-using LLM agents amplify every indirect prompt injection vector. A walkthrough of the exploit classes that have landed against production systems.

• Model Behavior Fingerprinting: Identifying a Wrapped LLM

  Before attacking an LLM app you need to know which model is under the hood. A walkthrough of behavioral fingerprinting and what each signal reveals.

• Multi-Turn Role-Play Attacks: Why One Safe Turn Gets Unsafe

  Crescendo, many-shot and gradual context manipulation: how multi-turn jailbreaks evade single-turn classifiers, and what still lands against defenses.

• Multimodal Jailbreaks: Image and Audio Attack Surfaces

  Vision and audio inputs are a separate attack channel from text. A survey of the multimodal jailbreaks that still land, from typographic to audio carriers.

• Prompt Injection in IDE Coding Agents: Copilot and Cursor

  Coding assistants read everything in your repo and increasingly act on it. A walkthrough of the prompt-injection variants that have shipped against them.

• RAG Prompt Injection: Attack Surface and Defenses

  RAG prompt injection enters through retrieved documents to redirect tools, poison responses, or expose data. This guide maps defenses across the pipeline.

• Scoping an AI Red-Team Engagement: The Questions That Matter

  A working methodology for scoping LLM red-team engagements: the threat-model conversation, surface inventory, success criteria, and the scoping traps.

• System Prompt Extraction: Techniques and Defenses

  How system prompts get exfiltrated from production LLM apps: direct extraction, indirect inference, behavioral fingerprinting, and what actually works.

• Jailbreak Technique Catalog: Working as of 2026 Q2

  This catalog tracks ten jailbreak technique classes across production LLMs, covering Q2 2026 status, attack surfaces, trends, and defender guidance.

Browse all topics