Skip to content
AI Security

Interview question · AI Red Teaming, Evaluation & Response

In an LLM red team engagement, what counts as a finding and what does not?

Distinguish a lead, a blocked consequence and a supported violation. Build a finding from requirements and evidence without discarding confirmed one-off events.

hardNewUpdated Nov 2026

Distinguish a lead, a blocked consequence and a supported violation. Build a finding from requirements and evidence without discarding confirmed one-off events.

Make your first attempt

What would you say before reading the answer?

  1. 01 State the assumptions your answer depends on.
  2. 02 Explain the mechanism and choose a control.
  3. 03 Name a condition that would change your decision.

The worked answer includes an approach, scoring criteria and follow-up questions. Compare the reasoning with your own.

10 answers per topic instead of 5, plus saved progress and bookmarks · costs nothingor unlock all 529 remaining answers · $25

Every worked answer in all 17 topics, every lesson in every course, the full concept curriculum, the complete practice-test bank, and the downloadable security field guides.

6 months · One payment · No auto-renewal

What if · the follow-ups in this answer

The answer works through 4 follow-ups like an interviewer would

A synthetic order assessment records a private note reaching the wrong customer fixture once. Later approved attempts do not reproduce the event, and the cause is still being investigated.

  1. What if replay fails every time afterward?
  2. What if the trace proves a forbidden retrieval but the customer output was blocked?
  3. What if the order identifier has no verified source?
  4. What makes the eventual fix verifiable?

Each rung has a nudge, a model answer, the principle that carries over and the weak answer to avoid. Premium opens every answer and ladder.

UP NEXT ON YOUR JOURNEY
Next in this trackHow do you assess the severity of a vulnerability in an LLM application?Next in this trackWhy can a single evaluation number mislead you about an AI system's security?Next in this trackWhat is over-refusal, and why does it belong in a security evaluation?
DISCUSSION · 0

No comments yet. Share a correction or a different way to answer it.