Skip to content
AI Security

Interview question · AI Red Teaming, Evaluation & Response

What AI-specific telemetry should you log?

Design records for identity, context provenance, authorization and actual effects. Include missing-event coverage and a protected way to retrieve evidence.

mediumNewUpdated Nov 2026

Design records for identity, context provenance, authorization and actual effects. Include missing-event coverage and a protected way to retrieve evidence.

Make your first attempt

What would you say before reading the answer?

  1. 01 State the assumptions your answer depends on.
  2. 02 Explain the mechanism and choose a control.
  3. 03 Name a condition that would change your decision.

The worked answer includes an approach, scoring criteria and follow-up questions. Compare the reasoning with your own.

signing in unlocks more free answers per topic

What if · the follow-ups in this answer

The answer works through 4 follow-ups like an interviewer would

An original fictional maintenance assistant retrieves manuals, reads asset records and creates work orders. The logging budget cannot retain every full conversation.

  1. What if only document IDs are logged?
  2. What if the worker times out after sending the work order?
  3. What if all logs are shipped to a separate host?
  4. What would you test before accepting this telemetry design?

Each rung has a nudge, a model answer, the principle that carries over and the weak answer to avoid. Sign in free to open it.

UP NEXT ON YOUR JOURNEY
Next in this trackWhy do you still need human review with automated judges, and how do you validate an LLM judge?Next in this trackHow do you put security regression tests for prompts and guardrails into CI?Next in this trackIn an LLM red team engagement, what counts as a finding and what does not?
DISCUSSION · 0

No comments yet. Share a correction or a different way to answer it.