Skip to content
AI Security

Interview question · LLM Application Security

A customer says your chatbot showed them another user's data. What do you check first?

An incident question disguised as debugging. The answer that scores treats it as a possible breach, preserves evidence, and checks the four usual causes in order of likelihood.

mediumNewPreparation tags: Salesforce, Microsoft, FinUpdated Nov 2026

An incident question disguised as debugging. The answer that scores treats it as a possible breach, preserves evidence, and checks the four usual causes in order of likelihood.

Make your first attempt

What would you say before reading the answer?

  1. 01 State the assumptions your answer depends on.
  2. 02 Explain the mechanism and choose a control.
  3. 03 Name a condition that would change your decision.

The worked answer includes an approach, scoring criteria and follow-up questions. Compare the reasoning with your own.

signing in unlocks more free answers per topic

What if · the follow-ups in this answer

The answer works through 6 follow-ups like an interviewer would

A chatbot briefly showed some users another user's conversation titles in the sidebar. Support has three screenshots.

  1. Where would you look first?
  2. What if a client library mixed up responses between connections under load?
  3. How do you scope how many users were affected?
  4. What obligations follow once confirmed?
  5. What would stop a repeat?
  6. What would your response include?

Each rung has a nudge, a model answer, the principle that carries over and the weak answer to avoid. Sign in free to open it.

UP NEXT ON YOUR JOURNEY
Next in this trackCan embeddings leak information about their source text? What does that mean for how you store them?Next in this trackHow should prompts, traces and logs in an LLM application handle personal data and secrets?Next in this trackShould LLM guardrails fail open or closed, and how do you handle their latency and cost?
DISCUSSION · 0

No comments yet. Share a correction or a different way to answer it.