Skip to content
AI Security

Interview question · Adversarial ML & Model Privacy

Why is membership inference hard even to define for LLMs trained on internet-scale data?

A research-depth question. The scored answer explains why 'was this in training' blurs at web scale, why many published attacks measured distribution shift instead, and what questions remain answerable.

expertNewPreparation tags: Google DeepMind, OpenAI, AnthropicUpdated Nov 2026

A research-depth question. The scored answer explains why 'was this in training' blurs at web scale, why many published attacks measured distribution shift instead, and what questions remain answerable.

Make your first attempt

What would you say before reading the answer?

  1. 01 State the assumptions your answer depends on.
  2. 02 Explain the mechanism and choose a control.
  3. 03 Name a condition that would change your decision.

The worked answer includes an approach, scoring criteria and follow-up questions. Compare the reasoning with your own.

10 answers per topic instead of 5, plus saved progress and bookmarks · costs nothingor unlock all 529 remaining answers · $25

Every worked answer in all 17 topics, every lesson in every course, the full concept curriculum, the complete practice-test bank, and the downloadable security field guides.

6 months · One payment · No auto-renewal

What if · the follow-ups in this answer

The answer works through 6 follow-ups like an interviewer would

A legal team asks whether you can determine if specific copyrighted articles were used to train a large language model, using membership inference.

  1. Why is membership inference harder for pretrained LLMs?
  2. What did careful evaluations find?
  3. What remains answerable?
  4. What if the model reproduces long passages verbatim?
  5. How should you present findings to the legal team?
  6. What would you tell the legal team?

Each rung has a nudge, a model answer, the principle that carries over and the weak answer to avoid. Premium opens every answer and ladder.

UP NEXT ON YOUR JOURNEY
Next in this trackWhy can adversarially robust models leak more membership information about their training data?Next in this trackYou suspect a fine-tuning dataset was poisoned. How do you investigate, prove it, and decide what to do with the model?Next in this trackWhat is transferability of adversarial examples, and why doesn't hiding a model behind an API stop adversarial attacks?
DISCUSSION · 0

No comments yet. Share a correction or a different way to answer it.