Skip to content

privacy

AI security interview questions tagged privacy, across every topic.

27 questions · 2 unlocked for you

Concepts behind "privacy"

Explanations of the mechanisms these questions rely on.

Foundational
Adversarial ML & Privacy
Membership Inference AttacksA membership inference attack tries to determine whether a specific record was part of a model's training data, using the model's outputs. Models behave measurably differently on data they were trained on, especially when they overfit, and an attacker can exploit that gap. For sensitive datasets, membership itself is private information. Differential privacy is the principled defence; regularisation, limiting outputs and data minimisation reduce risk.
Foundational
Adversarial ML & Privacy
Training-Data Memorisation and ExtractionLanguage models memorise part of their training data verbatim, and an attacker can sometimes make them emit it: personal data, secrets, copyrighted text. Memorisation grows with duplication, model size and prompt context, happens before overfitting, and survives alignment, which only hides it. Defences stack: deduplicate, scrub, train with differential privacy where it fits, filter outputs knowing approximate copies slip through, and measure with canaries and extraction tests. Fine-tuning on customer data is the highest-risk case.
Foundational
Detection & Response
Malware Scanning, Sample Privacy and Verdict LimitsMalware scanning combines signatures, content rules and other analysis under explicit handling limits. Understand public sample sharing, private analysis, hash lookups and why a clean verdict is not a safety proof.
Core
LLM Application SecuritySign in
Sensitive Information DisclosureSensitive information disclosure, LLM02 in the OWASP Top 10 for LLM Applications (2025 and 2026), covers personal data, secrets, proprietary information and other users' data leaking through an LLM application. The leak paths include retrieval without authorization, context shared across users, prompt and response logs, caches, fine-tuning data, model memorisation, third-party providers and the answer itself. Controls minimise what enters each path and enforce access before data reaches the model.
Advanced
Agent & MCP Security🔒 Premium
Agent Memory Security: Poisoning, Provenance and ForgettingPersistent memory can carry false claims or instructions into later agent tasks when those records are retrieved. Secure the write, promotion and retrieval paths with authenticated scope, source lineage, versions and expiry. Treat recalled content as data, keep resource authorization independent, and distinguish immediate retrieval denial from removal of derivatives, backups and copies already delivered.