13What would you log for a new service, and how do you write a detection with an acceptable false-positive rate?▼mediumNewCrowdStrikeMicrosoftGoogle◆ premiumDetection quality is decided before the first alert, by what you logged and how you set the threshold. The scored answer derives both from the questions an investigator will ask.Open full answer →
22What are the value and the limits of using an LLM to review every pull request for security?▼mediumNewGoogleMicrosoftAmazon◆ premiumAn LLM reviewer reads every change, which no human team can, and is confidently wrong some of the time. The scored answer places it as a triage layer, measures it, and protects it from the code it reads.Open full answer →
03Write a detection for a technique you care about. How do you choose data, write the logic, test it and keep false positives manageable?▼mediumNewCrowdStrikeGoogleMicrosoftunlockedAnyone can write a query that matches an attack. The interview is about everything else: the data source you trust, the benign activity that looks the same, how you proved it fires, and what the analyst does when it does.Open full answer →
13How do you evaluate guardrails honestly, without optimising only for pass rate?▼hardNewAnthropicGoogle DeepMindMicrosoft◆ premiumA guardrail that blocks everything scores perfectly on attacks. The scored answer measures both errors, tests with attacks the guardrail has not seen, and reports with intervals at the operating threshold.Open full answer →
14What is over-refusal, and why does it belong in a security evaluation?▼mediumNew◆ premiumMeasure unnecessary refusal without confusing it with incomplete answers, errors or correct permission denials. Keep useful work and actual security effects visible.Open full answer →