24Design abuse policy, reporting and enforcement for a consumer generative AI feature.▼mediumNewMetaGoogleOpenAI◆ premiumA trust and safety design question. The scored answer connects policy, detection, review, enforcement and appeals into one loop, and sizes it to the volume and the harm.Open full answer →
30How would you red-team a content moderation classifier for evasion, and report results that are useful to the team that owns it?▼mediumNewMetaGoogleMicrosoft◆ premiumEvasion testing is a search problem with a budget. Start from real harmful content, transform it while keeping its meaning, adapt to what gets through, and report false negatives and false positives by category.Open full answer →