Skip to content
AI Security

Interview question · Cloud, Container & AI Infrastructure Security

What isolation and side-channel concerns arise when GPUs are shared between tenants?

GPUs were built for throughput, not mutual distrust. Each sharing mode makes a different promise about memory, and some make none.

expertNewPreparation tags: NVIDIA, Google, AmazonUpdated Nov 2026

GPUs were built for throughput, not mutual distrust. Each sharing mode makes a different promise about memory, and some make none.

Make your first attempt

What would you say before reading the answer?

  1. 01 State the assumptions your answer depends on.
  2. 02 Explain the mechanism and choose a control.
  3. 03 Name a condition that would change your decision.

The worked answer includes an approach, scoring criteria and follow-up questions. Compare the reasoning with your own.

signing in unlocks more free answers per topic

What if · the follow-ups in this answer

The answer works through 6 follow-ups like an interviewer would

A platform rents GPU capacity to many customers on shared hardware and must decide how to share GPUs safely.

  1. How do GPU sharing modes differ?
  2. What is the memory residue risk?
  3. What other risks exist?
  4. Which mode would you choose for untrusted customers?
  5. How do you keep it safe over time?
  6. What sharing policy would you set?

Each rung has a nudge, a model answer, the principle that carries over and the weak answer to avoid. Sign in free to open it.

UP NEXT ON YOUR JOURNEY
Next in this trackNamespaces, capabilities and seccomp: how does each enforce least privilege for a process?Next in this trackWhat are the key controls for securing data and models in a managed cloud AI service?Next in this trackSecure a platform where customers upload and deploy their own models.
DISCUSSION · 0

No comments yet. Share a correction or a different way to answer it.