Title: Discussion 14 — MIG or Time-Slicing?
Course: AIINFRA 302: AI Security, Guardrails & Governance > Section: Week 14 — Fractional GPUs, MIG, Quantization, and KV-Cache Savings

💬 Discussion 14 — MIG or Time-Slicing? (20 pts)

You're designing a multi-tenant inference service that must simultaneously serve two very different workloads on the same GPU fleet: a security-sensitive client (think: handling regulated or confidential data, with contractual isolation requirements) and an internal test workload (your own team running experimental, lower-stakes traffic). In your initial post, address:

- Would you choose MIG or time-slicing for this scenario, and why?
- Why does the isolation difference between the two approaches matter more here than simply maximizing raw GPU utilization?
- What's a concrete failure scenario that could occur if you chose the wrong sharing strategy for the security-sensitive client?

Then respond to at least two classmates — ideally engaging with a post that reached a different conclusion or emphasized a different risk than yours, and explain where you agree or push back.