Title: Discussion 14 — When Does Disaggregation Actually Pay Off?
Course: AIINFRA 200: Production Inference Serving & GPU Orchestration > Section: Week 14 — Disaggregated Prefill/Decode with NVIDIA Dynamo

💬 Discussion 14 — When Does Disaggregation Actually Pay Off? (20 pts)

Under what request patterns and workload characteristics does disaggregated prefill/decode provide the largest performance wins, and when would you stick with aggregated serving instead? Ground your answer in your Lab 14 results and in this week's lecture — consider prompt length, concurrency, latency SLAs, and operational complexity in your reasoning. Post your initial response, then respond to at least two classmates, ideally ones who reached a different conclusion than you did.