Title: Week 14 Resources
Course: AIINFRA 200: Production Inference Serving & GPU Orchestration > Section: Week 14 — Disaggregated Prefill/Decode with NVIDIA Dynamo

📚 Resources

- Title: NVIDIA Dynamo — disaggregated prefill/decode serving framework: URL: https://github.com/ai-dynamo/dynamo
- Title: NVIDIA Dynamo introduction blog: URL: https://developer.nvidia.com/blog/introducing-nvidia-dynamo-a-low-latency-distributed-inference-framework-for-scaling-reasoning-ai-models/
- Title: Disaggregated Serving — NVIDIA Dynamo Documentation: URL: https://docs.nvidia.com/dynamo/latest/design-docs/disaggregated-serving.html
- Title: Disaggregation and Performance Tuning — NVIDIA Dynamo: URL: https://docs.nvidia.com/dynamo/latest/guides/disagg_perf_tuning.html
- Title: Deploying disaggregated LLM inference on Kubernetes: URL: https://developer.nvidia.com/blog/deploying-disaggregated-llm-inference-workloads-on-kubernetes/

Week 15 · Observability, Cost Analysis, and Right-Sizing

Notion ID: 392c08fd-0278-818c-afdb-d4b85caa4cac Notion URL: https://app.notion.com/p/392c08fd0278818cafdbd4b85caa4cac