📚 Resources

• Title: NVIDIA Dynamo — disaggregated prefill/decode serving framework: URL: https://github.com/ai-dynamo/dynamo
• Title: NVIDIA Dynamo introduction blog: URL: https://developer.nvidia.com/blog/introducing-nvidia-dynamo-a-low-latency-distributed-inference-framework-for-scaling-reasoning-ai-models/
• Title: Disaggregated Serving — NVIDIA Dynamo Documentation: URL: https://docs.nvidia.com/dynamo/latest/design-docs/disaggregated-serving.html
• Title: Disaggregation and Performance Tuning — NVIDIA Dynamo: URL: https://docs.nvidia.com/dynamo/latest/guides/disagg_perf_tuning.html
• Title: Deploying disaggregated LLM inference on Kubernetes: URL: https://developer.nvidia.com/blog/deploying-disaggregated-llm-inference-workloads-on-kubernetes/

Week 15 · Observability, Cost Analysis, and Right-Sizing

Notion ID: 392c08fd-0278-818c-afdb-d4b85caa4cac Notion URL: https://app.notion.com/p/392c08fd0278818cafdbd4b85caa4cac