Title: Week 09 Resources
Course: AIINFRA 200: Production Inference Serving & GPU Orchestration > Section: Week 09 — Ray Serve and KServe for Scalable Model Serving

📚 Resources

- Ray Serve LLM APIs (current, Ray 2.5x): https://docs.ray.io/en/latest/serve/llm/index.html
- KServe InferenceService and ModelMesh: https://kserve.github.io/website/docs/admin-guide/modelmesh
- Ray Serve as a general-purpose Python serving framework: https://docs.ray.io/en/latest/serve/index.html
- KServe Official Documentation: https://kserve.github.io/website/docs/intro
- kserve/kserve GitHub Repository: https://github.com/kserve/kserve

Week 10 · GPU Orchestration on Kubernetes with the NVIDIA GPU Operator

Notion ID: 392c08fd-0278-812a-909b-e62c50b33f40 Notion URL: https://app.notion.com/p/392c08fd0278812a909be62c50b33f40