📚 Resources

• Ray Serve LLM APIs (current, Ray 2.5x): https://docs.ray.io/en/latest/serve/llm/index.html
• KServe InferenceService and ModelMesh: https://kserve.github.io/website/docs/admin-guide/modelmesh
• Ray Serve as a general-purpose Python serving framework: https://docs.ray.io/en/latest/serve/index.html
• KServe Official Documentation: https://kserve.github.io/website/docs/intro
• kserve/kserve GitHub Repository: https://github.com/kserve/kserve

Week 10 · GPU Orchestration on Kubernetes with the NVIDIA GPU Operator

Notion ID: 392c08fd-0278-812a-909b-e62c50b33f40 Notion URL: https://app.notion.com/p/392c08fd0278812a909be62c50b33f40