Title: Week 07 Resources
Course: AIINFRA 200: Production Inference Serving & GPU Orchestration > Section: Week 07 — NVIDIA Triton Inference Server and Model Repositories

📚 Resources

- Title: NVIDIA Triton Inference Server Documentation — URL: https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html
- Title: Triton Model Repository Documentation — URL: https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/user_guide/model_repository.html
- Title: NVIDIA Triton Inference Server — current release and model repository — URL: https://github.com/triton-inference-server/server
- Title: Triton vLLM backend and TensorRT-LLM backend — URL: https://github.com/triton-inference-server/tensorrtllm_backend
- Title: triton-inference-server/tutorials GitHub Repository — URL: https://github.com/triton-inference-server/tutorials

Week 08 · Serving Engine Benchmarking Lab

Notion ID: 392c08fd-0278-816d-8798-f790726a804f Notion URL: https://app.notion.com/p/392c08fd0278816d8798f790726a804f