📚 Resources

• Title: NVIDIA Triton Inference Server Documentation — URL: https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html
• Title: Triton Model Repository Documentation — URL: https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/user_guide/model_repository.html
• Title: NVIDIA Triton Inference Server — current release and model repository — URL: https://github.com/triton-inference-server/server
• Title: Triton vLLM backend and TensorRT-LLM backend — URL: https://github.com/triton-inference-server/tensorrtllm_backend
• Title: triton-inference-server/tutorials GitHub Repository — URL: https://github.com/triton-inference-server/tutorials

Week 08 · Serving Engine Benchmarking Lab

Notion ID: 392c08fd-0278-816d-8798-f790726a804f Notion URL: https://app.notion.com/p/392c08fd0278816d8798f790726a804f