Title: Week 05 Resources
Course: AIINFRA 200: Production Inference Serving & GPU Orchestration > Section: Week 05 — Hugging Face TGI and SGLang Serving Engines

📚 Resources

- Title: Hugging Face TGI — archived, maintenance mode (important status change): URL: https://github.com/huggingface/text-generation-inference
- Title: SGLang install and RadixAttention server launch: URL: https://github.com/sgl-project/sglang
- Title: Text Generation Inference (TGI) Documentation: URL: https://huggingface.co/docs/text-generation-inference/en/index
- Title: SGLang Documentation: URL: https://docs.sglang.io/
- Title: SGLang NVIDIA release notes: URL: https://docs.nvidia.com/deeplearning/frameworks/sglang-release-notes/overview.html

Week 06 · TensorRT-LLM Compilation and Optimization

Notion ID: 392c08fd-0278-81d9-b176-feaf043dd26b Notion URL: https://app.notion.com/p/392c08fd027881d9b176feaf043dd26b