📚 Resources

• Title: Hugging Face TGI — archived, maintenance mode (important status change): URL: https://github.com/huggingface/text-generation-inference
• Title: SGLang install and RadixAttention server launch: URL: https://github.com/sgl-project/sglang
• Title: Text Generation Inference (TGI) Documentation: URL: https://huggingface.co/docs/text-generation-inference/en/index
• Title: SGLang Documentation: URL: https://docs.sglang.io/
• Title: SGLang NVIDIA release notes: URL: https://docs.nvidia.com/deeplearning/frameworks/sglang-release-notes/overview.html

Week 06 · TensorRT-LLM Compilation and Optimization

Notion ID: 392c08fd-0278-81d9-b176-feaf043dd26b Notion URL: https://app.notion.com/p/392c08fd027881d9b176feaf043dd26b