📚 Resources

• TRL — Generalized Knowledge Distillation (GKD) Trainer documentation: https://huggingface.co/docs/trl/main/en/gkd_trainer
• Transformers — Knowledge Distillation for Computer Vision (methodology reference): https://huggingface.co/docs/transformers/en/tasks/knowledge_distillation_for_image_classification
• Hugging Face SetFit — Knowledge Distillation How-To: https://huggingface.co/docs/setfit/how_to/knowledge_distillation
• On-Policy Distillation survey (2026): https://huggingface.co/papers/2604.00626

Week 15 · Serving Adapted and Quantized Models — Handoff to AIINFRA 200

Notion ID: 392c08fd-0278-812e-8ea2-fecf4b68926e Notion URL: https://app.notion.com/p/392c08fd0278812e8ea2fecf4b68926e