Title: Week 14 Resources
Course: AIINFRA 201: Model Adaptation — Fine-Tuning & Quantization > Section: Week 14 — Knowledge Distillation and Quality-Size Tradeoff Analysis

📚 Resources

- TRL — Generalized Knowledge Distillation (GKD) Trainer documentation: https://huggingface.co/docs/trl/main/en/gkd_trainer
- Transformers — Knowledge Distillation for Computer Vision (methodology reference): https://huggingface.co/docs/transformers/en/tasks/knowledge_distillation_for_image_classification
- Hugging Face SetFit — Knowledge Distillation How-To: https://huggingface.co/docs/setfit/how_to/knowledge_distillation
- On-Policy Distillation survey (2026): https://huggingface.co/papers/2604.00626

Week 15 · Serving Adapted and Quantized Models — Handoff to AIINFRA 200

Notion ID: 392c08fd-0278-812e-8ea2-fecf4b68926e Notion URL: https://app.notion.com/p/392c08fd0278812e8ea2fecf4b68926e