Title: Week 09 Resources
Course: AIINFRA 201: Model Adaptation — Fine-Tuning & Quantization > Section: Week 09 — Preference Tuning: DPO in Practice (with a Look at GRPO)

📚 Resources

- Title: TRL — DPO Trainer: URL: https://huggingface.co/docs/trl/en/dpo_trainer
- Title: TRL — GRPO Trainer: URL: https://huggingface.co/docs/trl/main/en/grpo_trainer
- Title: Direct Preference Optimization: Your Language Model is Secretly a Reward Model: URL: https://arxiv.org/pdf/2305.18290
- Title: DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior RL Knowledge (Hugging Face blog): URL: https://huggingface.co/blog/NormalUhr/grpo

Week 10 · Evaluating Fine-Tuned Models and Detecting Overfitting

Notion ID: 392c08fd-0278-81ba-a3a1-c982460a84d7 Notion URL: https://app.notion.com/p/392c08fd027881baa3a1c982460a84d7