📚 Resources

• Title: TRL — DPO Trainer: URL: https://huggingface.co/docs/trl/en/dpo_trainer
• Title: TRL — GRPO Trainer: URL: https://huggingface.co/docs/trl/main/en/grpo_trainer
• Title: Direct Preference Optimization: Your Language Model is Secretly a Reward Model: URL: https://arxiv.org/pdf/2305.18290
• Title: DeepSeek-R1 Dissection: Understanding PPO & GRPO Without Any Prior RL Knowledge (Hugging Face blog): URL: https://huggingface.co/blog/NormalUhr/grpo

Week 10 · Evaluating Fine-Tuned Models and Detecting Overfitting

Notion ID: 392c08fd-0278-81ba-a3a1-c982460a84d7 Notion URL: https://app.notion.com/p/392c08fd027881baa3a1c982460a84d7