Title: Discussion 9 — DPO, GRPO, or Both?
Course: AIINFRA 201: Model Adaptation — Fine-Tuning & Quantization > Section: Week 09 — Preference Tuning: DPO in Practice (with a Look at GRPO)

💬 Discussion 9 — DPO, GRPO, or Both? (20 pts)

Your fine-tuned model is accurate but sounds robotic and unhelpful — technically correct answers delivered in a flat, unengaging way that your users are complaining about. Would you reach for DPO with human preference pairs, GRPO with a reward function, or both in sequence, and why? In your post, address:

- What kind of feedback data you'd need to gather or already have for your chosen approach, and how realistic that is to collect.
- What specific behavior change you'd expect to see (and how you'd verify it actually happened, not just assume it).
- If you chose "both," which order would you run them in and why — does one setup step naturally feed the other?

Post your initial response (150–250 words), then respond to at least two classmates — ideally to someone who chose a different approach than you did, and push on a tradeoff they may not have considered (memory cost, data availability, or forgetting risk).