Title: Week 03 Resources
Course: AIINFRA 201: Model Adaptation — Fine-Tuning & Quantization > Section: Week 03 — Dataset Design and Data Preparation for Fine-Tuning

📚 Resources

- Hugging Face Datasets — Quickstart: https://huggingface.co/docs/datasets/quickstart
- Transformers — Fine-tuning (data preparation section): https://huggingface.co/docs/transformers/en/training
- LIMA: Less Is More for Alignment: https://huggingface.co/papers/2305.11206
- Fine-Tuning LLMs on Small Datasets: Methods and Techniques: https://www.sapien.io/blog/strategies-for-fine-tuning-llms-on-small-datasets

Week 04 · Instruction and Chat Formatting, Tokenization, and Templates

Notion ID: 392c08fd-0278-817d-8a2b-cc4c49209516 Notion URL: https://app.notion.com/p/392c08fd0278817d8a2bcc4c49209516