📚 Resources

• Hugging Face Datasets — Quickstart: https://huggingface.co/docs/datasets/quickstart
• Transformers — Fine-tuning (data preparation section): https://huggingface.co/docs/transformers/en/training
• LIMA: Less Is More for Alignment: https://huggingface.co/papers/2305.11206
• Fine-Tuning LLMs on Small Datasets: Methods and Techniques: https://www.sapien.io/blog/strategies-for-fine-tuning-llms-on-small-datasets

Week 04 · Instruction and Chat Formatting, Tokenization, and Templates

Notion ID: 392c08fd-0278-817d-8a2b-cc4c49209516 Notion URL: https://app.notion.com/p/392c08fd0278817d8a2bcc4c49209516