📚 Resources

• Title: PEFT — LoRA Conceptual Guide: URL: https://huggingface.co/docs/peft/main/en/conceptual_guides/lora
• Title: PEFT — LoRA-based Methods Task Guide: URL: https://huggingface.co/docs/peft/task_guides/lora_based_methods
• Title: Transformers — Parameter-Efficient Fine-Tuning (PEFT integration): URL: https://huggingface.co/docs/transformers/en/peft
• Title: LoRA Hyperparameters: Rank, Alpha & Target Module Selection: URL: https://mbrenndoerfer.com/writing/lora-hyperparameters-rank-alpha-target-modules

Week 07 · QLoRA and Training on Consumer GPUs with Unsloth

Notion ID: 392c08fd-0278-81f7-b35a-c4c211e1d008 Notion URL: https://app.notion.com/p/392c08fd027881f7b35ac4c211e1d008