Title: Week 12 Resources
Course: AIINFRA 201: Model Adaptation — Fine-Tuning & Quantization > Section: Week 12 — Quantization Foundations: Precision, GGUF, and llama.cpp

📚 Resources

- Hugging Face Hub — GGUF: https://huggingface.co/docs/hub/en/gguf
- llama.cpp — Quantize Tool README: https://github.com/ggml-org/llama.cpp/blob/master/tools/quantize/README.md
- llama.cpp — Official GitHub Repository: https://github.com/ggml-org/llama.cpp
- GGUF File Format Explained (llama.cpp): https://apxml.com/courses/practical-llm-quantization/chapter-5-quantization-formats-tooling/gguf-format

Week 13 · Advanced Quantization: AWQ, GPTQ, FP8, and KV-Cache Quantization

Notion ID: 392c08fd-0278-816f-9d3b-c83a12d9b8e4 Notion URL: https://app.notion.com/p/392c08fd0278816f9d3bc83a12d9b8e4