📚 Resources

• Hugging Face Hub — GGUF: https://huggingface.co/docs/hub/en/gguf
• llama.cpp — Quantize Tool README: https://github.com/ggml-org/llama.cpp/blob/master/tools/quantize/README.md
• llama.cpp — Official GitHub Repository: https://github.com/ggml-org/llama.cpp
• GGUF File Format Explained (llama.cpp): https://apxml.com/courses/practical-llm-quantization/chapter-5-quantization-formats-tooling/gguf-format

Week 13 · Advanced Quantization: AWQ, GPTQ, FP8, and KV-Cache Quantization

Notion ID: 392c08fd-0278-816f-9d3b-c83a12d9b8e4 Notion URL: https://app.notion.com/p/392c08fd0278816f9d3bc83a12d9b8e4