📚 Resources

• Transformers — Quantization Concepts: https://huggingface.co/docs/transformers/en/quantization/concept_guide
• Transformers — AWQ Quantization: https://huggingface.co/docs/transformers/quantization/awq
• Transformers — GPTQ Quantization: https://huggingface.co/docs/transformers/quantization/gptq
• vLLM — Quantized KV Cache: https://docs.vllm.ai/en/stable/features/quantization/quantized_kvcache/

Week 14 · Knowledge Distillation and Quality-Size Tradeoff Analysis

Notion ID: 392c08fd-0278-8178-9893-cd7d292f973e Notion URL: https://app.notion.com/p/392c08fd027881789893cd7d292f973e