Title: Week 02 Resources
Course: AIINFRA 100: AI Systems & Development Environments > Section: Week 02 — AI Workloads: Training vs. Inference, Latency vs. Throughput

📚 Resources

- What is AI Inference? (NVIDIA Glossary): https://www.nvidia.com/en-us/glossary/ai-inference/
- Inference options in Amazon SageMaker AI (AWS Documentation): https://docs.aws.amazon.com/sagemaker/latest/dg/deploy-model-options.html
- Run batch inference jobs — Amazon SageMaker AI (AWS Documentation): https://docs.aws.amazon.com/sagemaker/latest/dg/autopilot-deploy-models-batch.html
- GPU Training vs GPU Inference: How to Choose (RunPod): https://www.runpod.io/articles/comparison/choosing-a-gpu-for-training-vs-inference
- Hugging Face LLM Course — Chapter 0: https://huggingface.co/learn/llm-course/chapter0/1