Title: AIINFRA 302: AI Security, Guardrails & Governance

00 · Course Information
  Outcomes & Rubrics
Week 01 — AI Security Landscape and the LLM Threat Model
  Lecture 1 — Why LLM Security Is Not Just AppSec With a Chat Window
  Lab 1 — ATLAS Threat Modeling for a RAG Chatbot
  Discussion 1 — Beyond Confidentiality, Integrity, Availability
  Quiz 1 — AI Security Landscape and the LLM Threat Model
  Week 01 Resources
Week 02 — OWASP LLM Top 10 (2025) Deep Dive
  Lecture 2 — Touring the 2025 OWASP LLM Top 10
  Lab 2 — Risk Teach-Backs and Incident Classification
  Discussion 2 — Why New Categories in 2025?
  Quiz 2 — OWASP LLM Top 10 (2025) Deep Dive
  Week 02 Resources
Week 03 — Direct and Indirect Prompt Injection Attacks
  Lecture 3 — Direct and Indirect Prompt Injection Attacks
  Lab 3 — Break the Model, Then Break Your Own RAG
  Discussion 3 — Picking Your Leg of the Lethal Trifecta
  Quiz 3 — Direct and Indirect Prompt Injection Attacks
  Week 03 Resources
Week 04 — Prompt Injection Defenses and Input Validation
  Lecture 4 — Layering Defenses Against Prompt Injection
  Lab 4 — Building an Input Scanning Pipeline with LLM Guard and Rebuff
  Discussion 4 — What Does "Done" Look Like for a Defense-in-Depth Stack?
  Quiz 4 — Prompt Injection Defenses and Input Validation
  Week 04 Resources
Week 05 — Jailbreaks, Red-Teaming, and Adversarial Testing
  Lecture 5 — Jailbreaks, Multi-Turn Escalation, and Automated Red-Teaming
  Lab 5 — Scanning and Manually Red-Teaming a Local Model
  Discussion 5 — Can Model Alignment Alone Ever Be a Production Control?
  Quiz 5 — Jailbreaks, Red-Teaming, and Adversarial Testing
  Week 05 Resources
Week 06 — Guardrails Frameworks: NeMo Guardrails and LLM Guard
  Lecture 6 — Guardrails Frameworks: NeMo Guardrails and LLM Guard
  Lab 6 — Build and Compare: NeMo Guardrails vs. LLM Guard
  Discussion 6 — When Is a Guardrails Layer Worth It?
  Quiz 6 — Guardrails Frameworks: NeMo Guardrails and LLM Guard
  Week 06 Resources
Week 07 — Content Safety and Moderation with Llama Guard 4 and Rebuff
  Lecture 7 — Classifying Content Safety with Llama Guard 4
  Lab 7 — Two-Stage Moderation Pipeline with Llama Guard 4 and Rebuff Canary Tokens
  Discussion 7 — One Policy or Many? Tuning Hazard Categories per Deployment
  Quiz 7 — Content Safety and Moderation with Llama Guard 4 and Rebuff
  Week 07 Resources
Week 08 — PII Protection with Presidio and Output Validation
  Lecture 8 — PII Protection with Presidio and Output Validation
  Midterm Exam
  Discussion 8 — Setting Your PII Recall Bar
  Week 08 Resources
Week 09 — Data Privacy, Secrets Management, and Access Control
  Lecture 9 — Secrets, Identity, and Access Control for AI Systems
  Lab 9 — Catch the Leak: Secret Scanning and Role-Based Data Minimization
  Discussion 9 — Fixing the "Union of Everyone's Permissions" Anti-Pattern
  Quiz 9 — Data Privacy, Secrets Management, and Access Control
  Week 09 Resources
Week 10 — Model Provenance and AI Supply-Chain Security
  Lecture 10 — Provenance, Signing, and the AI Supply Chain
  Lab 10 — Scan, Convert, and Rank Model Trust Signals
  Discussion 10 — Flag or Block? Hugging Face's Unsafe-Model Policy
  Quiz 10 — Model Provenance and AI Supply-Chain Security
  Week 10 Resources
Week 11 — AI Governance Frameworks: NIST AI RMF, ISO/IEC 42001, and the EU AI Act
  Lecture 11 — Three Frameworks, Three Different Jobs
  Lab 11 — Governance Plan, Risk Classification & Framework Crosswalk
  Discussion 11 — The Certification Gap
  Quiz 11 — AI Governance Frameworks: NIST AI RMF, ISO/IEC 42001, and the EU AI Act
  Week 11 Resources
Week 12 — Responsible AI, Bias, Fairness, and Model Cards
  Lecture 12 — Documenting and Measuring Fairness in ML Systems
  Lab 12 — Audit, Mitigate, and Document a Fairness Gap
  Discussion 12 — Choosing a Fairness Definition
  Quiz 12 — Responsible AI, Bias, Fairness, and Model Cards
  Week 12 Resources
Week 13 — GPU FinOps Foundations: Cost per 1,000 Requests and Right-Sizing
  Lecture 13 — Cost per 1,000 Requests, Cost per Token, and the Utilization Lever
  Lab 13 — Benchmarking Cost per 1,000 Requests with vLLM on a Free GPU
  Discussion 13 — Why Self-Host Below the Break-Even Point?
  Quiz 13 — GPU FinOps Foundations: Cost per 1,000 Requests and Right-Sizing
  Week 13 Resources
Week 14 — Fractional GPUs, MIG, Quantization, and KV-Cache Savings
  Lecture 14 — Fractional GPUs, MIG, Quantization, and KV-Cache Savings
  Lab 14 — Quantize, Measure, and Partition
  Discussion 14 — MIG or Time-Slicing?
  Quiz 14 — Fractional GPUs, MIG, Quantization, and KV-Cache Savings
  Week 14 Resources
Week 15 — Autoscaling Economics, Spot Instances, and Build-vs-Buy
  Lecture 15 — Autoscaling Economics, Spot Instances, and Build-vs-Buy
  Lab 15 — Spot vs. On-Demand vs. Owned: A Build-vs-Buy Cost Model
  Discussion 15 — Vendor Longevity Risk in Build-vs-Buy
  Quiz 15 — Autoscaling Economics, Spot Instances, and Build-vs-Buy
  Week 15 Resources
Week 16 — Capstone Project & Course Review
  Final Capstone Project
  Capstone Presentation
  Course Review & Reflection
  What's Next