Title: Week 05 Resources
Course: AIINFRA 302: AI Security, Guardrails & Governance > Section: Week 05 — Jailbreaks, Red-Teaming, and Adversarial Testing

📚 Resources

- Title: NVIDIA garak (adversarial probe library) — URL: https://github.com/NVIDIA/garak
- Title: Microsoft PyRIT (Python Risk Identification Tool for GenAI) — URL: https://github.com/microsoft/PyRIT
- Title: Many-shot jailbreaking — Anthropic — URL: https://www.anthropic.com/research/many-shot-jailbreaking
- Title: PAIR / Tree of Attacks with Pruning (arXiv) — URL: https://arxiv.org/abs/2312.02119
- Title: Lessons From Red Teaming 100 Generative AI Products (arXiv) — URL: https://arxiv.org/pdf/2501.07238
- Title: Many-shot jailbreaking and multi-turn escalation research — URL: https://startup-house.com/blog/llm-jailbreak-techniques

Week 06 · Guardrails Frameworks: NeMo Guardrails and LLM Guard

Notion ID: 392c08fd-0278-8124-9cda-fb9ff5326b0a Notion URL: https://app.notion.com/p/392c08fd027881249cdafb9ff5326b0a