📚 Resources

• Title: NVIDIA garak (adversarial probe library) — URL: https://github.com/NVIDIA/garak
• Title: Microsoft PyRIT (Python Risk Identification Tool for GenAI) — URL: https://github.com/microsoft/PyRIT
• Title: Many-shot jailbreaking — Anthropic — URL: https://www.anthropic.com/research/many-shot-jailbreaking
• Title: PAIR / Tree of Attacks with Pruning (arXiv) — URL: https://arxiv.org/abs/2312.02119
• Title: Lessons From Red Teaming 100 Generative AI Products (arXiv) — URL: https://arxiv.org/pdf/2501.07238
• Title: Many-shot jailbreaking and multi-turn escalation research — URL: https://startup-house.com/blog/llm-jailbreak-techniques

Week 06 · Guardrails Frameworks: NeMo Guardrails and LLM Guard

Notion ID: 392c08fd-0278-8124-9cda-fb9ff5326b0a Notion URL: https://app.notion.com/p/392c08fd027881249cdafb9ff5326b0a