Title: Week 11 Resources
Course: AIINFRA 301: Production RAG & LLMOps — Observability and Evaluation > Section: Week 11 — Wiring Evaluation into CI/CD Quality Gates

📚 Resources

- Title: RAG evaluation in CI/CD with DeepEval (Confident AI guide): URL: https://www.confident-ai.com/blog/how-to-evaluate-rag-applications-in-ci-cd-pipelines-with-deepeval
- Title: Complementary eval-tool CI/CD stack: URL: https://medium.com/@tarek_89142/automating-llm-apps-quality-a-survey-of-open-source-evaluation-tools-for-ci-cd-cee235304510
- Title: CI/CD for LLM apps with Evidently and GitHub Actions: URL: https://www.evidentlyai.com/blog/llm-unit-testing-ci-cd-github-actions
- Title: DeepEval unit tests in CI with GitHub Actions: URL: https://deepeval.com/docs/evaluation-unit-testing-in-ci-cd
- Title: Unit Testing in CI/CD — DeepEval: URL: https://deepeval.com/docs/evaluation-unit-testing-in-ci-cd
- Title: CI/CD Integration for LLM Eval and Security — Promptfoo: URL: https://www.promptfoo.dev/docs/integrations/ci-cd/

Week 12 · Tracing and Observability: Langfuse and Arize Phoenix

Notion ID: 392c08fd-0278-8135-9226-d5e25c55f901 Notion URL: https://app.notion.com/p/392c08fd027881359226d5e25c55f901