Thest

Checklist

RAG Production Checklist

Checklist for permission-aware, evaluated retrieval systems that can survive enterprise use.

Use this in workshops, security reviews, and delivery planning. Print or copy freely.

Ingestion and corpus

  • ✓Source systems of record are identified
  • ✓Update and delete pipelines keep the index fresh
  • ✓Document metadata supports filtering and policy

Access control

  • ✓User identity flows into retrieval filters
  • ✓Denied documents cannot appear in context
  • ✓Access tests are part of evaluation

Answer quality

  • ✓Citations map to supporting passages
  • ✓System can abstain when evidence is weak
  • ✓Groundedness is measured on a golden set

Operations

  • ✓Latency and cost budgets are monitored
  • ✓Index health and pipeline failures alert owners
  • ✓Rollback path exists for bad releases