Checklist
RAG Production Checklist
Checklist for permission-aware, evaluated retrieval systems that can survive enterprise use.
Use this in workshops, security reviews, and delivery planning. Print or copy freely.
Ingestion and corpus
- ✓Source systems of record are identified
- ✓Update and delete pipelines keep the index fresh
- ✓Document metadata supports filtering and policy
Access control
- ✓User identity flows into retrieval filters
- ✓Denied documents cannot appear in context
- ✓Access tests are part of evaluation
Answer quality
- ✓Citations map to supporting passages
- ✓System can abstain when evidence is weak
- ✓Groundedness is measured on a golden set
Operations
- ✓Latency and cost budgets are monitored
- ✓Index health and pipeline failures alert owners
- ✓Rollback path exists for bad releases