RAG evaluation: fix retrieval before you blame the model
Most RAG failures are retrieval failures. A practical playbook for retrieval evaluation: golden sets, recall@k, chunking tests and drift monitoring.
Pillar
The infrastructure underneath AI features: retrieval, vector stores, caching, sharding and latency budgets. Each piece works through the arithmetic and the failure modes before the tooling.
Most RAG failures are retrieval failures. A practical playbook for retrieval evaluation: golden sets, recall@k, chunking tests and drift monitoring.
A better embedding model is only an upgrade if you can install it. The sizing, dual-write and cutover plan for re-indexing 10M+ vectors with no downtime.
Most Redis sharding goes wrong before the first shard exists. Diagnose the real ceiling, design keys around hash slots, and reshard without a p99 spike.