When people say they are "adding RAG" to a workflow, the conversation often jumps too quickly to infrastructure choices.

Should this use a vector database?

Should there be a reranker?

Should everything go into a knowledge graph?

Those are valid questions, but they are usually not the first question.