My RAG pipeline had a bottleneck, and the fix turned out to be just simple math. The...
My RAG pipeline had a bottleneck, and the fix turned out to be just simple math.
The problem
My retrieval pipeline for Uma Busca de Gelo e Fogo, a RAG system over the full A Song of Ice and Fire corpus (~66k paragraphs), follows a fairly standard hybrid retrieval setup:
Dense retrieval (ChromaDB, bge-m3)
→ BM25 sparse (BM25Okapi)
My RAG pipeline looked fine on paper. Fast retrieval. Decent cosine scores. But when I tested it with...
Design a High-Precision Retrieve-and-Rerank Pipeline with ZeroEntropy Zerank-2 Reranker
Originally published at vivekpatil23.hashnode.dev The Problem With Naive RAG Nobody Talks About Most...
Most RAG tutorials get you 70% of the way there. This is about the other 30% that actually matters in...
If your RAG app sometimes answers from the wrong document even though the right one was in your...
Search through billions of items for similar matches to any object, in milliseconds. It’s the next generation of search, an API…
