Home
Storia in 1 fonti
Context Compression Before the LLM: Cutting Tokens Without Cutting Recall
Extractive vs abstractive compression of retrieved chunks. Sentence-level filtering. How to cut tokens without losing the answer.
Raccontata da
dev.to
Timeline cronologica
- ·
Metadata Filtering Before Vector Search: The Recall Win Nobody Measures
Pre-filter by metadata to shrink the search space before the vector index runs. The recall lift, the cardinality trap, and the code.
- ·
Query Rewriting Before Retrieval: The Cheap Recall Win Most Skip
Most RAG pipelines embed the user's raw query and skip the cheapest recall win there is: rewriting it before search.
- ·
Context Compression Before the LLM: Cutting Tokens Without Cutting Recall
Extractive vs abstractive compression of retrieved chunks. Sentence-level filtering. How to cut tokens without losing the answer.