
Reranking Models: The Cheapest RAG Quality Upgrade
A reranker between retrieval and generation is the biggest RAG quality gain per dollar. Here is how reranking works and what it costs.
Oct 27, 20268 min read0 reactions0 comments
Tag archive

A reranker between retrieval and generation is the biggest RAG quality gain per dollar. Here is how reranking works and what it costs.
Bi-encoders retrieve fast but rank loosely. A cross-encoder reranker reads query and passage together and reorders the top candidates — here is how, w

벡터 검색이 가져온 Top 50을 LLM에 그대로 넘기면 정밀도가 깨집니다. cross-encoder 재순위가 그 50개를 다시 정렬해 Top 5만 LLM에 넘기면 답변 품질이 한 단계 올라갑니다.