9 papers matching “retrieval” and 1 domain
CoverSynth: Coverage-Guided Generation of Retrieval Evaluation Sets
It introduces CoverSynth, an automated framework that generates enterprise-grade retrieval evaluation sets from unannotated corpora to uncover failure modes and differentiate retrieval systems far more effectively than human-authored sets.
- Reframes the problem
Beyond Retrieval Failure: Understanding Why LLMs Miss Evidence in Multi-Hop RAG
The study demonstrates that apparent multi-hop retrieval failures often stem from search drift rather than retriever inadequacy, though recovering missing evidence primarily shifts errors to premature resolutions and abstentions.
- Surprising result
- Reframes the problem
UNREAL: Unifying Retrieval and Long-Context with a Single Model
It introduces a single model-internal selection mechanism adding under 500K parameters to a frozen LLM that improves both multi-hop corpus retrieval recall and long-context inference speed.
RIT-RAG: Navigating Document Corpora with Retrieval-Induced Trees
It improves agentic RAG accuracy on large enterprise documentation by dynamically constructing multi-document sub-trees from initial retrieval results to guide LLM exploration.
- New benchmark
AGO AI Quality Gate: Evidence-First Release Decisions for Retrieval-Augmented Generation
It introduces an evidence-first RAG release framework that reduces unsafe production deployments by treating LLM judges as fallible and quantifying regression risk probabilistically.
- Reframes the problem
Re-ranking and Late Interaction Drive Retrieval Quality: A Controlled Comparison of RAG Strategies for Scientific Question Answering
- New benchmark
Inverting Multi-Vector Visual Document Indices
It demonstrates that multi-vector visual document indices stored in vector databases can be inverted to reconstruct document images, exposing 45% of sensitive tokens.
- Surprising result
Equal Ranking Quality, Different Decisions: Measuring and Reducing Order Dependence in LLM Scorers
It demonstrates that LLM rerankers with equivalent ranking metrics produce widely inconsistent downstream decisions due to candidate ordering, and introduces order-consistency fine-tuning to resolve the issue.
- Surprising result
- Reframes the problem
Accurate but Not Humble: Evaluating Epistemic Humility in LLM Agents under Knowledge Conflict
Higher agent task accuracy does not correlate with epistemic humility, as high-performing models often detect knowledge conflicts during execution but fail to escalate or report unresolved uncertainty in incorrect answers.
- New benchmark
- Surprising result