Superintelligent Retrieval Agent (SIRA): Compressing Multi-Round Agentic Search into a Single Retrieval Action
- Authors: Zeyu Yang, Qi Ma, Jason Chen, Anshumali Shrivastava
- Type: Academic paper (Agentic Search)
- Source: https://arxiv.org/abs/2605.06647
- Most retrieval-augmented agents treat retrieval as a black box: they issue exploratory queries, inspect snippets, and reformulate until evidence emerges. This resembles a newcomer searching an unfamiliar database rather than an expert navigating with strong priors, causing extra retrieval rounds, latency, and poor recall.
- SIRA redefines retrieval "superintelligence" as compressing multi-round exploratory search into a single corpus-discriminative retrieval action. Rather than asking which terms are merely relevant, it asks which terms separate the desired evidence from corpus-level confusers.
- Pipeline: 1. Offline: an LLM enriches each document with missing search vocabulary. 2. Query time: the LLM predicts evidence vocabulary the query omits. 3. Corpus statistics serve as tool calls that filter terms that are absent, overly common, or unlikely to create retrieval margin. 4. Final step: a single weighted BM25 call combining the query with the validated expansion.
- Across ten BEIR benchmarks, SIRA achieves the strongest average retrieval performance in its comparison, beating dense retrievers, learned sparse retrievers, and LLM search-agent baselines — using no relevance labels and no retriever fine-tuning.
- On downstream QA, its retrieval-only answer coverage exceeds recent RL-trained agentic QA systems on NQ and HotpotQA.
- The authors introduce BrowseComp-Wikipedia, a hard-search benchmark of 232 BrowseComp-derived queries over a 25,587,229-document Wikipedia index. Even without index-time enrichment (using only grounded Wikipedia categories), SIRA outperforms multi-round Perplexity agents at every budget, reaching:
- 9.70% Recall@1
- 15.27% Recall@10
- 36.14% Recall@100
- Quantitative details should be verified against the original PDF; the discussion of evaluation protocol is based on the abstract and public metadata.
- Broader open issues in agentic retrieval include evaluation trustworthiness, latency and cost, hallucination and safety, and cross-lingual / multimodal extension.
- A Systematic Framework for Enterprise Knowledge Retrieval (arXiv:2512.05411)
- Retrieval Augmented Generation and Understanding in Vision: A Survey (arXiv:2503.18016)
- Synergizing RAG and Reasoning: A Systematic Review (arXiv:2504.15909)
- AceSearcher: Bootstrapping Reasoning and Search for LLMs via RL (arXiv:2509.24193)
- Agentic Information Retrieval (arXiv:2410.09713)
Key Points
Results
Why It Matters
The agentic search paradigm is making "how many times and how to retrieve" itself a learnable object. SIRA challenges the assumption that multi-round exploration is necessary, showing that LLM priors plus corpus statistics can deliver expert-level retrieval in a single step — with clear implications for latency, cost, and reliability of industrial RAG systems.