Paper Overview
Field: Machine Learning Authors: Yanjun Zhao, Ruizhong Qiu, Tianxin Wei Published: 2026-07-04 arXiv: 2507.00478
Introduction
Understanding and reasoning over long contexts has become a key requirement for deploying large language models (LLMs) in realistic applications. Although recent LLMs support increasingly long context windows, they often fail to use relevant evidence that is already present in the input, revealing a gap between context access and effective context utilization.
Method
The paper proposes RECONTEXT (Recursive Evidence Replay as LLM Harness for Long-Context Reasoning), a training-free inference method for improving long-context reasoning:
- Uses model-internal relevance signals to construct a query-conditioned evidence pool.
- Replays the evidence pool before final generation while preserving the full original context.
- The recursive selection process separates evidence organization from answer generation — no training, external memory, or context pruning required.
- Context as memory storage
- Questions as retrieval cues
- Attention as cue-trace association
- Replay as trace reactivation
Theoretical Analysis
The authors provide an analysis based on associative memory, framing:
Results
Experiments on eight long-context datasets with 128K context length show that RECONTEXT consistently improves evidence utilization on Qwen3-4B, Qwen3-8B, and Llama3-8B, achieving the best average rank across all three backbone models.
---
*Auto-collected on 2026-07-04*