Paper Overview
- Research area: ML
- Authors: Yixi Zhou, Sikun Wang, Lei Fan, Fan Zhang
- Published: 2026-10-05
- arXiv: 2610.00212
- Selective recommendation: EviGraph avoids withholding useful recommendations just because minor, non-decisive details are missing.
- Architecture: A language agent grounds decision requirements in evidence from a temporal knowledge graph; a deterministic checker certifies whether recommendations are supported.
- Benchmark: Evaluated on a bilingual Hong Kong public-service benchmark with executable policy references.
- Result: The requirement/abstention distinction reduces unnecessary abstention.
- Counterintuitive finding: Extra verification can retract already-supported recommendations without improving decision quality — more checking is not always better.
- Implication: Trustworthy evidence-based systems should explicitly specify which facts a decision must establish.
Abstract
Public-service recommendations require evidence that matches the requested service, scope, and date. Yet treating every missing detail as decisive can withhold useful recommendations. We introduce EviGraph, which distinguishes critical decision requirements from information that can remain unresolved. A language agent links these requirements to evidence in a temporal knowledge graph, while a deterministic checker establishes whether a recommendation is supported. Evaluation on a bilingual Hong Kong public-service benchmark with executable policy references shows that this distinction reduces unnecessary abstention. Additional verification, however, can withdraw supported recommendations without improving decision quality. These findings suggest that reliable evidence-based navigation depends on explicitly defining what a decision must establish, rather than simply adding more verification.
Key Takeaways
*Auto-collected on 2026-10-05.*