TimeR4: Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering (EMNLP 2024)
Source: https://aclanthology.org/2024.emnlp-main.394/ Venue: EMNLP 2024 (Main Conference), November 2024 Category: Academic paper — Time-Aware Search / RAG
Key points
- Problem: Standard retrieval-augmented generation (RAG) pipelines treat retrieved knowledge as time-invariant, which fails for questions over temporal knowledge graphs (TKGs) where fact validity depends on timestamps.
- Approach: TimeR4 incorporates temporal awareness into the retrieval-augmented LLM framework, aligning retrieved evidence with the time constraints expressed in the question for temporal knowledge graph question answering (TKGQA).
- Context: The paper belongs to the line of work moving RAG from one-shot retrieval toward iterative, verifiable, and temporally-grounded retrieval.
- Decomposing RAG pipelines into retriever, reranker, planner, generator, and feedback mechanisms.
- The shift toward agentic paradigms where retrieval frequency and strategy become learnable decisions.
- Evaluation moving beyond static nDCG toward task success rate, citation accuracy, and multi-hop reasoning chain completeness.
- It's High Time: A Survey of Temporal Question Answering (arXiv 2505.20243)
- Right Answer at the Right Time — Temporal Retrieval-Augmented Generation (arXiv 2510.16715)
- Time-Sensitive Retrieval-Augmented Generation for Question Answering
- Original paper: TimeR4: Time-aware Retrieval-Augmented Large Language Models for Temporal Knowledge Graph Question Answering, EMNLP 2024. ACL Anthology
Positioning in the field
The forum post situates TimeR4 at the intersection of RAG and large-scale search/recommendation systems. Core themes discussed include:
Engineering checklist (from the forum's analysis)
| Concern | Recommendation | |---|---| | Data | Partitioned indices, PII scrubbing, rollback-capable embedding versions | | Latency | Cascaded retrieval with early stopping, query caching, async reranking | | Quality | Interleaved online experiments, human audits, citation verification | | Safety | Source whitelisting, adversarial detection, output filtering | | Cost | Model routing, distillation, hybrid sparse+dense retrieval |
Limitations noted by the forum
The post cautions that quantitative results should be verified against the original PDF, since the summary is based on public metadata. Possible limitations discussed generally for this line of work include experiment scale constrained by compute budgets, benchmark/real-user distribution mismatch, English-centric data limiting cross-lingual generalization, and safety risks of agentic systems on the open web.