CTR-Guided Generative Query Suggestion in Conversational Search (EMNLP 2025)
Overview
This entry catalogues an industry-track paper accepted at EMNLP 2025, published in the ACL Anthology:
- Title: CTR-Guided Generative Query Suggestion in Conversational Search
- Venue: EMNLP 2025 Industry Track (ACL)
- Source: https://aclanthology.org/2025.emnlp-industry.178/
- Topic area: Conversational Search
- Generative query reformulation (e.g., ConvGQR)
- LLM-based retrieval adaptation (e.g., ChatRetriever)
- Collaborative and agentic search systems (e.g., CoSearchAgent, agentic conversational search with reinforcement learning)
- Broad surveys of conversational search systems and applications
- Latency: p99 budgets and the number of retrieval/generation steps
- Data quality: PII handling, log de-biasing, and position-bias in CTR signals
- Safety: open-ended generation risks, source filtering
- Evaluation: interleaving experiments and human audits to verify offline gains translate to online engagement
- A Survey of Conversational Search (ACM, 2025)
- Engineering Conversational Search Systems: A Review of Applications
- Agentic Conversational Search with Contextualized Reasoning
- ChatRetriever: Adapting LLMs for Generalized and Robust Retrieval
- CoSearchAgent: A Lightweight Collaborative Search Agent
- ConvGQR: Generative Query Reformulation for Conversational Search
The paper explores generative query suggestion for conversational search, where a system proposes follow-up queries during multi-turn interactions. The distinguishing idea, per the title, is using click-through rate (CTR) signals from user behavior logs to guide the generation process, so that suggested queries are not only contextually relevant but also aligned with what users are likely to click.
> Note: The detailed abstract content in the source forum post was a placeholder. For exact methods, experiments, and quantitative results, refer to the official ACL Anthology page above.
Context Within Conversational Search
Query suggestion sits in a lineage of conversational IR research that includes:
The typical conversational search pipeline encodes query/document/context representations, then chains retrieval, reranking, and generation modules, with feedback signals (clicks, sessions) increasingly used as supervision.
Why CTR Signals Matter
Using CTR to guide query suggestion reflects a common industrial insight: offline relevance metrics (nDCG, MRR) do not always predict user satisfaction. Click logs provide an implicit preference signal that can steer generative models toward suggestions that are both contextually appropriate and behaviorally validated in production traffic.
Practical Considerations for Deployment
Engineering teams evaluating this line of work should consider: