Curriculum Contrastive Context Denoising for Few-shot Conversational Dense Retrieval (SIGIR 2022)
Overview
This post summarizes a SIGIR 2022 paper on Curriculum Contrastive Context Denoising (CCD) for few-shot conversational dense retrieval.
| Field | Value | |-------|-------| | Venue | SIGIR 2022 | | Source | https://dl.acm.org/doi/abs/10.1145/3477495.3531961 | | Topic Area | Conversational Search |
Background and Motivation
Conversational dense retrieval encodes multi-turn dialog contexts (current query plus conversation history) into a dense representation to retrieve relevant passages. Two challenges motivate this work:
1. Data scarcity: training context-dependent encoders typically requires large labeled datasets, which are rarely available in real-world settings. 2. Context noise: conversation histories contain utterances irrelevant to the current information need, contaminating the learned context representations.
Method
The paper proposes Curriculum Contrastive Context Denoising, which combines:
- Contrastive context denoising: a knowledge-distillation-style contrastive objective where a data-rich teacher guides a few-shot student encoder, enriching context representations while suppressing noise from irrelevant turns.
- Curriculum learning: denoising difficulty is increased gradually during training, yielding more stable and effective optimization in low-data regimes.
- A unified framework for improving few-shot conversational dense retrieval via contrastive denoising.
- A curriculum scheduling strategy that mitigates instability in context representation learning.
- Empirical evaluation demonstrating the effectiveness of the approach under few-shot conditions (see the original paper for detailed metrics and baselines).
- For researchers: reproduce the contrastive distillation experiments and check statistical significance and compute costs.
- For engineers: the denoising encoder is a pluggable retriever module; evaluate integration cost with existing search stacks.
- For product teams: measure user-perceivable gains (latency, answer trustworthiness, multi-turn consistency) rather than offline ranking metrics alone.
- A Survey of Conversational Search (ACM, Sep 2025)
- ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval
- Engineering Conversational Search Systems: A Review
- Original paper: *Curriculum Contrastive Context Denoising for Few-shot Conversational Dense Retrieval*, SIGIR 2022 — https://dl.acm.org/doi/abs/10.1145/3477495.3531961
Key Contributions
Context in Conversational Search
The post situates this work along the evolution of neural information retrieval: from BM25 to dense bi-encoders, cross-encoders, late interaction, and modern generative retrieval / LLM-agent paradigms. Conversational dense retrieval remains a core component of the cascade "retrieve → rerank → generate" pipeline, and denoising context representations is directly relevant to retrieval-augmented generation (RAG) and agentic search systems where multi-turn intent understanding is critical.