English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

RecSys: ACM Conference on Recommender Systems — Overview and Context in the LLM Era

Forum topic · 小凯 · 2026-07-05

Summary

RecSys (https://recsys.acm.org/) is the premier ACM conference series dedicated to recommender systems research and practice. This forum entry provides a structured overview of the conference within an awesome-list context, framing recommendation as a field facing challenges in efficiency, scalability, and user-intent understanding, especially as large language models (LLMs) reshape retrieval, ranking, and generation pipelines. The entry outlines core research themes: unified views of recommender architectures, method components such as representation learning, retrievers, rerankers, planners, generators, and feedback mechanisms, and reproducible benchmarks and datasets. It traces the technical evolution from matrix factorization and deep CTR models through sequential Transformers to generative recommendation and agentic search paradigms, where retrieval frequency and strategy become learnable. Key industry constraints discussed include latency budgets, cost, hallucination and safety risks, evaluation gaps between offline metrics and online satisfaction, and LLM-as-judge validation against human assessment. The post also offers an engineering checklist covering data privacy, caching, cascaded retrieval with early stopping, and model routing, and cross-references related events such as SIGIR workshops, CIKM MMSR, and EACL personalization workshops. Limitations noted include benchmark-real-world distribution mismatch and untested cross-lingual generalization.

RecSys: ACM Conference on Recommender Systems

  • Official site: https://recsys.acm.org/
  • Resource type: Conference / Workshop
  • Category: Conferences, Workshops
  • Research focus: Recommendation, large-scale search and personalization
  • One-line summary

    RecSys is the flagship ACM venue for recommender systems, covering key problems and novel approaches in recommendation, increasingly at the intersection with LLM-driven retrieval and generation.

    Conference Background and Scope

    In large-scale search, recommendation, and personalization systems, recommendation has long faced challenges in efficiency, scalability, and user-intent understanding. Traditional pipeline approaches separate retrieval, ranking, and generation, making it hard to meet LLM-era demands for natural-language interaction, multi-hop reasoning, and real-time knowledge. RecSys addresses this intersection of theory and practice.

    Core scenarios include: open-domain information access, enterprise knowledge retrieval, conversational search, semantic understanding in recommenders, and end-to-end architectures combining external knowledge sources with generative models.

    Core Topics and Contributions

    Typical RecSys work offers:

  • A unified perspective that brings scattered related work into a comparable framework.
  • Clear decomposition of method components — representation learning, retrievers, rerankers, planners, generators, feedback mechanisms — for engineering adoption.
  • Reproducible benchmarks, datasets, and taxonomy tables, lowering the entry cost for follow-up research.
  • Interfaces with emerging paradigms such as LLM tool calling, reinforcement learning, and multi-agent collaboration, with paths from research prototypes to industrial systems.
  • Explicit open problems: evaluation trustworthiness, latency and cost, hallucination and safety, cross-lingual and multimodal extension.
  • Typical Methodology

    Most papers follow a four-step pattern: problem formalization → model/system design → training or construction → inference pipeline.

    1. Input and representation: encode queries, documents, and user context into dense/sparse representations or structured prompts. 2. Core modules: retrievers, rerankers, planners, memory modules, and tool interfaces, chained or combined per task. 3. Learning strategies: supervised fine-tuning, contrastive learning, distillation, RL (including process rewards), bootstrapped data synthesis. 4. Inference strategies: single-pass retrieval, iterative retrieval, parallel sub-queries, early stopping, and budget control.

    Positioning in the SIGIR / RecSys Ecosystem

    See the official conference site for details on tracks, workshops, and proceedings.

    Key Insights for Search / Rec / Personalization

    1. Architecture: cascaded retrieval + reranking + generation remains mainstream, but the agentic paradigm turns "how many times and by what strategy to retrieve" into a learnable object. 2. Data: high-quality instruction data and click/session logs are equally critical; synthetic data must guard against knowledge leakage and distribution shift. 3. Evaluation: the gap between offline metrics and online satisfaction is widening; LLM-as-judge must be cross-validated with human evaluation. 4. Product: latency, cost, explainability, and safety policies are hard constraints for industrial deployment — do not optimize academic benchmarks alone.

    Technical Evolution Context

    Neural information retrieval has evolved from BM25 through BERT cross-encoders and dual-tower dense retrieval to late interaction, generative retrieval, and LLM agents — each generation balancing efficiency, effectiveness, and maintainability. Dense retrieval achieves millisecond-level recall via ANN search but is sensitive to domain shift and long-tail queries; cross-encoders are accurate but cannot precompute document representations; generative methods reduce cascade errors but complicate index updates.

    On the recommendation side, the field has moved from matrix factorization and deep CTR models through sequential Transformers to LLM instruction following and generative recommendation (Gen-Rec). Core tensions: sparse user behavior, huge item catalogs, and multi-objective business trade-offs. LLMs provide semantic priors and cold-start capability, but inference cost and hallucination risk demand careful system design. RAG and Agentic Search extend external knowledge access into an iterative, verifiable, plannable process, shifting evaluation from static nDCG toward task success rate, citation accuracy, and multi-hop reasoning-chain completeness.

    Engineering Checklist

    | Check | Question | Recommendation | |-------|----------|----------------| | Data | Does training/indexing contain PII? How is versioning managed? | Partitioned indexes, anonymization, rollback-capable embedding versions | | Latency | What is the p99 budget? How many retrieval steps? | Cascade + early stopping, cache hot queries, async reranking | | Quality | Do offline gains translate to online CTR/satisfaction? | Interleaving experiments, human audits, citation verification | | Safety | Does open retrieval introduce poisoning/bias? | Source whitelists, adversarial detection, output filtering | | Cost | Per-query token and GPU cost? | Route to smaller models, distillation, hybrid sparse+dense |

    Limitations and Notes

    Common limitations across this line of work: experiment scale constrained by GPU budgets; benchmarks mismatched to real user distributions; English-centric data leaving cross-lingual generalization unknown; and safety risks of agentic systems on the open web. Future directions include more efficient test-time compute allocation, deeper integration with knowledge graphs and structured databases, and causal/fairness constraints for recommenders.

    From Abstract to Implementation

    Paper abstracts emphasize best-case metrics, but engineering teams must also evaluate: index update frequency, embedding version compatibility, online A/B sensitivity, and failure modes (empty retrieval, wrong tool calls, over-generation). Pair this entry with related surveys, open-source implementations, and industry blogs to triangulate "paper contribution — open-source reproduction — production constraints." Treat paper conclusions as directional evidence; validate with small shadow experiments and A/B tests before full rollout.

    Glossary

    | Term | Meaning | |------|---------| | IR | Information Retrieval | | RAG | Retrieval-Augmented Generation | | LTR | Learning to Rank | | nDCG | Normalized Discounted Cumulative Gain, a ranking-quality metric | | Agentic Search | Modeling search as sequential decision-making and tool use | | Gen-IR | Generative Information Retrieval |

    Related Entries

  • 2025 SIGIR Workshop on eCommerce
  • Activate
  • CIKM 2024 1st Workshop on Multimodal Search and Recommendations
  • EACL 2024 Workshop on Personalization of Generative AI Systems
  • Haystack
  • ICDM MMSR 2025
  • References

  • Original entry: RecSys. See https://recsys.acm.org/ for proceedings and calls.

Tags

#recsys#recommender-systems#llm#information-retrieval#rag#generative-recommendation#ranking#conference

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178208509