LLMRec: Large Language Models with Graph Augmentation for Recommendation (WSDM 2024)
Overview
LLMRec is a paper published at WSDM 2024 that integrates Large Language Models (LLMs) with graph augmentation to improve recommendation systems built on collaborative filtering.
- Paper link: https://dl.acm.org/doi/abs/10.1145/3616855.3635853
- Venue: WSDM 2024
- Category: Recommender Engines
- Users interact with only a tiny fraction of the item catalog, so the user–item bipartite graph is highly incomplete.
- Sparse graphs degrade the quality of learned embeddings and reduce recommendation accuracy.
- Experiments on public benchmark datasets show that LLMRec consistently outperforms competitive recommendation baselines.
- The results demonstrate that LLM knowledge can be effectively distilled into graph-structured recommenders, improving accuracy even for sparse-interaction users.
- Careful denoising is essential: naive LLM augmentation can inject noise, and the quality-control step is a core contribution.
- 360Brew: A Decoder-only Foundation Model for Personalized Ranking
- Bridging Language and Items for Retrieval and Recommendation
- DiffKG: Knowledge Graph Diffusion Model for Recommendation (WSDM 2024)
- Data-efficient Fine-tuning for LLM-based Recommendation (SIGIR 2024)
- LLMs can serve as semantic priors to solve the sparsity problem in graph-based recommendation.
- Augmentation pipelines must include denoising/verification to control hallucination risk.
- LLM-augmented graphs remain compatible with conventional GNN-based CF architectures, easing industrial adoption.
Motivation
Graph-based collaborative filtering recommenders are bottlenecked by the sparsity and noise of user–item interaction data:
LLMRec's key idea is to use the world knowledge of LLMs to infer users' preferences toward items they have not interacted with, effectively augmenting the interaction graph with high-quality synthetic edges.
Method
1. LLM-based augmentation: Auxiliary prompting strategies are used to have the LLM infer user attitudes toward un-interacted items, generating augmented user–item interactions. 2. Denoising: A denoising mechanism (an auxiliary denoising loss) filters unreliable or hallucinated LLM feedback so that noisy augmented edges do not harm training. 3. Recommendation: The enhanced graph is fed into standard graph collaborative filtering models for training and inference.
Findings
Context and Related Entries
This entry is part of a series on LLM-enhanced search and recommendation, cross-referenced with: