BLAIR: Bridging Language and Items for Retrieval and Recommendation
Paper: arXiv:2403.03952 (March 2024) Authors: Yupeng Hou, Jiacheng Li, Xiangjun Fu, Zhankui He, An Yan, Xiusi Chen, et al. Category: Recommender Engines
Overview
BLAIR (Bridging Language and Items for Retrieval and Recommendation) addresses a core problem in LLM-based recommendation: large language models, trained mostly on general web text, handle domain-specific terminology and sparse item metadata poorly. The paper builds a large-scale, expert-annotated dataset that pairs product metadata with natural language, aligning the language and recommendation domains.
Key Contributions
- BLAIR summaries: over one million expert-annotated product summaries derived from Amazon product metadata. These summaries convey substantially richer information than the raw, often terse, item metadata available in recommendation datasets.
- BLAIR subsumption sentences: annotated sentences capturing nuanced relationships between product attributes (e.g., how features of one item relate to or generalize over another), which help models learn fine-grained item semantics.
- Improved alignment: fine-tuning language models on BLAIR improves performance on language understanding tasks while enabling better zero-shot generalization to recommendation tasks such as rating prediction and sequential recommendation.
- Recommendation datasets have sparse, domain-specific text; LLMs benefit from curated alignment data rather than relying on raw metadata.
- BLAIR offers a reusable resource for training and evaluating LLM-based recommenders, retrieval models, and semantic item representations.
- The expert-annotation pipeline provides a template for building similar alignment datasets in other verticals.
- 360Brew: A Decoder-only Foundation Model for Personalized Ranking
- Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers
- Data-efficient Fine-tuning for LLM-based Recommendation (SIGIR 2024)
- DiffKG: Knowledge Graph Diffusion Model for Recommendation (WSDM 2024)
- EAGER-LLM: Enhancing LLMs as Recommenders
Why It Matters
Evaluation Notes
The authors evaluate fine-tuned language models on both language understanding benchmarks and zero-shot recommendation tasks, showing gains relative to models without domain alignment. Exact numbers should be verified against the original PDF tables.
Context in the Field
This work sits at the intersection of LLMs and recommender systems, complementing research such as:
Limitations and Open Questions
As with most Amazon-based datasets, results may not transfer to other domains or languages, and the cost of expert annotation may limit scaling. Open questions include integrating such alignment data with causal/fairness constraints and reducing inference costs for LLM-based recommendation in production.
Reference: Bridging Language and Items for Retrieval and Recommendation, https://arxiv.org/abs/2403.03952