Paper Overview
- Field: NLP (medical vision-language modeling)
- Authors: Shiao Xie, Siyu Chen, Jianwei Lv, Bo Yuan, Yujin Wang, Xiandong Li
- Published: 2026-08-22
- arXiv: 2608.20331
- Explain medical report findings in plain, lay-friendly language
- Stay grounded in visual evidence from the associated medical images
- Adapt the explanation to the specific patient's background and context
- 3,020 radiology reports
- Corresponding patient backgrounds
- Matching medical images
- Factually accurate with respect to the source report and images
- Tailored to the individual patient's situation
Introduction
Personalized interpretation of medical reports has become an increasingly important need among patients. Meeting this need requires both evidence-grounded medical factuality and context-dependent patient communication — two requirements that existing medical vision-language tasks fail to fully capture.
The PMRI Task
To bridge this gap, the authors introduce Patient-Oriented Medical Report Interpretation (PMRI), a novel open-ended multimodal generation task. Models must:
Dataset
The paper contributes a multimodal dataset consisting of:
The G-CARL Method
G-CARL (Grounded Checklist-Aligned Reward Learning) is a reinforcement learning from human feedback (RLHF) approach. It uses structured checklists to guide the model, ensuring outputs are:
Results
Experiments show that G-CARL significantly improves both factual accuracy and patient satisfaction, paving the way for more personalized and reliable communication in medical AI.
---
Paper: arXiv:2608.20331