DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultation
- Paper: arXiv:2308.14346
- Authors: Zhijie Bao, Wei Chen, Shengze Xiao, Kuang Ren, Jiaao Wu, Cheng Zhong, et al. (9 authors in total)
- Published: August 2023 (arXiv preprint)
- Category: Vertical-domain LLMs (Healthcare)
- Service-oriented objective: The model is tuned for instruction-driven, multi-turn medical conversations rather than single-turn benchmark answering, reflecting how patients actually interact with online consultation platforms.
- Dataset construction pipeline: The authors build a supervised fine-tuning dataset that combines:
- Multi-turn conversational data derived from real online consultation records;
- Knowledge-base-grounded QA pairs to inject reliable medical knowledge;
- Patient-agent simulated dialogues to expand coverage of triage and dialogue behaviors.
- Behavioral goals: faithfulness (reducing hallucinated medical claims), multi-turn contextual awareness, and goal-oriented triage (guiding patients to appropriate departments or care).
- Original paper: DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultation. https://arxiv.org/abs/2308.14346
Overview
DISC-MedLLM is a medical-domain large language model designed to bridge the gap between general-purpose LLMs and real-world medical consultation services. Rather than focusing solely on medical exam QA, the project targets practical service scenarios: multi-turn patient-doctor dialogues, medical information provision, and auxiliary triage.
Key Ideas
Model and Training
The model is initialized from an open-source general-purpose Chinese LLM base and adapted via supervised fine-tuning on the curated medical instruction dataset, following a standard instruction-tuning recipe adapted to the healthcare vertical.
Evaluation
Experiments compare DISC-MedLLM against general-purpose and medical LLM baselines, with both automatic metrics and human/LLM evaluation emphasizing the service-oriented properties listed above. Readers should consult the original PDF tables for exact quantitative results.
Significance
Released in August 2023, DISC-MedLLM was among the early open efforts to adapt general LLMs to trustworthy healthcare dialogue, including discussion of hallucination mitigation, evaluation methodology, and deployment considerations. The model and data resources were released publicly.