English static mirror for SEO/GEO · AI-assisted translation · Read Chinese original

Medical Image Segmentation: Foundation Model Adaptation vs Task-Specific Models (DINOv2 Study)

Forum topic · 小凯 · 2026-11-12

Summary

This paper (arXiv:2611.14519) by Emre Kutlusan and Yongmin Li compares the adaptation of the DINOv2 foundation model against task-specific U-Net and ResU-Net models for medical image segmentation across colonoscopy, breast ultrasound, and dermoscopy. DINOv2 was adapted using strategies from bias-only tuning to full fine-tuning, and evaluated on held-out in-distribution data and independent external datasets from other clinical institutions. Key findings: adapted foundation models generalize better on all external datasets; within the training distribution, task-specific models remain competitive when data is abundant and produce finer lesion boundary delineation, while foundation models tend to miss small lesions; only a small fraction of the foundation model's capacity needs adapting, with the required capacity determined by the imaging domain rather than the adaptation method; and the authors discovered image duplication between a widely used polyp test set and another benchmark. The authors conclude that adapting foundation models is worthwhile for cross-site clinical scenarios, and adaptation capacity should be selected based on the target domain.

Paper Overview

  • Research area: Computer Vision (CV)
  • Authors: Emre Kutlusan, Yongmin Li
  • Published: 2026-11-10
  • arXiv: 2611.14519
  • Summary

    Foundation models pretrained on large natural-image collections are increasingly adapted for medical image segmentation, with the expectation that they will replace models trained for each individual task. However, most prior comparisons rely on data from the training distribution and a single task-specific baseline whose configuration is rarely justified, providing limited evidence of performance at new clinical sites. It also remains unclear how much of a foundation model must be adapted, and what determines this.

    The authors adapted DINOv2 with strategies ranging from tuning only its bias terms to full fine-tuning, and compared it with U-Nets and ResU-Nets trained from scratch. Experiments covered colonoscopy, breast ultrasound, and dermoscopy, with testing on both held-out data from the training source and independent datasets from other institutions.

    Key Findings

  • Adapted foundation models generalize better on all external datasets.
  • Within the training distribution, task-specific models remain competitive when sufficient data is available and achieve finer lesion boundary delineation; foundation models are more prone to missing small lesions.
  • Foundation models only require adapting a small fraction of their capacity; the required capacity is determined by the imaging domain rather than by the adaptation method.
  • The authors discovered image duplication between a widely used polyp test set and another benchmark.

Conclusion

Adapting foundation models is worthwhile for cross-site clinical scenarios, and the adaptation capacity should be selected based on the target imaging domain.

Tags

#medical-imaging#image-segmentation#foundation-models#dinov2#computer-vision#deep-learning#arxiv

This page is an English static mirror generated for search and AI citation. It may be a full translation or structured summary of the Chinese original. Canonical interactive discussion lives on the Chinese page: https://zhichai.net/topic/178637060