UrbanCross: Enhancing Satellite Image-Text Retrieval with Cross-Domain Adaptation (ACM MM 2024)
Overview
UrbanCross is a paper published at ACM Multimedia 2024 that focuses on satellite image-text retrieval — the task of matching remote sensing imagery with natural language descriptions — using cross-domain adaptation techniques.
- Paper: UrbanCross: Enhancing Satellite Image-Text Retrieval with Cross-Domain Adaptation
- Venue: ACM Multimedia 2024 (MM '24)
- Link: https://dl.acm.org/doi/abs/10.1145/3664647.3680604
- DOI: 10.1145/3664647.3680604
- Cross-modal retrieval (image-text matching, dual-encoder alignment)
- Remote sensing / Earth observation
- Domain adaptation (transferring knowledge across visual domains)
- Cross-Modal Retrieval: A Systematic Review of Methods and Future Directions
- Clotho-AQA: A Crowdsourced Dataset for Audio Question Answering
- ColPali: Efficient Document Retrieval with Vision Language Models
- EA-VTR: Event-Aware Video-Text Retrieval (ECCV 2024)
- Generative Cross-Modal Retrieval: Memorizing Images in Multimodal Language Models
- Hybrid-Vector Retrieval for Visually Rich Documents
- UrbanCross: Enhancing Satellite Image-Text Retrieval with Cross-Domain Adaptation, ACM MM 2024. https://dl.acm.org/doi/abs/10.1145/3664647.3680604
Problem and Motivation
Satellite and aerial imagery differs substantially from natural photos in viewpoint, scale, and visual appearance. Cross-modal retrieval models trained primarily on natural image-caption corpora therefore suffer a significant domain gap when applied to remote sensing data. UrbanCross addresses this by adapting cross-modal alignment to the satellite imagery domain, improving text-to-image and image-to-text retrieval for geographic and Earth-observation applications.
Positioning in the Field
This work sits at the intersection of:
Related Entries
Notes
Detailed methodology, benchmark datasets, and quantitative results should be verified against the original paper PDF. Quantitative claims in this post are limited to what can be confirmed from the publication metadata.