EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ARA-RSIC: Adaptive Retrieval-Augmented Large Vision-Language Model for Remote Sensing Image Captioning

Kangda Cheng, Wudi Zhao, Jinlong Liu

Entropy · 11.11.2026 · 28 (11) · 1242

DOI: 10.3390/e28111242 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 11.11.2026. Verfasst von Kangda Cheng und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jimei University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent advances in large vision-language models (LVLMs) have significantly improved multimodal understanding and generation. However, adapting these foundation models to specialized domains remains challenging due to domain-specific knowledge gaps, limited reasoning over fine-grained concepts, and insufficient access to external knowledge. Remote sensing image captioning (RSIC) represents a challenging scenario where general-purpose LVLMs often struggle to capture specialized semantics and complex spatial relationships. Retrieval-Augmented Generation (RAG) enables LVLMs to use external examples, but simple similarity-retrieval prompting does not explicitly coordinate context diversity, learned evidence weighting, and selective caption revision. In this work, we propose ARA-RSIC, an Adaptive Retrieval-Augmented Generation framework that enhances LVLM adaptation and multimodal reasoning for remote sensing scenarios. The framework’s contribution lies in coordinating three task-specific mechanisms: image-query-based cross-modal candidate reranking and adaptive context selection in MMCR; query- and retrieval-conditioned gated cross-attention in the Qwen2VL-7B generator; and confidence-triggered context revision with a constrained caption acceptance rule. RemoteCLIP embeddings, MMR, and LoRA are adopted as established building blocks rather than claimed as new algorithms. This integrated design enables selective retrieval, explicit learned weighting of retrieved evidence, and targeted revision beyond fixed-example prompting. Experiments on UCM-Captions, Sydney-Captions, and RSICD show strong BLEU performance and improvements over controlled retrieval-and-generation ablations. On RSICD, the highest BLEU scores coexist with lower ROUGE_L and CIDEr scores than those of selected competing methods, revealing metric-dependent trade-offs in remote sensing captioning.

Förderung

  • Jimei University

Zitieren

APA

Cheng, K., Zhao, W., & Liu, J. (2026). ARA-RSIC: Adaptive Retrieval-Augmented Large Vision-Language Model for Remote Sensing Image Captioning. Entropy, 28(11), 1242. https://doi.org/10.3390/e28111242

Vancouver

Cheng K, Zhao W, Liu J. ARA-RSIC: Adaptive Retrieval-Augmented Large Vision-Language Model for Remote Sensing Image Captioning. Entropy. 2026;28(11):1242. doi:10.3390/e28111242

BibTeX
@article{Cheng2026,
  author = {Cheng, Kangda and Zhao, Wudi and Liu, Jinlong},
  title = {ARA-RSIC: Adaptive Retrieval-Augmented Large Vision-Language Model for Remote Sensing Image Captioning},
  journal = {Entropy},
  year = {2026},
  volume = {28},
  number = {11},
  pages = {1242},
  doi = {10.3390/e28111242}
}
Kostenlos starten →