EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ClinX ‐Net: Multimodal Visual–Language Feature Fusion for Chest X‐Ray Report Generation

Muhammad Sufyan Khan, Azhar Imran, Syed Muhammad Usman, Ahmad Alshammari, Yalin Zheng, Bilal Hassan

International Journal of Imaging Systems and Technology · 2026-11 · 36 (6)

DOI: 10.1002/ima.70469 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Imaging Systems and Technology, online erschienen am 30.10.2026. Verfasst von Muhammad Sufyan Khan und 5 weiteren Autor:innen. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated chest X‐ray report generation has the potential to improve reporting efficiency and reduce variability in radiological documentation. However, existing methods remain challenged by subtle abnormality description, long‐range textual consistency, and effective integration of clinical information with visual findings. To address these limitations, we propose ClinX‐Net, a multimodal framework for chest X‐ray report generation that combines hierarchical visual representation learning, disease‐aware semantic encoding, and language‐model‐based text generation. The visual branch employs ConvNeXt to extract multilevel chest radiograph features, which are integrated through multiscale fusion to capture global anatomical structures and localized pathological patterns. Disease label representations are incorporated to provide additional semantic guidance, while a BioBERT encoder captures clinical context from radiology‐related text. The resulting visual, disease‐semantic, and clinical representations are fused to condition a T5‐based decoder for report generation. Experiments were conducted on the publicly available IU X‐Ray and MIMIC‐CXR datasets. On IU X‐Ray, ClinX‐Net achieved a BLEU‐4 of 0.199, ROUGE‐L score of 0.454 and a METEOR score of 0.222, while on MIMIC‐CXR, it achieved BLEU‐4, ROUGE‐L, and METEOR scores of 0.122, 0.296, and 0.174, respectively. Additional semantic and clinical evaluations using BERTScore and CheXbert demonstrate improved contextual similarity and preservation of clinically relevant observations in generated reports. Qualitative analysis further shows improved anatomical descriptions and better localization of reported findings. These results indicate that integrating hierarchical visual features, disease‐aware semantic representations, and clinical context improves the quality and clinical relevance of automated chest X‐ray report generation.

Zitieren

APA

Khan, M. S., Imran, A., Usman, S. M., Alshammari, A., Zheng, Y., & Hassan, B. (2026). ClinX ‐Net: Multimodal Visual–Language Feature Fusion for Chest X‐Ray Report Generation. International Journal of Imaging Systems and Technology, 36(6). https://doi.org/10.1002/ima.70469

Vancouver

Khan MS, Imran A, Usman SM, Alshammari A, Zheng Y, Hassan B. ClinX ‐Net: Multimodal Visual–Language Feature Fusion for Chest X‐Ray Report Generation. International Journal of Imaging Systems and Technology. 2026;36(6). doi:10.1002/ima.70469

BibTeX
@article{Khan2026,
  author = {Khan, Muhammad Sufyan and Imran, Azhar and Usman, Syed Muhammad and Alshammari, Ahmad and Zheng, Yalin and Hassan, Bilal},
  title = {ClinX ‐Net: Multimodal Visual–Language Feature Fusion for Chest X‐Ray Report Generation},
  journal = {International Journal of Imaging Systems and Technology},
  year = {2026},
  volume = {36},
  number = {6},
  doi = {10.1002/ima.70469}
}
Kostenlos starten →