EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hyperspectral Image Classification Using Multi-Scale Lightweight Transformer

Quan Gu, Hongkang Luan, Kaixuan Huang, Yubao Sun

Electronics · 29.02.2024 · 13 (5) · 949

DOI: 10.3390/electronics13050949 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 29.02.2024. Verfasst von Quan Gu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The distinctive feature of hyperspectral images (HSIs) is their large number of spectral bands, which allows us to identify categories of ground objects by capturing discrepancies in spectral information. Convolutional neural networks (CNN) with attention modules effectively improve the classification accuracy of HSI. However, CNNs are not successful in capturing long-range spectral–spatial dependence. In recent years, Vision Transformer (VIT) has received widespread attention due to its excellent performance in acquiring long-range features. However, it requires calculating the pairwise correlation between token embeddings and has the complexity of the square of the number of tokens, which leads to an increase in the computational complexity of the network. In order to cope with this issue, this paper proposes a multi-scale spectral–spatial attention network with frequency-domain lightweight Transformer (MSA-LWFormer) for HSI classification. This method synergistically integrates CNN, attention mechanisms, and Transformer into the spectral–spatial feature extraction module and frequency-domain fused classification module. Specifically, the spectral–spatial feature extraction module employs a multi-scale 2D-CNN with multi-scale spectral attention (MS-SA) to extract the shallow spectral–spatial features and capture the long-range spectral dependence. In addition, The frequency-domain fused classification module designs a frequency-domain lightweight Transformer that employs the Fast Fourier Transform (FFT) to convert features from the spatial domain to the frequency domain, effectively extracting global information and significantly reducing the time complexity of the network. Experiments on three classic hyperspectral datasets show that MSA-LWFormer has excellent performance.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Gu, Q., Luan, H., Huang, K., & Sun, Y. (2024). Hyperspectral Image Classification Using Multi-Scale Lightweight Transformer. Electronics, 13(5), 949. https://doi.org/10.3390/electronics13050949

Vancouver

Gu Q, Luan H, Huang K, Sun Y. Hyperspectral Image Classification Using Multi-Scale Lightweight Transformer. Electronics. 2024;13(5):949. doi:10.3390/electronics13050949

BibTeX
@article{Gu2024,
  author = {Gu, Quan and Luan, Hongkang and Huang, Kaixuan and Sun, Yubao},
  title = {Hyperspectral Image Classification Using Multi-Scale Lightweight Transformer},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {5},
  pages = {949},
  doi = {10.3390/electronics13050949}
}
Kostenlos starten →