Hyperspectral Image Classification Using Multi-Scale Lightweight Transformer
Electronics · 29.02.2024 · 13 (5) · 949
DOI: 10.3390/electronics13050949 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 29.02.2024. Verfasst von Quan Gu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
The distinctive feature of hyperspectral images (HSIs) is their large number of spectral bands, which allows us to identify categories of ground objects by capturing discrepancies in spectral information. Convolutional neural networks (CNN) with attention modules effectively improve the classification accuracy of HSI. However, CNNs are not successful in capturing long-range spectral–spatial dependence. In recent years, Vision Transformer (VIT) has received widespread attention due to its excellent performance in acquiring long-range features. However, it requires calculating the pairwise correlation between token embeddings and has the complexity of the square of the number of tokens, which leads to an increase in the computational complexity of the network. In order to cope with this issue, this paper proposes a multi-scale spectral–spatial attention network with frequency-domain lightweight Transformer (MSA-LWFormer) for HSI classification. This method synergistically integrates CNN, attention mechanisms, and Transformer into the spectral–spatial feature extraction module and frequency-domain fused classification module. Specifically, the spectral–spatial feature extraction module employs a multi-scale 2D-CNN with multi-scale spectral attention (MS-SA) to extract the shallow spectral–spatial features and capture the long-range spectral dependence. In addition, The frequency-domain fused classification module designs a frequency-domain lightweight Transformer that employs the Fast Fourier Transform (FFT) to convert features from the spatial domain to the frequency domain, effectively extracting global information and significantly reducing the time complexity of the network. Experiments on three classic hyperspectral datasets show that MSA-LWFormer has excellent performance.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Gu, Q., Luan, H., Huang, K., & Sun, Y. (2024). Hyperspectral Image Classification Using Multi-Scale Lightweight Transformer. Electronics, 13(5), 949. https://doi.org/10.3390/electronics13050949
Vancouver
Gu Q, Luan H, Huang K, Sun Y. Hyperspectral Image Classification Using Multi-Scale Lightweight Transformer. Electronics. 2024;13(5):949. doi:10.3390/electronics13050949
BibTeX
@article{Gu2024,
author = {Gu, Quan and Luan, Hongkang and Huang, Kaixuan and Sun, Yubao},
title = {Hyperspectral Image Classification Using Multi-Scale Lightweight Transformer},
journal = {Electronics},
year = {2024},
volume = {13},
number = {5},
pages = {949},
doi = {10.3390/electronics13050949}
}
EUVIMED