TY - JOUR
T1 - Spectral-spatial wave and frequency interactive transformer for hyperspectral image classification
AU - Arshad, Tahir
AU - peng, Bo
AU - Rahman, Ali
AU - khan, Rahim
AU - khan, Sajid Ullah
AU - Alnazi, Sultan
AU - Alturki, Nazik
N1 - Publisher Copyright:
© The Author(s) 2025.
PY - 2025/12
Y1 - 2025/12
N2 - Efficient extraction of spectral-spatial features is essential for accurate hyperspectral image (HSI) classification, where capturing both local texture and global semantic relationships is critical. While Convolutional Neural Networks (CNNs) and Transformers have shown strong capabilities in modeling local and global dependencies, most existing architectures operate directly on raw spectral-spatial inputs and lack explicit mechanisms for frequency-domain decomposition thereby overlooking potentially discriminative phase and frequency components. To address this limitation, we propose a Spectral-Spatial Wave and Frequency Interactive Transformer for HSI classification, which integrates frequency-aware and phase-aware token representations into a unified Transformer framework. Specifically, our model first employs a CNN backbone to extract shallow spectral-spatial features. These are then processed by a novel Frequency Domain Transformer Encoder, composed of two complementary branches: (i) a Spectral-Spatial Frequency Generator that extracts multiscale frequency features, and (ii) a Spectral-Spatial Wave Generator that encodes phase and amplitude characteristics as complex-valued wave tokens. A Spectral-Spatial Interaction Module fuses these components, followed by a Local-Global Modulator that refines semantic representations from multiple perspectives. Extensive experiments on five benchmark HSI datasets, demonstrate the effectiveness of our approach. The proposed model achieves state-of-the-art classification performance, with Overall Accuracies of 98.49%, 98.60%, 99.07%, 98.29%, and 97.97%, consistently outperforming existing methods.
AB - Efficient extraction of spectral-spatial features is essential for accurate hyperspectral image (HSI) classification, where capturing both local texture and global semantic relationships is critical. While Convolutional Neural Networks (CNNs) and Transformers have shown strong capabilities in modeling local and global dependencies, most existing architectures operate directly on raw spectral-spatial inputs and lack explicit mechanisms for frequency-domain decomposition thereby overlooking potentially discriminative phase and frequency components. To address this limitation, we propose a Spectral-Spatial Wave and Frequency Interactive Transformer for HSI classification, which integrates frequency-aware and phase-aware token representations into a unified Transformer framework. Specifically, our model first employs a CNN backbone to extract shallow spectral-spatial features. These are then processed by a novel Frequency Domain Transformer Encoder, composed of two complementary branches: (i) a Spectral-Spatial Frequency Generator that extracts multiscale frequency features, and (ii) a Spectral-Spatial Wave Generator that encodes phase and amplitude characteristics as complex-valued wave tokens. A Spectral-Spatial Interaction Module fuses these components, followed by a Local-Global Modulator that refines semantic representations from multiple perspectives. Extensive experiments on five benchmark HSI datasets, demonstrate the effectiveness of our approach. The proposed model achieves state-of-the-art classification performance, with Overall Accuracies of 98.49%, 98.60%, 99.07%, 98.29%, and 97.97%, consistently outperforming existing methods.
KW - Attention module
KW - Convolutional neural network
KW - Frequency domain
KW - Hyperspectral image classification
KW - Vision transformer
UR - http://www.scopus.com/inward/record.url?scp=105011684632&partnerID=8YFLogxK
U2 - 10.1038/s41598-025-12489-3
DO - 10.1038/s41598-025-12489-3
M3 - Article
C2 - 40715305
AN - SCOPUS:105011684632
SN - 2045-2322
VL - 15
JO - Scientific Reports
JF - Scientific Reports
IS - 1
M1 - 27259
ER -