Hyperspectral image denoising with sparse spatial-spectral transformer
DOI:
CSTR:
Author:
Affiliation:

School of Computer Science & School of Cyberspace Security, Nanjing University of Information Science & Technology,Nanjing 210044, China

Clc Number:

TP751

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    The application of Transformer models has improved the performance of hyperspectral image denoising. However, the original Transformer model still falls short in effectively leveraging the spatial-spectral coupling in HSIs. It tends to excessively smooth spatial features, leading to the loss of small-scale structures. Moreover, it overly emphasizes all spectral channel features, neglecting the differences between different spectral bands. In order to solve these problems, this paper introduces a novel Sparse Spatial-Spectral Transformer model, enhancing the utilization of spatial-spectral coupling. In the spatial dimension, a local enhancement module is introduced to refine spatial feature details and deal with oversmoothing problem. Simultaneously, in the spectral dimension, a Top-k sparse self-attention mechanism is proposed, which adaptively selects the top-K most relevant spectral channel features for feature interaction, effectively capturing spatial-spectral characteristics. Ultimately, hyperspectral image denoising is achieved through hierarchical residual connections with the Sparse Spatial-Spectral Transformer. On the ICVL dataset, denoising performance for both Gaussian noise and complex noise attains peak signal-to-noise ratios of 40.56 dB and 40.19 dB, respectively, demonstrating the superior performance of the proposed Sparse Spatial-Spectral Transformer model in this paper.

    Reference
    Related
    Cited by
Get Citation
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:
  • Revised:
  • Adopted:
  • Online: April 24,2024
  • Published:
Article QR Code