Hyperspectral images (HSIs) often suffer from diverse and unknown degradations during imaging, leading to severe spectral and spatial distortions. Existing HSI restoration methods typically rely on specific degradation assumptions, limiting their effectiveness in complex scenarios. In this paper, we propose \textbf{MP-HSIR}, a novel multi-prompt framework that effectively integrates spectral, textual, and visual prompts to achieve universal HSI restoration across diverse degradation types and intensities. Specifically, we develop a prompt-guided spatial-spectral transformer, which incorporates spatial self-attention and a prompt-guided dual-branch spectral self-attention. Since degradations affect spectral features differently, we introduce spectral prompts in the local spectral branch to provide universal low-rank spectral patterns as prior knowledge for enhancing spectral reconstruction. Furthermore, the text-visual synergistic prompt fuses high-level semantic representations with fine-grained visual features to encode degradation information, thereby guiding the restoration process. Extensive experiments on 9 HSI restoration tasks, including all-in-one scenarios, generalization tests, and real-world cases, demonstrate that MP-HSIR not only consistently outperforms existing all-in-one methods but also surpasses state-of-the-art task-specific approaches across multiple tasks. The code and models are available at https://github.com/ZhehuiWu/MP-HSIR.
翻译:高光谱图像在成像过程中常遭受多样且未知的退化,导致严重的光谱与空间失真。现有高光谱图像复原方法通常依赖于特定的退化假设,限制了其在复杂场景下的有效性。本文提出\textbf{MP-HSIR},一种新颖的多提示框架,通过有效整合光谱、文本与视觉提示,实现对多种退化类型与强度的通用高光谱图像复原。具体而言,我们设计了一种提示引导的空间-光谱Transformer,该架构融合了空间自注意力机制与提示引导的双分支光谱自注意力机制。由于退化对光谱特征的影响方式各异,我们在局部光谱分支中引入光谱提示,以提供通用的低秩光谱模式作为先验知识,从而增强光谱重建效果。此外,文本-视觉协同提示将高层语义表征与细粒度视觉特征相融合,以编码退化信息,进而引导复原过程。在涵盖一体化场景、泛化测试及真实案例的9项高光谱图像复原任务上进行的大量实验表明,MP-HSIR不仅在一体化方法中持续优于现有方案,还在多项任务中超越了当前最先进的专用方法。代码与模型已发布于 https://github.com/ZhehuiWu/MP-HSIR。