Scene Background Initialization (SBI) is one of the challenging problems in computer vision. Dynamic mode decomposition (DMD) is a recently proposed method to robustly decompose a video sequence into the background model and the corresponding foreground part. However, this method needs to convert the color image into the grayscale image for processing, which leads to the neglect of the coupling information between the three channels of the color image. In this study, we propose a quaternion-based DMD (Q-DMD), which extends the DMD by quaternion matrix analysis, so as to completely preserve the inherent color structure of the color image and the color video. We exploit the standard eigenvalues of the quaternion matrix to compute its spectral decomposition and calculate the corresponding Q-DMD modes and eigenvalues. The results on the publicly available benchmark datasets prove that our Q-DMD outperforms the exact DMD method, and experiment results also demonstrate that the performance of our approach is comparable to that of the state-of-the-art ones.
翻译:场景背景初始化(SBI) 是计算机视觉中具有挑战性的问题之一。 动态模式分解( DMD) 是最近提出的一种将视频序列快速分解到背景模型和相应的前景部分的方法。 但是, 这种方法需要将彩色图像转换成灰度图像进行处理, 从而忽略了彩色图像的三个渠道之间的混合信息。 在这次研究中, 我们建议使用基于四元的 DMD( Q- DMD) 来扩展 DMD( Q- DMD), 通过四元矩阵分析来扩展 DMD( Q- DMD), 以便完全保存彩色图像和彩色视频的内在颜色结构。 我们利用四元矩阵的标准电子值来计算光谱分解并计算相应的Q- DMD模式和电子值。 公开的基准数据集的结果证明, 我们的Q- DMD( DMD) 超越了精确的 DMD方法, 实验结果还表明, 我们的方法的性能与最先进的方法相比。