Single-pixel imaging (SPI) is a novel imaging technique whose working principle is based on the compressive sensing (CS) theory. In SPI, data is obtained through a series of compressive measurements and the corresponding image is reconstructed. Typically, the reconstruction algorithm such as basis pursuit relies on the sparsity assumption in images. However, recent advances in deep learning have found its uses in reconstructing CS images. Despite showing a promising result in simulations, it is often unclear how such an algorithm can be implemented in an actual SPI setup. In this paper, we demonstrate the use of deep learning on the reconstruction of SPI images in conjunction with block compressive sensing (BCS). We also proposed a novel reconstruction model based on convolutional neural networks that outperforms other competitive CS reconstruction algorithms. Besides, by incorporating BCS in our deep learning model, we were able to reconstruct images of any size above a certain smallest image size. In addition, we show that our model is capable of reconstructing images obtained from an SPI setup while being priorly trained on natural images, which can be vastly different from the SPI images. This opens up opportunity for the feasibility of pretrained deep learning models for CS reconstructions of images from various domain areas.
翻译:单像素成像(STI)是一种新型的成像技术,其工作原理以压缩感测(CS)理论为基础。在SPI中,数据是通过一系列压缩测量获得的,相应的图像得到重建。一般情况下,基础追踪等重建算法依靠图像中的光度假设。然而,最近深层次学习的进展发现其在重建 CS 图像方面的用途。尽管在模拟中显示了一个有希望的结果,但这种算法如何能在实际的SPI 设置中实施却往往不清楚。在本文中,我们展示了利用与块压缩感测(BCS)相结合的关于重建SPI图像的深层次学习。我们还提出了一个以革命神经网络为基础的新的重建模型,这些网络超越了其他竞争性 CS重建算法。此外,通过将BCSS纳入我们的深层次学习模型,我们得以重建超过某些最小图像大小的任何图像。此外,我们展示了我们的模型能够重建从SPI 所设置的图像,同时接受过对自然图象的事先培训,这些图像的重建模型可以与SPI 的深度模型相比,这是非常不同的可能性。