For modern high-resolution imaging sensors, pixel binning is performed in low-lighting conditions and in case high frame rates are required. To recover the original spatial resolution, single-image super-resolution techniques can be applied for upscaling. To achieve a higher image quality after upscaling, we propose a novel binning concept using tetromino-shaped pixels. In doing so, we investigate the reconstruction quality using tetromino pixels for the first time in literature. Instead of using different types of tetrominoes as proposed in the literature for a sensor layout, we show that using a small repeating cell consisting of only four T-tetrominoes is sufficient. For reconstruction, we use a locally fully connected reconstruction (LFCR) network as well as two classical reconstruction methods from the field of compressed sensing. Using the LFCR network in combination with the proposed tetromino layout, we achieve superior image quality in terms of PSNR, SSIM, and visually compared to conventional single-image super-resolution using the very deep super-resolution (VDSR) network. For the PSNR, a gain of up to +1.92 dB is achieved.
翻译:对于现代高分辨率成像传感器来说,像素硬化是在低光度条件下进行的,如果需要高框架率。为了恢复原来的空间分辨率,可以应用单一图像超分辨率技术来升级。为了在升级后达到更高的图像质量,我们提出了一个使用Tetromino形状像素的新颖的硬化概念。我们这样做,我们第一次在文献中用Tetromino像素来调查重建质量。我们不使用文献中提议的用于传感器布局的不同类型Tetromino,而是使用只有四个T-tetromino的小型重复细胞。为了重建,我们使用了完全连接当地重建(LFCR)网络,以及从压缩遥感领域采用了两种典型重建方法。我们利用LFCR网络与拟议的Tetromino布局,在PSNR、SSIM和与常规的单层超分辨率相比,我们实现了高图像质量。我们利用非常深的超分辨率网络(VDSR)实现了PSNR+92。