It is very challenging for various visual tasks such as image fusion, pedestrian detection and image-to-image translation in low light conditions due to the loss of effective target areas. In this case, infrared and visible images can be used together to provide both rich detail information and effective target areas. In this paper, we present LLVIP, a visible-infrared paired dataset for low-light vision. This dataset contains 30976 images, or 15488 pairs, most of which were taken at very dark scenes, and all of the images are strictly aligned in time and space. Pedestrians in the dataset are labeled. We compare the dataset with other visible-infrared datasets and evaluate the performance of some popular visual algorithms including image fusion, pedestrian detection and image-to-image translation on the dataset. The experimental results demonstrate the complementary effect of fusion on image information, and find the deficiency of existing algorithms of the three visual tasks in very low-light conditions. We believe the LLVIP dataset will contribute to the community of computer vision by promoting image fusion, pedestrian detection and image-to-image translation in very low-light applications. The dataset is being released in https://bupt-ai-cz.github.io/LLVIP. Raw data is also provided for further research such as image registration.
翻译:对于各种视觉任务,例如图像聚合、行人探测和图像到图像的图像翻译等,由于有效目标区域丧失,在低光条件下的低光条件下,这些视觉任务非常艰巨。在这种情况下,红红外图像和可见图像可以一起使用,以提供丰富的详细信息和有效的目标区域。在本文中,我们展示了一个可见的红外相配对的低光视觉数据集LLVIP。该数据集包含30976图像,或15488对对,其中大部分是在非常暗的场景拍摄的,所有图像都严格在时间和空间上对齐。数据集有标签。我们将数据集与其他可见红外数据集进行比较,并评估一些流行的视觉算法的性,包括图像融合、行人探测和图像到图像的翻译。实验结果显示了对图像信息的融合的互补效应,并在非常暗的场上发现三种视觉任务的现有算法的缺陷。我们认为LLVIP数据集将进一步促进图像融合、行人探测和图像定位数据集,从而帮助计算机视觉社区。在 ALP-LV-LUD 数据库中提供这种低光度数据。