Thermal images can be obtained as either grayscale images or pseudo colored images based on the thermal profile of the object being captured. In this work, we explore what an optimal encoder decoder might look like for creating a thermal-optical fused domain image. We compare the results from several different encoder-decoder structures with different networks to answer this question. This output images obtained from our method provides information of both domains jointly in a colorized image. We call this a cross domain colorized image. We also present a robust registration method for thermal and optical pairs, which can work despite changes in resolution and the make of the thermal imager. Lastly, we present a unique public dataset with registered thermal-visual image pairs containing around 1800 images as a part of this work, collected over a period of 2 years. We compare our results with prior literature, show how our results are different and discuss on some future work that can be explored further in this domain.
翻译:热图像可以以灰度图像或假色图像获取, 以所捕获对象的热配置为基础。 在这项工作中, 我们探索创建热光导引信域图时, 最理想的编码器解码器是什么样子的。 我们比较了多个不同的编码器解码器结构的结果和不同的网络来回答这个问题。 从我们的方法获得的这种输出图像以彩色图像的形式共同提供两个域的信息。 我们称它为跨域的彩色图像。 我们还为热和光学配对提供了一种强有力的登记方法, 尽管分辨率和热成像器的造型有所变化, 仍然可以发挥作用。 最后, 我们展示了一个独特的公共数据集, 由注册的热视图像配对组成, 包含大约1800张图像, 作为这项工作的一部分, 收集了两年时间。 我们比较了我们的成果和先前的文献, 显示我们的结果如何不同, 并讨论今后可以在这一领域进一步探索的工作。