Camera gimbal systems are important in various air or water borne systems for applications such as navigation, target tracking, security and surveillance. A higher steering rate (rotation angle per second) of gimbal is preferable for real-time applications since a given field-of-view (FOV) can be revisited within a short period of time. However, due to relative motion between the gimbal and scene during the exposure time, the captured video frames can suffer from motion blur. Since most of the post-capture applications require blurfree images, motion deblurring in real-time is an important need. Even though there exist blind deblurring methods which aim to retrieve latent images from blurry inputs, they are constrained by very high-dimensional optimization thus incurring large execution times. On the other hand, deep learning methods for motion deblurring, though fast, do not generalize satisfactorily to different domains (e.g., air, water, etc). In this work, we address the problem of real-time motion deblurring in infrared (IR) images captured by a gimbal-based system. We reveal how a priori knowledge of the blur-kernel can be used in conjunction with non-blind deblurring methods to achieve real-time performance. Importantly, our mathematical model can be leveraged to create large-scale datasets with realistic gimbal motion blur. Such datasets which are a rarity can be a valuable asset for contemporary deep learning methods. We show that, in comparison to the state-of-the-art techniques in deblurring, our method is better suited for practical gimbal-based imaging systems.
翻译:相机 gimbal 系统在各种空气或水载系统中对于导航、目标跟踪、安保和监视等应用系统十分重要。 Gimbal 的更高指导率( 每秒旋转角度)对于实时应用来说更为可取,因为可以在短期内对特定视野领域(FOV)进行重新审视。然而,由于Gimbal和场景在接触期间的相对运动,所捕捉到的视频框架可能会因运动模糊而受到影响。由于捕获后的大多数应用都需要模糊的图像,实时的移动模糊是一个重要的需要。即使存在旨在从模糊输入中检索潜影图像的盲点模糊方法,但它们受到非常高的维度优化的限制,从而造成大量执行时间。另一方面,运动变形的深层学习方法虽然速度不快,但却无法向不同领域(如空气、水等)推广。在这项工作中,我们可以解决红外线(IR) 图像的实时变形变色移动问题。即使存在盲分解方法,但是在基于 gimbil 的模型系统中,我们如何用前期的数学方法来显示,这种变蓝的变现方法是如何在使用。