The design and evaluation of complex systems can benefit from a software simulation - sometimes called a digital twin. The simulation can be used to characterize system performance or to test its performance under conditions that are difficult to measure (e.g., nighttime for automotive perception systems). We describe the image system simulation software tools that we use to evaluate the performance of image systems for object (automobile) detection. We describe experiments with 13 different cameras with a variety of optics and pixel sizes. To measure the impact of camera spatial resolution, we designed a collection of driving scenes that had cars at many different distances. We quantified system performance by measuring average precision and we report a trend relating system resolution and object detection performance. We also quantified the large performance degradation under nighttime conditions, compared to daytime, for all cameras and a COCO pre-trained network.
翻译:复杂系统的设计和评估可受益于软件模拟,有时称为数字双对。模拟可用于描述系统性能,或在难以测量的条件下测试系统性能(例如汽车感知系统的夜间时间)。我们描述图像系统模拟软件工具,用以评价用于探测物体(汽车)的图像系统性能。我们描述13个不同摄影机的实验,这些摄影机有各种光学和像素尺寸。为了测量摄影机空间分辨率的影响,我们设计了一套汽车距离很远的驾驶场景。我们通过测量平均精确度对系统性能进行量化,并报告一个与系统分辨率和物体探测性能有关的趋势。我们还量化了所有照相机和COCO预先训练的网络在夜间性能与白天性能严重下降的情况。</s>