Image retrieval under generalized test scenarios has gained significant momentum in literature, and the recently proposed protocol of Universal Cross-domain Retrieval is a pioneer in this direction. A common practice in any such generalized classification or retrieval algorithm is to exploit samples from multiple domains during training to learn a domain-invariant representation of data. Such criterion is often restrictive, and thus in this work, for the first time, we explore the challenges associated with generalized retrieval problems under a low-data regime, which is quite relevant in many real-world scenarios. We attempt to make any retrieval model trained on a small cross-domain dataset (containing just two training domains) more generalizable towards any unknown query domain or category by quickly adapting it to the test data during inference. This form of test-time training or adaptation of the retrieval model is explored by means of a number of self-supervision-based loss functions, for example, Rotnet, Jigsaw-puzzle, Barlow twins, etc., in this work. Extensive experiments on multiple large-scale datasets demonstrate the effectiveness of the proposed approach.
翻译:在通用测试情景下,图像检索在一般测试情景下获得了巨大的势头,最近提出的《环球交叉域检索协议》是这方面的先驱。任何此类通用分类或检索算法的常见做法都是在培训期间利用多个领域的样本来学习域内变化的数据说明。这种标准往往是限制性的,因此在这项工作中,我们首次探索在低数据制度下与普遍检索问题相关的挑战,这种低数据制度在许多现实世界情景中具有相当的相关性。我们试图使任何关于小型跨域数据集(仅包含两个培训领域)的检索模型更加普遍地适用于任何未知的查询域或类别,在推论期间将其迅速调整为测试数据。这种测试时间培训或对检索模型的调整形式是通过一些基于自我监督的损失功能来探索的,例如,Rotnet、Jigsaw-puzzle、Barlow双胞等,在这项工作中,对多个大型数据集进行广泛的实验,展示了拟议方法的有效性。