Product images are essential for providing desirable user experience in an e-commerce platform. For a platform with billions of products, it is extremely time-costly and labor-expensive to manually pick and organize qualified images. Furthermore, there are the numerous and complicated image rules that a product image needs to comply in order to be generated/selected. To address these challenges, in this paper, we present a new learning framework in order to achieve Automatic Generation of Product-Image Sequence (AGPIS) in e-commerce. To this end, we propose a Multi-modality Unified Image-sequence Classifier (MUIsC), which is able to simultaneously detect all categories of rule violations through learning. MUIsC leverages textual review feedback as the additional training target and utilizes product textual description to provide extra semantic information. Based on offline evaluations, we show that the proposed MUIsC significantly outperforms various baselines. Besides MUIsC, we also integrate some other important modules in the proposed framework, such as primary image selection, noncompliant content detection, and image deduplication. With all these modules, our framework works effectively and efficiently in JD.com recommendation platform. By Dec 2021, our AGPIS framework has generated high-standard images for about 1.5 million products and achieves 13.6% in reject rate.
翻译:为了在电子商务平台上提供理想的用户经验,产品图象是必不可少的。 对于拥有数十亿产品的平台来说,人工挑选和组织合格图像非常耗时和耗费人力,人工挑选和组织合格图像非常费时。此外,产品图象需要遵守许多复杂的图像规则才能产生/选择。为了应对这些挑战,我们在本文件中提出一个新的学习框架,以实现电子商务产品自动生成序列(AGPIS)的基线。为此,我们还提议了一个多式统一图像序列分类器(MUSIC),该分类器能够通过学习同时检测所有类型的违反规则行为。MUISC利用文本审查反馈作为额外的培训目标,并利用产品文本描述提供额外的语义信息。根据离线评价,我们显示拟议的MUISC大大超越了各种基线。除了MUISC外,我们还将其他一些重要模块纳入拟议的框架,例如原始图像选择、不合规内容检测和图像解析。 通过所有这些模块, JUIS C 有效完成了我们15GP6 标准格式的15 标准模型工作,我们在1321 标准模型中有效完成了15 % 标准化的模型和15GP6 标准化产品。