Data valuation is critical in machine learning, as it helps enhance model transparency and protect data properties. Existing data valuation methods have primarily focused on discriminative models, neglecting deep generative models that have recently gained considerable attention. Similar to discriminative models, there is an urgent need to assess data contributions in deep generative models as well. However, previous data valuation approaches mainly relied on discriminative model performance metrics and required model retraining. Consequently, they cannot be applied directly and efficiently to recent deep generative models, such as generative adversarial networks and diffusion models, in practice. To bridge this gap, we formulate the data valuation problem in generative models from a similarity-matching perspective. Specifically, we introduce Generative Model Valuator (GMValuator), the first model-agnostic approach for any generative models, designed to provide data valuation for generation tasks. We have conducted extensive experiments to demonstrate the effectiveness of the proposed method. To the best of their knowledge, GMValuator is the first work that offers a training-free, post-hoc data valuation strategy for deep generative models.
翻译:数据估价对机器学习至关重要,它有助于增强模型的透明度并保护数据的特性。现有的数据估价方法主要集中在判别模型上,忽略了近来备受关注的深度生成模型。与判别模型类似,迫切需要评估深度生成模型中的数据贡献。然而,以前的数据估价方法主要依赖于判别模型的性能指标,并需要模型重训练。因此,它们不能直接和高效地应用于最近的深度生成模型,如生成对抗网络和扩散模型。为了填补这一空白,我们从一个相似-匹配的视角来形式化生成模型中的数据估价问题。具体而言,我们介绍了 GMValuator,这是第一个针对任何生成模型的模型无关方法,旨在为生成任务提供数据估价。我们进行了大量实验来证明所提出方法的有效性。据我们所知,GMValuator 是第一个提供仅依赖生成模型输出即可进行后处理的数据估价策略。