Recently, the use of sound measures and metrics in Artificial Intelligence has become the subject of interest of academia, government, and industry. Efforts towards measuring different phenomena have gained traction in the AI community, as illustrated by the publication of several influential field reports and policy documents. These metrics are designed to help decision takers to inform themselves about the fast-moving and impacting influences of key advances in Artificial Intelligence in general and Machine Learning in particular. In this paper we propose to use such newfound capabilities of AI technologies to augment our AI measuring capabilities. We do so by training a model to classify publications related to ethical issues and concerns. In our methodology we use an expert, manually curated dataset as the training set and then evaluate a large set of research papers. Finally, we highlight the implications of AI metrics, in particular their contribution towards developing trustful and fair AI-based tools and technologies. Keywords: AI Ethics; AI Fairness; AI Measurement. Ethics in Computer Science.
翻译:最近,在人工智能中采用健全的措施和衡量标准已成为学术界、政府和产业界感兴趣的主题。测量不同现象的努力在AI社区中得到了推动,例如出版了若干有影响力的实地报告和政策文件。这些衡量标准旨在帮助决策者了解人工智能、特别是机器学习方面关键进展的快速变化和影响。我们在本文件中提议利用AI技术的这种新发现能力来增强我们的AI测量能力。我们这样做的方式是培训一种对与伦理问题和关切有关的出版物进行分类的模型。我们的方法是使用专家、手工整理的数据集作为培训的集,然后评价大量的研究文件。最后,我们强调AI衡量标准的影响,特别是它们对开发基于人工智能的可靠和公平工具和技术的贡献。关键词:AI道德;AI公平;AI公平;AI计量;计算机科学中的道德。