With the advancements in machine learning (ML) methods and compute resources, artificial intelligence (AI) empowered systems are becoming a prevailing technology. However, current AI technology such as deep learning is not flawless. The significantly increased model complexity and data scale incur intensified challenges when lacking trustworthiness and transparency, which could create new risks and negative impacts. In this paper, we carve out AI maintenance from the robustness perspective. We start by introducing some highlighted robustness challenges in the AI lifecycle and motivating AI maintenance by making analogies to car maintenance. We then propose an AI model inspection framework to detect and mitigate robustness risks. We also draw inspiration from vehicle autonomy to define the levels of AI robustness automation. Our proposal for AI maintenance facilitates robustness assessment, status tracking, risk scanning, model hardening, and regulation throughout the AI lifecycle, which is an essential milestone toward building sustainable and trustworthy AI ecosystems.
翻译:随着机器学习方法的进步和对资源的计算,人工智能(AI)授权系统正在成为主流技术。然而,目前人工智能技术,如深层学习等并非完美无缺。模型复杂性和数据规模的大幅增加,当缺乏信任度和透明度时会遇到更大的挑战,这可能造成新的风险和负面影响。在本文件中,我们从稳健性的角度来分析人工智能的维护。我们首先在人工智能生命周期中引入一些突出的稳健性挑战,并通过对汽车维护进行类比来激励人工智能的维护。我们然后提出一个人工智能示范检查框架,以探测和减轻稳健性风险。我们还从汽车自主中汲取灵感,以确定人工智能的稳健性自动化水平。我们关于人工智能维护的建议有助于在人工智能生命周期中进行稳健性评估、状况跟踪、风险扫描、模型强化和监管,这是建设可持续和可靠的人工智能生态系统的重要里程碑。