AI components are increasingly becoming a key element of all types of software systems to enhance their functionality. These AI components are often implemented as AI Agents, offering more autonomy than a plain integration of Large Language Models (LLMs), moving from a Model-as-a-Service paradigm to an Agent-as-a-Service one, bringing new challenges to the development of smart software systems. Indeed, while support for the design, implementation, and deployment of those agents exist, the specification of Quality of Service (QoS) and definition of Service Level Agreements (SLAs) aspects for those agents, important to ensure the quality of the resulting systems, remains an open challenge. Part of this is due to the difficulty to clearly define quality in the context of AI components, resulting in a lack of consensus on how to best approach Quality Assurance (QA) for these types of systems. To address this challenge, this paper proposes both a quality model for AI agents based on the ISO/IEC 25010 standard, and a domain specific language to support the definition of SLAs for the services provided by these AI agents.
翻译：人工智能组件正日益成为各类软件系统的关键要素，以增强其功能。这些人工智能组件通常以AI代理的形式实现，相较于单纯集成大型语言模型（LLMs），其具备更高的自主性，正从“模型即服务”范式转向“代理即服务”范式，这为智能软件系统的开发带来了新的挑战。事实上，尽管目前已有支持这些代理的设计、实现和部署的工具，但如何为这些代理明确服务质量（QoS）规范并定义服务水平协议（SLA）方面——这对于确保最终系统的质量至关重要——仍然是一个悬而未决的难题。部分原因在于，在人工智能组件的背景下清晰定义质量存在困难，导致对于如何最好地实施此类系统的质量保证（QA）缺乏共识。为应对这一挑战，本文提出了一种基于ISO/IEC 25010标准的人工智能代理质量模型，以及一种领域特定语言，用以支持为这些AI代理所提供的服务定义SLA。
相关内容
微信扫码咨询专知VIP会员