A new generation of increasingly autonomous and self-learning systems, which we call embodied systems, is about to be developed. When deploying these systems into a real-life context we face various engineering challenges, as it is crucial to coordinate the behavior of embodied systems in a beneficial manner, ensure their compatibility with our human-centered social values, and design verifiably safe and reliable human-machine interaction. We are arguing that raditional systems engineering is coming to a climacteric from embedded to embodied systems, and with assuring the trustworthiness of dynamic federations of situationally aware, intent-driven, explorative, ever-evolving, largely non-predictable, and increasingly autonomous embodied systems in uncertain, complex, and unpredictable real-world contexts. We are also identifying a number of urgent systems challenges for trustworthy embodied systems, including robust and human-centric AI, cognitive architectures, uncertainty quantification, trustworthy self-integration, and continual analysis and assurance.
翻译:我们称之为体现系统的新一代日益自主和自学系统即将开发。当将这些系统部署到现实生活中时,我们面临各种工程挑战,因为以有益的方式协调体现系统的行为,确保它们与我们以人为本的社会价值观兼容,并设计可以核查的安全可靠的人体机械互动。 我们主张,传统系统工程正在走向从嵌入到体现系统的高潮,并确保动态联合会的可信赖性,这些联合会具有感知、意向驱动、探索性、不断演变、基本上无法预测和日益自主的、在不确定、复杂和不可预测的现实世界环境中体现的系统。 我们还正在确定可信赖的体现系统面临的一些紧迫系统挑战,包括强健和以人为本的人工智能、认知架构、不确定性的量化、可信赖的自我整合以及持续分析和保证。