The relationships between the listener, physical world and virtual environment (VE) should not only inspire the design of natural multimodal interfaces but should be discovered to make sense of the mediating action of VR technologies. This chapter aims to transform an archipelago of studies related to sonic interactions in virtual environments (SIVE) into a research field equipped with a first theoretical framework with an inclusive vision of the challenges to come: the egocentric perspective of the auditory digital twin. In a VE with immersive audio technologies implemented, the role of VR simulations must be enacted by a participatory exploration of sense-making in a network of human and non-human agents, called actors. The guardian of such locus of agency is the auditory digital twin that fosters intra-actions between humans and technology, dynamically and fluidly redefining all those configurations that are crucial for an immersive and coherent experience. The idea of entanglement theory is here mainly declined in an egocentric-spatial perspective related to emerging knowledge of the listener's perceptual capabilities. This is an actively transformative relation with the digital twin potentials to create movement, transparency, and provocative activities in VEs. The chapter contains an original theoretical perspective complemented by several bibliographical references and links to the other book chapters that have contributed significantly to the proposal presented here.
翻译:监听者、物理世界和虚拟环境之间的关系不仅应当激励自然多式联运界面的设计,而且应当被发现,使VR技术的调解行动具有意义。本章旨在将虚拟环境中声学互动(SIVE)相关研究的集合体转变为一个研究领域,其第一个理论框架具有对未来挑战的包容性观点:听觉数字双胞胎的自我中心观点。在采用隐蔽的音频技术的VE中,VR模拟的作用必须通过在由人类和非人类代理人组成的网络(即所谓的行为者)中参与性地探索感知能力来发挥。这种机构的守护者是促进人类与技术之间内部行动(SIVE)的听觉数字双胞胎,以动态和流畅的方式重新定义所有对于感知和连贯经验至关重要的配置。在这里,纠缠理论的概念主要从自我中心空间的角度下降,因为正在出现对听众感知能力的了解。这是与数字双面潜力的积极转变关系,有助于创造人类与技术之间的运动、透明性、真实性和挑衅性联系。这在书中包含了一些原始的章节和开创性活动。