The replication crisis is real, and awareness of its existence is growing across disciplines. We argue that research in human-computer interaction (HCI), and especially virtual reality (VR), is vulnerable to similar challenges due to many shared methodologies, theories, and incentive structures. For this reason, in this work, we transfer established solutions from other fields to address the lack of replicability and reproducibility in HCI and VR. We focus on reducing errors resulting from the so-called human factor and adapt established solutions to the specific needs of VR research. In addition, we present a toolkit to support the setup, execution, and evaluation of VR research. Some of the features aim to reduce human errors and thus improve replicability and reproducibility. Finally, the identified chances are applied to a typical scientific process in VR.
翻译:由于许多共同的方法、理论和激励结构,人类计算机互动研究,特别是虚拟现实研究,由于许多共享的方法、理论和激励结构,容易遇到类似的挑战,因此,我们在此工作中将其他领域已有的解决办法转移,以解决人类计算机互动和虚拟计算机危机缺乏可复制性和可复制性的问题。我们注重减少所谓的人类因素造成的错误,并调整既定的解决方案,以满足人类计算机互动研究的具体需要。此外,我们还提出了一个工具包,支持建立、执行和评价甚大计算机互动研究,其中一些特征旨在减少人类错误,从而改进复制性和可复制性。最后,所确定的机会被用于甚大风险研究的典型科学进程。