The use of AI in healthcare is designed to improve care delivery and augment the decisions of providers to enhance patient outcomes. When deployed in clinical settings, the interaction between providers and AI is a critical component for measuring and understanding the effectiveness of these digital tools on broader health outcomes. Even in cases where AI algorithms have high diagnostic accuracy, healthcare providers often still rely on their experience and sometimes gut feeling to make a final decision. Other times, providers rely unquestioningly on the outputs of the AI models, which leads to a concern about over-reliance on the technology. The purpose of this research was to understand how reliant drug shop dispensers were on AI-powered technologies when determining a differential diagnosis for a presented clinical case vignette. We explored how the drug dispensers responded to technology that is framed as always correct in an attempt to measure whether they begin to rely on it without any critical thought of their own. We found that dispensers relied on the decision made by the AI 25 percent of the time, even when the AI provided no explanation for its decision.
翻译:在保健方面使用AI是为了改善护理的提供,并增加提供者的决定,以提高病人的结果。在临床环境中部署时,提供者与AI之间的互动是衡量和理解这些数字工具在更广泛的保健结果方面的有效性的一个关键组成部分。即使AI算法具有很高的诊断准确性,保健提供者往往仍然依赖其经验,有时甚至直觉地作出最后决定。有时,提供者毫无疑问地依赖AI模型的产出,这导致对过度依赖技术的关切。这项研究的目的是了解在为提出的临床案例确定差别诊断时,依赖AI动力的药店发放者是如何使用AI动力技术的。我们探讨了药物发放者如何对始终正确的技术作出反应,以衡量他们是否在没有自己任何批判性思考的情况下开始依赖这种技术。我们发现,即使在AI没有解释其决定的情况下,药物发放者也依赖AI25%的时间所作的决定。