ChatGPT has been emerging as a novel information source, and it is likely that the public might seek information from ChatGPT while taking protective actions when facing climate hazards such as floods and hurricanes. The objective of this study is to evaluate the accuracy and completeness of responses generated by ChatGPT when individuals seek information about aspects of taking protective actions. The survey analysis results indicated that: (1) the emergency managers considered the responses provided by ChatGPT as accurate and complete to a great extent; (2) it was statistically verified in evaluations that the generated information was accurate, but lacked completeness, implying that the extent of information provided is accurate; and (3) information generated for prompts related to hazard insurance received the highest evaluation, whereas the information generated related to evacuation received the lowest. This last result implies that, for complex, context-specific protective actions (such as evacuation), the information was rated as less complete compared with other protective actions. Also, the results showed that the perception of respondents regarding the utility of AI- assistive technologies (such as ChatGPT) for emergency preparedness and response improved after taking the survey and evaluating the information generated by ChatGPT. The findings from this study provide empirical evaluation regarding the utility of AI-assistive technologies for improving public decision-making and protective actions in disasters.
翻译:摘要:ChatGPT作为一种新的信息来源正在出现,公众可能会在面对洪水和飓风等气候灾害时寻求ChatGPT的信息来采取保护措施。本研究的目的是评估ChatGPT生成应对保护性行动的回应的准确性和完整性。调查分析结果表明:(1)应急管理人员认为ChatGPT提供的回应在很大程度上是准确和完整的;(2)在评估中经过统计验证生成的信息是准确的,但缺乏完整性,这意味着提供的信息程度是准确的;(3)与其他保护性行动相关的提示生成的信息得到了最高的评价,而与疏散相关的信息得到了最低的评价。这个结果意味着对于复杂的、特定于上下文的保护性行动(如疏散),与其他保护性行动相比,被评定为不够完整。此外,结果显示,在进行调查和评估ChatGPT生成的信息后,受访者对于AI辅助技术(如ChatGPT)在紧急准备和响应中的实用性的看法得到了提高。本研究的结果为评估AI辅助技术在改善公众决策和灾难保护行动中的实用性提供了经验性的评估。