We present SpaceQA, to the best of our knowledge the first open-domain QA system in Space mission design. SpaceQA is part of an initiative by the European Space Agency (ESA) to facilitate the access, sharing and reuse of information about Space mission design within the agency and with the public. We adopt a state-of-the-art architecture consisting of a dense retriever and a neural reader and opt for an approach based on transfer learning rather than fine-tuning due to the lack of domain-specific annotated data. Our evaluation on a test set produced by ESA is largely consistent with the results originally reported by the evaluated retrievers and confirms the need of fine tuning for reading comprehension. As of writing this paper, ESA is piloting SpaceQA internally.
翻译:我们向大家介绍空间质量评估,据我们所知,这是空间飞行任务设计中的第一个开放域质量评估系统。空间质量评估是欧洲航天局(欧空局)的一项举措的一部分,目的是便利在机构内部和与公众获取、分享和再利用有关空间飞行任务设计的信息。我们采用了由密集的检索器和神经读物组成的最先进的结构,并选择了一种基于转让学习的方法,而不是由于缺乏特定域的附加说明的数据而进行微调。我们对欧空局制作的测试集的评价与评估的检索器最初报告的结果基本一致,并确认有必要对阅读理解进行微调。在撰写本文件时,欧空局正在内部进行空间质量评估试点。