Against the background of what has been termed a reproducibility crisis in science, the NLP field is becoming increasingly interested in, and conscientious about, the reproducibility of its results. The past few years have seen an impressive range of new initiatives, events and active research in the area. However, the field is far from reaching a consensus about how reproducibility should be defined, measured and addressed, with diversity of views currently increasing rather than converging. With this focused contribution, we aim to provide a wide-angle, and as near as possible complete, snapshot of current work on reproducibility in NLP, delineating differences and similarities, and providing pointers to common denominators.
翻译:在所谓的科学再生危机的背景下,国家实验室方案领域越来越关心和认真研究其成果的再生,过去几年在该领域出现了令人印象深刻的新倡议、事件和积极研究,然而,这一领域还远未就如何再生定义、衡量和处理达成共识,而目前观点的多样性在增加,而不是趋同。有了这种重点贡献,我们的目标是对目前关于国家实验室方案再生的工作进行广泛、尽可能全面的概述,说明差异和相似之处,并提供共同点的指针。