Appropriate reviewer assignment significantly impacts the quality of proposal evaluation, as accurate and fair reviews are contingent on their assignment to relevant reviewers. The crucial task of assigning reviewers to submitted proposals is the starting point of the review process and is also known as the reviewer assignment problem (RAP). Due to the obvious restrictions of manual assignment, journal editors, conference organizers, and grant managers demand automatic reviewer assignment approaches. Many studies have proposed assignment solutions in response to the demand for automated procedures since 1992. The primary objective of this survey paper is to provide scholars and practitioners with a comprehensive overview of available research on the RAP. To achieve this goal, this article presents an in-depth systematic review of 103 publications in the field of reviewer assignment published in the past three decades and available in the Web of Science, Scopus, ScienceDirect, Google Scholar, and Semantic Scholar databases. This review paper classified and discussed the RAP approaches into two broad categories and numerous subcategories based on their underlying techniques. Furthermore, potential future research directions for each category are presented. This survey shows that the research on the RAP is becoming more significant and that more effort is required to develop new approaches and a framework.
翻译:摘要:合适的审稿人分配显著影响建议评估的质量,因为准确和公正的审查取决于将其分配给相关审稿人。将审稿人分配到提交的建议的关键任务是审查过程的起点,也被称为审稿人分配问题(RAP)。由于手动分配的明显限制,期刊编辑、会议组织者和资助管理人员要求自动审稿人分配方法。自1992年以来,许多研究提出了分配解决方案,以响应自动化程序的需求。本综述的主要目标是为学者和从业人员提供RAP可用研究的全面概述。为实现这一目标,本文在Web of Science、Scopus、ScienceDirect、Google Scholar和Semantic Scholar数据库中进行了103篇审稿人分配领域的出版物深入系统的综述。本文根据底层技术将RAP方法分为两大类和多个子类进行分类和讨论。此外,还介绍了每个类别的潜在未来研究方向。这份综述显示RAP的研究越来越重要,需要更多的努力来开发新的方法和框架。