Anonymous peer review is used by the great majority of computer science conferences. OpenReview is such a platform that aims to promote openness in peer review process. The paper, (meta) reviews, rebuttals, and final decisions are all released to public. We collect 5,527 submissions and their 16,853 reviews from the OpenReview platform. We also collect these submissions' citation data from Google Scholar and their non-peer-reviewed versions from arXiv.org. By acquiring deep insights into these data, we have several interesting findings that could help understand the effectiveness of the public-accessible double-blind peer review process. Our results can potentially help writing a paper, reviewing it, and deciding on its acceptance.
翻译:绝大多数计算机科学会议都使用匿名同侪审查。 公开审查是一个旨在促进同侪审查进程公开性的平台。 公开审查(meta)审查、反驳和最终决定都公布于众。 我们从公开审查平台收集了5,527份呈件及其16,853份审查报告。 我们还从Google学者收集了这些呈件的引证数据,并从arxiv.org收集了它们未经同侪审查的版本。 通过深入了解这些数据,我们发现了若干有趣的发现,有助于了解公众可获取的双盲同侪审查过程的有效性。我们的结果可能有助于撰写论文,审查并决定是否接受。