We present ir-measures, a new tool that makes it convenient to calculate a diverse set of evaluation measures used in information retrieval. Rather than implementing its own measure calculations, ir-measures provides a common interface to a handful of evaluation tools. The necessary tools are automatically invoked (potentially multiple times) to calculate all the desired metrics, simplifying the evaluation process for the user. The tool also makes it easier for researchers to use recently-proposed measures (such as those from the C/W/L framework) alongside traditional measures, potentially encouraging their adoption.
翻译:我们提出“不计量”这一新工具,方便计算信息检索中使用的一套不同的评价措施。“不计量”不是执行自己的计量计算,而是为少数评价工具提供一个共同的界面。必要的工具被自动(可能多次)引用,以计算所有所需的衡量标准,简化用户的评价程序。“不计量”工具还使研究人员更容易使用最近提出的措施(如C/W/L框架的措施)以及可能鼓励采用的传统措施。