This paper presents a test collection for contextual point of interest (POI) recommendation in a narrative-driven scenario. There, user history is not available, instead, user requests are described in natural language. The requests in our collection are manually collected from social sharing websites, and are annotated with various types of metadata, including location, categories, constraints, and example POIs. These requests are to be resolved from a dataset of POIs, which are collected from a popular online directory, and are further linked to a geographical knowledge base and enriched with relevant web snippets. Graded relevance assessments are collected using crowdsourcing, by pooling both manual and automatic recommendations, where the latter serve as baselines for future performance comparison. This resource supports the development of novel approaches for end-to-end POI recommendation as well as for specific semantic annotation tasks on natural language requests.
翻译:本文件在叙述驱动的假设情景中为背景利益点(POI)建议进行测试收集。在这种假设情景中,用户历史无法提供,而用户的要求是用自然语言描述的。我们收集的要求是用手工从社会共享网站手工收集的,并附有各种类型的元数据(包括地点、类别、限制和POI)的附加说明。这些要求将从一个流行的在线目录中收集的POI数据集中解决,该数据集与一个地理知识库进一步连接,并用相关的网络片段加以丰富。通过将人工和自动建议汇集在一起,收集分级相关性评估,将后者作为未来业绩比较的基线。这一资源支持为终端到终端的POI建议以及针对自然语言请求的具体语义说明任务制定新办法。