We develop a visual analytics system, NewsKaleidoscope, to investigate the how news reporting of events varies. NewsKaleidoscope combines several backend text language processing techniques with a coordinated visualization interface tailored for visualization non-expert users. To robustly evaluate NewsKaleidoscope, we conduct a trio of user studies. (1) A usability study with news novices assesses the overall system and the specific insights promoted for journalism-agnostic users. (2) A follow-up study with news experts assesses the insights promoted for journalism-savvy users. (3) Based on identified system limitations in these two studies, we amend NewsKaleidoscope design and conduct a third study to validate these improvements. Results indicate that, for both news novice and experts, NewsKaleidoscope supports an effective, task-driven workflow for analyzing the diversity of news coverage about events, though journalism expertise has a significant influence on the user insights and takeaways. Our insights while developing and evaluating NewsKaleidoscope can aid future interface designs that combine visualization with natural language processing to analyze coverage diversity in news event reporting.
翻译:我们开发了一个视觉分析系统 -- -- NewsKaleidoopic,以调查事件新闻报道的不同。NewsKaleidocopic将若干后端文字语言处理技术与针对非专家用户的可视化协调界面相结合。为了大力评价NewsKaleidocosopic,我们进行了三组用户研究。 (1) 使用新消息的研究评估了整个系统,以及为新闻-不可知用户宣传的具体见解。 (2) 由新闻专家进行的后续研究评估了为新闻-隐蔽用户宣传的见解。 (3) 根据这两项研究中查明的系统限制,我们修正了NewsKaleidopocopic设计,并进行了第三次研究,以验证这些改进。结果显示,对于新闻专家和专家来说,NewsKaleidocopicopic支持一种有效的、任务驱动的工作流程,用以分析事件新闻报道的多样性,尽管新闻专门知识对用户的洞察和取影响很大。我们在开发和评价新闻-Kaleidocopic时的见解有助于未来的界面设计,将视觉与天然语言处理结合起来,分析新闻事件报道的多样化。