Adverse drug events (ADEs) are an important aspect of drug safety. Various texts such as biomedical literature, drug reviews, and user posts on social media and medical forums contain a wealth of information about ADEs. Recent studies have applied word embedding and deep learning -based natural language processing to automate ADE detection from text. However, they did not explore incorporating explicit medical knowledge about drugs and adverse reactions or the corresponding feature learning. This paper adopts the heterogenous text graph which describes relationships between documents, words and concepts, augments it with medical knowledge from the Unified Medical Language System, and proposes a concept-aware attention mechanism which learns features differently for the different types of nodes in the graph. We further utilize contextualized embeddings from pretrained language models and convolutional graph neural networks for effective feature representation and relational learning. Experiments on four public datasets show that our model achieves performance competitive to the recent advances and the concept-aware attention consistently outperforms other attention mechanisms.
翻译:反向药物事件是药物安全的一个重要方面。各种文件,如生物医学文献、药物审查、社交媒体和医疗论坛的用户职位等,都含有大量有关ADE的信息。最近的研究应用了文字嵌入和深学习的自然语言处理,将ADE从文本中自动检测。然而,它们并没有探索纳入关于药物和不利反应的明确医学知识或相应的特征学习。本文采用了描述文件、文字和概念之间关系的异种文本图,用统一医学语言系统的医学知识来充实它,并提出了一个概念意识关注机制,为不同类型的节点学习不同特征。我们进一步利用预先培训的语言模式和革命图案神经网络的内嵌入环境,以有效地貌表现和关系学习。对四个公共数据集的实验表明,我们的模型取得了与最近进展的绩效竞争力,概念意识关注始终超越了其他关注机制。