深传输学习及以后的学习:信息系统研究中的变换语言模式 (Deep Transfer Learning & Beyond: Transformer Language Models in Information Systems Research)

from arxiv, Under review (revised once). Section 2, the literature review on deep transfer learning and transformer language models, is a valuable introduction for a broad audience (not just information systems researchers). 33 pages plus 13-page appendix

AI is widely thought to be poised to transform business, yet current perceptions of the scope of this transformation may be myopic. Recent progress in natural language processing involving transformer language models (TLMs) offers a potential avenue for AI-driven business and societal transformation that is beyond the scope of what most currently foresee. We review this recent progress as well as recent literature utilizing text mining in top IS journals to develop an outline for how future IS research can benefit from these new techniques. Our review of existing IS literature reveals that suboptimal text mining techniques are prevalent and that the more advanced TLMs could be applied to enhance and increase IS research involving text data, and to enable new IS research topics, thus creating more value for the research community. This is possible because these techniques make it easier to develop very powerful custom systems and their performance is superior to existing methods for a wide range of tasks and applications. Further, multilingual language models make possible higher quality text analytics for research in multiple languages. We also identify new avenues for IS research, like language user interfaces, that may offer even greater potential for future IS research.

翻译：人们普遍认为,大赦国际准备改变商业,但目前对这种转变的范围的看法可能是短视的。在涉及变压器语言模型的自然语言处理方面最近取得的进展,为AI驱动的商业和社会转型提供了超出目前大多数预测范围的潜在途径。我们审查了最近的进展以及最近的文献,利用高级IS杂志的文字挖掘,为未来的IS研究如何从这些新技术中受益制定大纲。我们对现有IS文献的审查表明,不理想的文本挖掘技术十分普遍,而且可以应用更先进的TLM方法来增强和增加涉及文本数据的IS研究,从而使得新的IS研究专题具有更大的价值,从而为研究界创造更大的价值。这是可能的,因为这些技术使开发非常强大的定制系统更加容易,其性能优于现有的广泛任务和应用方法。此外,多种语言的语文模型为多种语言的研究提供了更高质量的文本分析方法。我们还确定了新的IS研究途径,如语言用户界面,可能为未来的IS研究提供更大的潜力。