Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. The latest model developed by OpenAI, GPT-4, was trained using an unprecedented scale of compute and data. In this paper, we report on our investigation of an early version of GPT-4, when it was still in active development by OpenAI. We contend that (this early version of) GPT-4 is part of a new cohort of LLMs (along with ChatGPT and Google's PaLM for example) that exhibit more general intelligence than previous AI models. We discuss the rising capabilities and implications of these models. We demonstrate that, beyond its mastery of language, GPT-4 can solve novel and difficult tasks that span mathematics, coding, vision, medicine, law, psychology and more, without needing any special prompting. Moreover, in all of these tasks, GPT-4's performance is strikingly close to human-level performance, and often vastly surpasses prior models such as ChatGPT. Given the breadth and depth of GPT-4's capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. In our exploration of GPT-4, we put special emphasis on discovering its limitations, and we discuss the challenges ahead for advancing towards deeper and more comprehensive versions of AGI, including the possible need for pursuing a new paradigm that moves beyond next-word prediction. We conclude with reflections on societal influences of the recent technological leap and future research directions.
翻译:人工智能(AI)研究人员一直在开发和完善大型语言模型(LLM),这些模型在各种领域和任务中展示了卓越的能力,挑战了我们对学习和认知的理解。最新的OpenAI模型GPT-4是使用前所未有的计算和数据规模进行训练的。本文报道了我们对GPT-4早期版本(它仍在OpenAI的研发过程中)的研究。我们认为(早期版本的)GPT-4是一个新的LLMs队列的一部分(例如ChatGPT和Google的PaLM),这些模型比以前的AI模型展现出更通用的智能。我们讨论了这些模型不断提升的能力和影响。我们证明,除了其语言掌握能力外,GPT-4可以解决跨越数学、编码、视觉、医学、法律、心理学等领域的新颖而困难的任务,而无需任何特殊提示。而且,在所有这些任务中,GPT-4的表现与人类水平非常接近,并且往往远远超越了以前的ChatGPT等模型。鉴于GPT-4的能力广泛且深入,我们认为它可以合理地被视为一个人工通用智能(AGI)系统的早期(但仍不完整)版本。在我们对GPT-4的探索中,我们特别强调发现它的局限性,并讨论了朝着更深入和全面的AGI版本前进的挑战,包括可能需要追求超越下一个单词预测的新范式。我们最后反思了最近技术进步的社会影响和未来研究方向。