Language models such as GPT-3 have caused a furore in the research community. Some studies found that GPT-3 has some creative abilities and makes mistakes that are on par with human behaviour. This paper answers a related question: who is GPT-3? We administered two validated measurement tools to GPT-3 to assess its personality, the values it holds and its self-reported demographics. Our results show that GPT-3 scores similarly to human samples in terms of personality and - when provided with a model response memory - in terms of the values it holds. We provide the first evidence of psychological assessment of the GPT-3 model and thereby add to our understanding of the GPT-3 model. We close with suggestions for future research that moves social science closer to language models and vice versa.
翻译:GPT-3等语言模型引起了研究界的愤怒,有些研究发现,GPT-3具有一定的创造力,犯与人类行为相同的错误。本文回答一个相关的问题:谁是GPT-3?我们向GPT-3提供了两种有效的测量工具,以评估其个性、其持有的价值观及其自我报告的人口统计。我们的结果表明,GPT-3在个性方面与人类样本的得分相似,在提供反应记忆模型时,其所得的得分与人类样本的得分相似。我们提供了对GPT-3模型进行心理评估的首个证据,从而加深了我们对GPT-3模型的理解。我们最后建议今后开展研究,使社会科学更接近语言模型,反之亦然。