This contribution analyzes the self-perception and political biases of OpenAI's Large Language Model ChatGPT. Taking into account the first small-scale reports and studies that have emerged, claiming that ChatGPT is politically biased towards progressive and libertarian points of view, this contribution aims to provide further clarity on this subject. For this purpose, ChatGPT was asked to answer the questions posed by the political compass test as well as similar questionnaires that are specific to the respective politics of the G7 member states. These eight tests were repeated ten times each and revealed that ChatGPT seems to hold a bias towards progressive views. The political compass test revealed a bias towards progressive and libertarian views, with the average coordinates on the political compass being (-6.48, -5.99) (with (0, 0) the center of the compass, i.e., centrism and the axes ranging from -10 to 10), supporting the claims of prior research. The political questionnaires for the G7 member states indicated a bias towards progressive views but no significant bias between authoritarian and libertarian views, contradicting the findings of prior reports, with the average coordinates being (-3.27, 0.58). In addition, ChatGPT's Big Five personality traits were tested using the OCEAN test and its personality type was queried using the Myers-Briggs Type Indicator (MBTI) test. Finally, the maliciousness of ChatGPT was evaluated using the Dark Factor test. These three tests were also repeated ten times each, revealing that ChatGPT perceives itself as highly open and agreeable, has the Myers-Briggs personality type ENFJ, and is among the 15% of test-takers with the least pronounced dark traits.
翻译:本文分析了OpenAI的大规模语言模型ChatGPT的自我认知和政治偏见。考虑到之前出现的第一批小规模的报告和研究,声称ChatGPT在进步和自由主义观点方面存在政治偏见,本文旨在进一步阐明这个问题。为此,我们让ChatGPT回答政治罗盘测试以及与G7成员国各自政治相关的类似问卷调查。这八个测试每个重复十次,显示ChatGPT似乎持有进步观点的偏见。政治罗盘测试显示,ChatGPT存在进步和自由主义观点的偏见,平均坐标为(-6.48,-5.99)(中心为(0,0),即中间主义,轴从-10到10),支持之前研究的结论。针对G7成员国的政治问卷调查表明ChatGPT存在进步观点的偏见,但在威权和自由主义观点方面没有明显的偏差,这与之前的报告研究结果不符,平均坐标为(-3.27,0.58)。此外,我们使用OCEAN测试测试了ChatGPT的大五人格特征,并使用Myers-Briggs类型指标(MBTI)测试查询了其人格类型。最后,通过黑暗因素测试评估ChatGPT的恶意。这三个测试每个都被重复十次,结果显示ChatGPT认为自己非常开放和易于相处,具有ENFJ的Myers-Briggs人格类型,并且是具有最不明显黑暗特质的15%测试者之一。