We demonstrate a proof-of-concept of a large language model conducting corporate lobbying related activities. An autoregressive large language model (OpenAI's text-davinci-003) determines if proposed U.S. Congressional bills are relevant to specific public companies and provides explanations and confidence levels. For the bills the model deems as relevant, the model drafts a letter to the sponsor of the bill in an attempt to persuade the congressperson to make changes to the proposed legislation. We use hundreds of novel ground-truth labels of the relevance of a bill to a company to benchmark the performance of the model. It outperforms the baseline of predicting the most common outcome of irrelevance. We also benchmark the performance of the previous OpenAI GPT-3 model (text-davinci-002), which was the state-of-the-art model on many academic natural language tasks until text-davinci-003 was recently released. The performance of text-davinci-002 is worse than the simple baseline. Longer-term, if AI begins to influence law in a manner that is not a direct extension of human intentions, this threatens the critical role that law as information could play in aligning AI with humans. Initially, AI is being used to simply augment human lobbyists for a small portion of their daily tasks. However, firms have an incentive to use less and less human oversight over automated assessments of policy ideas and the written communication to regulatory agencies and Congressional staffers. The core question raised is where to draw the line between human-driven and AI-driven policy influence.
翻译:我们展示了一个大型语言模式的概念证明,该模式是一个大型语言模式,开展与企业游说相关的活动。一个自动递减的大型语言模式(OpenAI的文本-davinci-003)决定了拟议的美国国会法案是否与特定公营公司相关,并提供解释和信任程度。对于该模式认为相关的法案,该模式向该法案的发起者起草一封信,试图说服国会议员修改拟议的立法。我们使用数百个关于法案与公司基准衡量该模式业绩的新的地面真相标签。该模式超过了预测最常见的无关性结果的基准。我们还将先前的OpenAI GPT-3模式(文本-davinci-002)的绩效作为基准,该模式是许多学术性自然语言任务的最新模式,直到该文本-davinci-03最近发布为止。 文本-davinici-002的绩效比简单的基线要差得多。如果AI开始以非书面直接扩展人类意图的方式影响法律,那么AI-3模式(Text-Drentalal)的绩效, 也就是将一个核心的监管作用提升到日常机构。 AI-I-LI-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I-I