We demonstrate a proof-of-concept of a large language model conducting corporate lobbying related activities. An autoregressive large language model (OpenAI's text-davinci-003) determines if proposed U.S. Congressional bills are relevant to specific public companies and provides explanations and confidence levels. For the bills the model deems as relevant, the model drafts a letter to the sponsor of the bill in an attempt to persuade the congressperson to make changes to the proposed legislation. We use hundreds of novel ground-truth labels of the relevance of a bill to a company to benchmark the performance of the model, which outperforms the baseline of predicting the most common outcome of irrelevance. We also benchmark the performance of the previous OpenAI GPT-3 model (text-davinci-002), which was the state-of-the-art model on many academic natural language tasks until text-davinci-003 was recently released. The performance of text-davinci-002 is worse than a simple benchmark. These results suggest that, as large language models continue to exhibit improved natural language understanding capabilities, performance on corporate lobbying related tasks will continue to improve. Longer-term, if AI begins to influence law in a manner that is not a direct extension of human intentions, this threatens the critical role that law as information could play in aligning AI with humans. This Essay explores how this is increasingly a possibility. Initially, AI is being used to simply augment human lobbyists for a small proportion of their daily tasks. However, firms have an incentive to use less and less human oversight over automated assessments of policy ideas and the written communication to regulatory agencies and Congressional staffers. The core question raised is where to draw the line between human-driven and AI-driven policy influence.
翻译:自动递减的大型语言模式(OpenAI's text-davinci-003)决定美国国会法案是否与特定公共公司相关,并提供解释和信心水平。对于该法案,模型认为相关,模型向法案发起人起草一封信,试图说服国会议员修改拟议的立法。我们使用数百个关于法案对公司进行自动化影响力基准测试的新的地面真相标签(OpenAI's text-davinci-003),该模型超过了预测不相干公司最常见结果的基准。我们还以美国国会法案为基准,确定拟议的美国法案是否与特定公共公司相关,并提供解释和信任水平。对于法案发起者来说,模型向法案发起者起草了一份信函,试图说服议员修改拟议的立法。 文本达文 -002的表现比简单的基准要差得多。这些结果表明,随着大型语言模式继续展示更好的自然语言理解能力,公司游说3-GPT-3(text-davinci-002)模式(Text-legroupulate)的绩效比重,如果公司在日常监管任务中不断提高,那么,那么,在内部法律中,那么,在法律上, 将使用这一法律的稳定性,那么,那么,在法律上,它的作用会继续使用,那么, 就会使用。