AI 与机器学习2024arxiv.org
Better Call GPT:比较大型语言模型与律师
Better Call GPT: Comparing large language models against lawyers
进阶 · 约 45 分钟读完前置知识:大语言模型基础、法律合同常识、评测与统计方法
导读
这篇论文将 GPT 等大语言模型与真实律师在消费者法律问题上的表现进行对比,发现 LLM 在定位合同相关条款等法律信息任务上不逊于甚至优于人类律师,且速度更快、成本更低。
HN 关注点:LLM 是否能替代律师服务,讨论焦点集中在 AI 法律建议的责任问题、律师行业的抵制,以及普通人获得平价法律帮助的可能性。
HN 评论精选
这几条评论里:支持 1 补充 2 亲历 1
亲历从业者亲历:GPT 擅长分析合同而非生成,且缺乏法律责任约束,更好的标准模板比 AI 生成更有价值
我经营一家做法律合同生成的创业公司(把律师写的合同做成模板),也做过让 GPT 分析合同、供普通人提问的工作。就合同审查而言,我发现 GPT 更擅长分析文档而非生成文档,这篇论文也支持这一点。但我用过几家 AI 文档审查创业公司的产品,一旦追问具体答案它们就都不行了。这篇论文看起来只需要定位到相关条款,而不必像律师和客户那样来回对话。另外 GPT 给错答案也不承担法律责任,所以它适合聪明人自己做研究,就像以前聪明人会用 Google 自己查一样。至于合同生成,我认为对大多数情况,如果有更好的标准合同模板,人们会得到更好的服务。律师们把合同捂着不放,我们很难找到愿意写合同让我们做成模板的律师,因为这等于断了自己的收入来源。但人们并不需要每次都让 GPT 现场生成一份独一无二的合同,一份经过精心撰写和审查的模板就够了……
hansonkd查看英文原文
I run a startup that does legal contract generation (contracts written by lawyers turned into templates) and have done some work GPT analysis of the contract for laypersons to interact and ask questions about the contract they are getting. In terms of contract review, what I've found is that GPT is better at analysis of the document than generating the document, which is what this paper supports. However, I have used several startups options of AI document review and they all fall apart with any sort of prodding for specific answers. This paper looks like it just had to locate the section not necessarily have the back and forth conversation about the contract that a lawyer and client would have. There is also no legal liability for GPT for giving the wrong answer. So It works well for someone smart who is doing their own research. Just like if you are smart you could use google before to do your own research. My feelings on contract generation is that for the majority of cases, people are better served if there were simply better boilerplate contracts available. Laywers hoard their contracts and it was very difficult in our journey to find lawyers who would be willing to write contracts we would turn into templates because they are essentially putting themselves and their professional community out of income streams in the future. But people don't need a unique contract generated on the fly from GPT every time when a template of a well written and well reviewed contract does just fine. It cost hundreds of millions to train GPT4. If $10m was just spent building a repository of well reviewed contracts, it would be a more useful than spending the equivalent money training a GPT to generate them. People ask pretty wide range of questions about what they want to do with their documents and GPT didn't do a great job with it, so for the near future, it looks like lawyers still have a job.
支持期待 LLM 让普通人获得平价的专业法律建议
这是我对 LLM 最期待的领域之一。5-10 年内(虽然这篇论文让我觉得它已经到来了),我会非常有信心地与一个能访问我所有税务/医疗/保险/婚姻文件的"律师" LLM 聊上几个小时,获得专业建议,而不用按每小时 500 美元付费。一波法律素养更高的普通人即将到来,我对此无比兴奋!
crakenzak查看英文原文
This is one of the domains I'm very very excited about for LLMs to help me with. In 5-10 years (even though this research paper makes me feel its already here), I would feel very confident chatting for a few hours with a "lawyer" LLM that has access to all my relevant taxes/medical/insurance/marriage documents and would be able to give me specialized advice and information without billing me $500 an hour. A wave of (better) legally informed common-person is coming, and I couldn't be more excited!
补充提出宪法层面的有趣问题:第六修正案的"律师协助"是否必须是人类
美国宪法第六修正案规定,刑事被告有权获得律师协助为其辩护。当 LLM 比普通人类律师更有能力时,这条修正案是否还要求必须由人类律师提供协助?
delichon查看英文原文
In all criminal prosecutions, the accused shall enjoy the right ... to have the Assistance of Counsel for his defense -- 6th amendment to US Constitution When an LLM is more competent than an average human counsel, does this amendment still require assistance of a human counsel?
补充质疑律师行业会用法律手段抵制威胁其利益的技术
我很好奇律师们会想出什么法律论据,来打压这项威胁他们行业的技术?
Workaccount2查看英文原文
I wonder what the reach of a legal argument a bunch of lawyers are going to come up with in order to cripple the tech that threatens their industry?
相关资源
从这篇论文所有 HN 讨论帖的全部评论里整理出来的链接。
历次讨论
- 2024Hacker News 讨论帖389 分 · 264 评
同领域还值得读
DeepSeek-R1:通过强化学习激励 LLM 的推理能力
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via RL
研究如何用强化学习激励大语言模型的推理能力,提出 DeepSeek-R1,并探讨 RL 训练对模型推理表现的影响。
AI 与机器学习2025 · 1,351 分 · 1,056 评 · 引用 30进阶 · 约 80 分钟编辑精选1-bit LLM 时代:面向低成本计算的三值参数
The Era of 1-bit LLMs: ternary parameters for cost-effective computing
提出用三值参数 {-1, 0, 1} 替代 LLM 中的浮点权重,即所谓“1-bit LLM”。
AI 与机器学习2024 · 1,040 分 · 447 评 · 引用 19进阶 · 约 45 分钟编辑精选DeepSeek-V3.2:推进开放大语言模型的前沿
DeepSeek-v3.2: Pushing the frontier of open large language models
这是 DeepSeek-V3.2 的技术报告,延续了 DeepSeek 开源权重模型的路线,目标是让开放模型继续逼近甚至追平前沿闭源模型。
AI 与机器学习2025 · 982 分 · 465 评进阶 · 约 90 分钟编辑精选通过自我对弈与通用强化学习掌握国际象棋和将棋(AlphaZero)
Mastering Chess and Shogi by Self-Play with General Reinforcement Learning
DeepMind 的 AlphaZero 论文:用通用强化学习算法(自我博弈 + MCTS + 神经网络),从零开始仅数小时训练便在国际象棋和将棋上击败了世界顶级引擎 Stock…
AI 与机器学习2017 · 539 分 · 270 评 · 引用 13进阶 · 约 90 分钟编辑精选用强化学习发现更快的矩阵乘法算法
Discovering faster matrix multiplication algorithms with reinforcement learning
论文提出 AlphaTensor,用强化学习搜索矩阵乘法算法。
AI 与机器学习2022 · 518 分 · 111 评专业 · 约 90 分钟编辑精选