Futurology

1760 readers

411 users here now

founded 1 year ago

MODERATORS

OpenAI is boasting that they are about to make a lot of the legal profession permanently unemployed. (wallstreetpit.com)

submitted 2 weeks ago by [email protected] to c/[email protected]

43 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[+] [email protected] -13 points 2 weeks ago (14 children)

Law = rules. Action A is legal. Action B isn't. Doing X + Y + Z constitutes action A and so on. Legal arguments have to abide by all rules of logic. Law is one of the most logic heavy fields out there.

As for LLMs not being able to reason, it's very debatable. Whether they reason or not depends upon your definition of "reasoning". Debating definitions here is useless however, as the end result speaks for itself.

If LLMs can pass certification exams for lawyers, then it means either one of two things:

the exams are flawed
LLMs are capable of practicing law.

[–] [email protected] 7 points 2 weeks ago (3 children)

The bar exam is just one part of a larger set of qualifications
The bar exam is just a (closed-book) proxy for the actual skills and knowledge being tested. While a reasonable proxy for humans, it is a poor proxy for computers

[–] [email protected] 1 points 2 weeks ago (2 children)

Ok. What test would an LLM need to pass to convince you that it capable of being a lawyer?

[–] [email protected] 3 points 2 weeks ago

The short answer is being admitted by the bar; we already trust them to certify humans.

If for some reason I were arbiter, I would say a convincing record of doing actual legal work, vetted by existing lawyers. The legal profession already has a well-defined model of how non-lawyers can contribute to the work, so there is no need for a quantum leap up to being a lawyer.

load more comments (1 replies)

load more comments (11 replies)