Persuasive Legal Writing Using Large Language Models
Legal Education Review · 2024
DOI: 10.53300/001c.124116 ↗Kurz gefasst
Fachartikel in der Zeitschrift Legal Education Review, 2024. Verfasst von Damian Curran und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Persuasive writing is an essential skill for a lawyer. Budding lawyers hone their persuasive writing skills during their studies, in part through essay-style examinations. However, Large Language Models (LLMs) have recently proved adept at a broad range of language tasks. They could undermine the utility of many existing forms of law school assessment by allowing students to generate essays artificially. This paper explores the extent to which those concerns are warranted. This study first explores the constituent elements of persuasive legal writing and reviews the available literature on an LLM’s competence in each area. It then evaluates whether OpenAI’s powerful LLM, GPT-4, can produce essay-style answers to a post-graduate law school exam on legal theory. The GPT-4 output is compared to essays written by actual honors students by having them blind-graded by human graders using the subject’s examination rubric. The study finds that GPT-4 cannot match the honors students. Whilst it can produce essays which are of a passable grade, there are significant challenges producing higher quality content. The paper closes with observations about the experience, prompt engineering, LLM-bias and the technology’s implications for the legal profession.
Zitieren
APA
Curran, D., Levy, I., Mistica, M., & Hovy, E. (2024). Persuasive Legal Writing Using Large Language Models. Legal Education Review. https://doi.org/10.53300/001c.124116
Vancouver
Curran D, Levy I, Mistica M, Hovy E. Persuasive Legal Writing Using Large Language Models. Legal Education Review. 2024. doi:10.53300/001c.124116
BibTeX
@article{Curran2024,
author = {Curran, Damian and Levy, Inbar and Mistica, Meladel and Hovy, Eduard},
title = {Persuasive Legal Writing Using Large Language Models},
journal = {Legal Education Review},
year = {2024},
doi = {10.53300/001c.124116}
}
EUVIMED