EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Persuasive Legal Writing Using Large Language Models

Damian Curran, Inbar Levy, Meladel Mistica, Eduard Hovy

Legal Education Review · 2024

DOI: 10.53300/001c.124116 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Legal Education Review, 2024. Verfasst von Damian Curran und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Persuasive writing is an essential skill for a lawyer. Budding lawyers hone their persuasive writing skills during their studies, in part through essay-style examinations. However, Large Language Models (LLMs) have recently proved adept at a broad range of language tasks. They could undermine the utility of many existing forms of law school assessment by allowing students to generate essays artificially. This paper explores the extent to which those concerns are warranted. This study first explores the constituent elements of persuasive legal writing and reviews the available literature on an LLM’s competence in each area. It then evaluates whether OpenAI’s powerful LLM, GPT-4, can produce essay-style answers to a post-graduate law school exam on legal theory. The GPT-4 output is compared to essays written by actual honors students by having them blind-graded by human graders using the subject’s examination rubric. The study finds that GPT-4 cannot match the honors students. Whilst it can produce essays which are of a passable grade, there are significant challenges producing higher quality content. The paper closes with observations about the experience, prompt engineering, LLM-bias and the technology’s implications for the legal profession.

Zitieren

APA

Curran, D., Levy, I., Mistica, M., & Hovy, E. (2024). Persuasive Legal Writing Using Large Language Models. Legal Education Review. https://doi.org/10.53300/001c.124116

Vancouver

Curran D, Levy I, Mistica M, Hovy E. Persuasive Legal Writing Using Large Language Models. Legal Education Review. 2024. doi:10.53300/001c.124116

BibTeX
@article{Curran2024,
  author = {Curran, Damian and Levy, Inbar and Mistica, Meladel and Hovy, Eduard},
  title = {Persuasive Legal Writing Using Large Language Models},
  journal = {Legal Education Review},
  year = {2024},
  doi = {10.53300/001c.124116}
}
Kostenlos starten →