Download This PaperGPT Gets Its First Law School B-pluses
3 Pages Posted: 16 Feb 2024
Date Written: February 5, 2024
Abstract
In November 2023, OpenAI released GPT-4-turbo. We had it take our Fall 2023 law school final exams and graded it on the same curve as students. We find an improvement from GPT-4’s performance on spring 2023 finals, where the highest grade was a B. This semester GPT-4-turbo got three B+’s, in Civil Procedure, Environmental Law, and Torts; a B in Contracts; B-’s in Constitutional Law, Corporate Tax, and the Intellectual Property Law Survey course; a C+ in Immigration Law; and a D in Election Law. The mean and median improved from GPT-4’s performance the prior semester.
Keywords: AI, law
JEL Classification: K00
Suggested Citation: Suggested Citation
Blair-Stanek, Andrew and Campbell, Patricia and Gifford, Donald G. and Krishnamurthi, Guha and Percival, Robert V. and Sovern, Jeff and Sweeney, Maureen and Tobin, Donald B. and Vertinsky, Liza, GPT Gets Its First Law School B-pluses (February 5, 2024). Available at SSRN: https://ssrn.com/abstract=4717411 or http://dx.doi.org/10.2139/ssrn.4717411
Feedback
Feedback to SSRN