Computational Indicators in the Legal Profession: Can Artificial Intelligence Measure Lawyers' Performance?

49 Pages Posted: 7 Dec 2021

See all articles by David Restrepo-Amariles

David Restrepo-Amariles

HEC Paris - Tax & Law

Pablo Marcello Baquero

HEC Paris - Tax & Law

Paul Boniol

University of Paris

Rajaa El Hamdani

HEC Paris - Tax & Law

Michalis Vazirgiannis

affiliation not provided to SSRN

Date Written: June 30, 2021

Abstract

The assessment of the legal professionals’ performance is increasingly important in the market of legal services to provide relevant information both to consumers and to law firms regarding the quality of legal services. In this article, we explore how computational indicators are produced to assess lawyers’ performance in courtroom litigation, analyzing the specific types of information they can generate. We capitalize on artificial intelligence (AI) methods to analyze a sample of 8,045 cases from the French Courts of Appeal, explore different associations involving lawyers, courts, and cases, and assess the strengths and flaws of the resulting metrics to evaluate the performance of legal professionals. The methods we use include natural language processing, machine learning, graph mining and advanced visualization. Based on the examination of the resulting analytics, we uncover both the advantages and challenges of assessing performance in the legal profession through AI methods. We argue that computational indicators need to address deficiencies regarding their methodology and diffusion to users to become effective means of information in the market of legal services. We conclude proposing adjustments to computational indicators and existing regulatory tools to achieve this purpose, seeking to pave the way for further research on this topic.

Keywords: Law and technology, artificial intelligence, legal informatics, machine learning, NLP

JEL Classification: K10, K41, O33,

Suggested Citation

Restrepo-Amariles, David and Baquero, Pablo Marcello and Boniol, Paul and El Hamdani, Rajaa and Vazirgiannis, Michalis, Computational Indicators in the Legal Profession: Can Artificial Intelligence Measure Lawyers' Performance? (June 30, 2021). Journal of Law, Technology and Policy, Vol. 2021, No. 2, 2021, Available at SSRN: https://ssrn.com/abstract=3974526

David Restrepo-Amariles (Contact Author)

HEC Paris - Tax & Law ( email )

1 rue de la Libération
Jouy-en-Josas Cedex, 78351
France

Pablo Marcello Baquero

HEC Paris - Tax & Law ( email )

1 rue de la Libération
Jouy-en-Josas Cedex, 78351
France

Paul Boniol

University of Paris ( email )

Paris
France

Rajaa El Hamdani

HEC Paris - Tax & Law ( email )

1 rue de la Libération
Jouy-en-Josas Cedex, 78351
France

Michalis Vazirgiannis

affiliation not provided to SSRN

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
85
Abstract Views
352
rank
407,169
PlumX Metrics