Footnotes (140)



The Case for Curation: The Relevance of Digest and Citator Results in Westlaw and Lexis

Susan Nevelow Mart

affiliation not provided to SSRN

December 12, 2012

32 Legal Reference Services Quarterly 13 (2013)

Humans and machines are both involved in the creation of legal research resources. For legal information retrieval systems, the human-curated finding aid is being overtaken by the computer algorithm. But human-curated finding aids still exist. One of them is the West Key Number system. The Key Number system’s headnote classification of case law, started back in the nineteenth century, was and is the creation of humans. The retrospective headnote classification of the cases in Lexis’s case databases, started in 1999, was created primarily - although not exclusively - with computer algorithms. So how do these two very different systems deal with a similar headnote from the same case, when they link the headnote to the digest and citator functions in their respective databases? This paper continues the author’s investigation into this question, looking at the relevance of results from digest and citator searches run on matching headnotes in Westlaw and Lexis for ninety important federal and state cases, to see how each system performs. For digests, where the results are curated where a human has made a judgment about the meaning of a case and placed it in a classification system humans still have an advantage. For citators, where algorithm is battling algorithm to find relevant results, it is a matter of the better algorithm winning. But neither algorithm is doing a very good job of finding all the relevant results; the overlap between the two citator systems is not that large. The lesson for researchers: know how your legal research system was created, what involvement, if any, humans had in the curation of the system, and what a researcher can and cannot expect from the system being used.

Number of Pages in PDF File: 58

Keywords: curation, relevance, recall, precision, legal classification, empirical, research

JEL Classification: K19, K1

Open PDF in Browser Download This Paper

Date posted: December 13, 2012 ; Last revised: May 22, 2013

Suggested Citation

Mart, Susan Nevelow, The Case for Curation: The Relevance of Digest and Citator Results in Westlaw and Lexis (December 12, 2012). 32 Legal Reference Services Quarterly 13 (2013). Available at SSRN: http://ssrn.com/abstract=2188541

Contact Information

Susan Nevelow Mart (Contact Author)
affiliation not provided to SSRN
Feedback to SSRN

Paper statistics
Abstract Views: 1,616
Downloads: 263
Download Rank: 82,681
Footnotes:  140

© 2016 Social Science Electronic Publishing, Inc. All Rights Reserved.  FAQ   Terms of Use   Privacy Policy   Copyright   Contact Us
This page was processed by apollobot1 in 2.375 seconds