A Field Evaluation of Natural Language for Data Retrieval

72 Pages Posted: 31 Oct 2008

See all articles by Matthias Jarke

Matthias Jarke

affiliation not provided to SSRN

Jon Turner

New York University (NYU) - Department of Information, Operations, and Management Sciences

Edward A. Stohr

Stevens Institute of Technology - School of Business

Yannis Vassiliou

affiliation not provided to SSRN

Norman White

New York University (NYU) - Leonard N. Stern School of Business; New York University (NYU) - Department of Information, Operations, and Management Sciences

Ken Michielse

New York University (NYU)

Date Written: November 1983

Abstract

Although a large number of natural language database interfaceshave been developed, there have been few empirical studies of theirpractical usefulness. This paper presents the design and results of afield evaluation of a natural language system - NLS - used for dataretrieval .A balanced, multifactorial design comparing NLS with a referenceretrieval language, SQL, is described. The data are analyzed on twolevels: work task (n=87) and query (n=1081). SQL performed betterthan NLS on a variety of measures, but NLS required less effort touse. Subjects performed much poorer than expected based on theresults of laboratory studies. This finding is attributed to thecomplexity of the field setting and to optimism in grading laboratoryexperiments.The methodology developed for studying computer languages in realwork settings was successful in consistently measuring differences intreatments over a variety of conditions.

Suggested Citation

Jarke, Matthias and Turner, Jon and Stohr, Edward A. and Vassiliou, Yannis and White, Norman and Michielse, Ken, A Field Evaluation of Natural Language for Data Retrieval (November 1983). Information Systems Working Papers Series, Vol. , pp. -, 1983. Available at SSRN: https://ssrn.com/abstract=1290108

Matthias Jarke (Contact Author)

affiliation not provided to SSRN

No Address Available

Jon Turner

New York University (NYU) - Department of Information, Operations, and Management Sciences ( email )

44 West Fourth Street
New York, NY 10012
United States

Edward A. Stohr

Stevens Institute of Technology - School of Business ( email )

Hoboken, NJ 07030
United States

Yannis Vassiliou

affiliation not provided to SSRN

No Address Available

Norman White

New York University (NYU) - Leonard N. Stern School of Business ( email )

44 West 4th Street
Suite 9-160
New York, NY NY 10012
United States

New York University (NYU) - Department of Information, Operations, and Management Sciences ( email )

44 West Fourth Street
New York, NY 10012
United States

Ken Michielse

New York University (NYU)

Bobst Library, E-resource Acquisitions
20 Cooper Square 3rd Floor
New York, NY 10003-711
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
25
Abstract Views
472
PlumX Metrics