Robots that Use Language

Posted: 16 May 2020

See all articles by Stefanie Tellex

Stefanie Tellex

Brown University

Nakul Gopalan

Georgia Institute of Technology - School of Interactive Computing

Hadas Kress-Gazit

Cornell University

Cynthia Matuszek

University of Maryland, Baltimore County (UMBC)

Date Written: May 2020

Abstract

This article surveys the use of natural language in robotics from a robotics point of view. To use human language, robots must map words to aspects of the physical world, mediated by the robot's sensors and actuators. This problem differs from other natural language processing domains due to the need to ground the language to noisy percepts and physical actions. Here, we describe central aspects of language use by robots, including understanding natural language requests, using language to drive learning about the physical world, and engaging in collaborative dialogue with a human partner. We describe common approaches, roughly divided into learning methods, logic-based methods, and methods that focus on questions of human–robot interaction. Finally, we describe several application domains for language-using robots.

Suggested Citation

Tellex, Stefanie and Gopalan, Nakul and Kress-Gazit, Hadas and Matuszek, Cynthia, Robots that Use Language (May 2020). Annual Review of Control, Robotics, and Autonomous Systems, Vol. 3, pp. 25-55, 2020, Available at SSRN: https://ssrn.com/abstract=3601606 or http://dx.doi.org/10.1146/annurev-control-101119-071628

Stefanie Tellex (Contact Author)

Brown University ( email )

Box 1860
Providence, RI 02912
United States

Nakul Gopalan

Georgia Institute of Technology - School of Interactive Computing ( email )

85 5th St NW
Atlanta, GA 30332
United States

Hadas Kress-Gazit

Cornell University ( email )

616 Thurston Ave
Ithaca, NY 14853
United States

Cynthia Matuszek

University of Maryland, Baltimore County (UMBC) ( email )

1000 Hilltop Circle
Baltimore, MD 21250
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
657
PlumX Metrics