header

No One is Perfect: Analysing the Performance of Question Answering Components Over the Dbpedia Knowledge Graph

12 Pages Posted: 20 Jan 2021 Publication Status: Accepted

See all articles by Kuldeep Singh

Kuldeep Singh

Fraunhofer IAIS

Ioanna Lytra

University of Bonn

Arun Sethupat Radhakrishna

University of Minnesota

Saeedeh Shekarpour

University of Dayton

Maria-Esther Vidal

Universidad Simón Bolívar (USB) - Computer Science Department

Jens Lehmann

University of Bonn

Abstract

Question answering (QA) over knowledge graphs has gained significant momentum over the past five years due to the increasing availability of large knowledge graphs and the rising importance of question answering for user interaction. DBpedia has been the most prominently used knowledge graph in this setting and most approaches currently use a pipeline of processing steps connecting a sequence of components. In this article, we analyse and micro evaluate the behaviour of 29 available QA components for the DBpedia knowledge graph that were released by the research community since 2010. As a result, we provide a perspective on collective failure cases, suggest characteristics of QA components that prevent them from performing better and provide future challenges and research directions in the field.

Suggested Citation

Singh, Kuldeep and Lytra, Ioanna and Sethupat Radhakrishna, Arun and Shekarpour, Saeedeh and Vidal, Maria-Esther and Lehmann, Jens, No One is Perfect: Analysing the Performance of Question Answering Components Over the Dbpedia Knowledge Graph. Journal of Web Semantics First Look , Available at SSRN: https://ssrn.com/abstract=3769878 or http://dx.doi.org/10.2139/ssrn.3769878

Kuldeep Singh (Contact Author)

Fraunhofer IAIS ( email )

Sankt Augustin
Germany

Ioanna Lytra

University of Bonn ( email )

Arun Sethupat Radhakrishna

University of Minnesota ( email )

Saeedeh Shekarpour

University of Dayton ( email )

Maria-Esther Vidal

Universidad Simón Bolívar (USB) - Computer Science Department ( email )

Sartenejas
Caracas
Venezuela

Jens Lehmann

University of Bonn ( email )

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
82
Downloads
3
PlumX Metrics