header

A Novel Approach to Generate MCQs from Domain Ontology: Considering Dl Semantics and Open-World Assumption

29 Pages Posted: 23 Jun 2018 First Look: Accepted

See all articles by E. V. Vinu

E. V. Vinu

Indian Institute of Technology (IIT), Madras - Artificial Intelligence and Databases Lab

P. Sreenivasa Kumar

Indian Institute of Technology (IIT), Madras - Artificial Intelligence and Databases Lab

Abstract

Ontologies are structures, used for knowledge representation, which model domain knowledge in the form of concepts, roles, instances and their relationships. This knowledge can be exploited by an assessment system in the form of multiple choice questions (MCQs). The existing approaches which use ontologies expressed in the Web Ontology Language (OWL) for MCQ generation, are limited to simple concept related questions — “What is C?” or “Which of the following is an example of C?” (where C is a concept symbol) — or analogy type questions involving roles. There are no efforts in the literature which make use of the terminological axioms in the ontology such as existential, universal and cardinality restrictions on concepts and roles for MCQ generation. Also, there are no systematic methods for generating incorrect answers (distractors) from ontologies. Distractor generation process has to be given much importance, since the generated distractors determine the quality and hardness of an MCQ. We propose two new MCQ generation approaches, which generate MCQs that are very useful and realistic in conducting assessment tests, and the corresponding distractor generating techniques. Our distractor generation techniques, unlike other methods, consider the open-world assumption, so that the generated MCQs will always be valid (falsity of distractors is ensured). Furthermore, we present a measure to determine the difficulty level (a value between 0 and 1) of the generated MCQs. The proposed system is implemented, and experiments on specific ontologies have shown the effectiveness of the approaches. We also did an empirical study by generating question items from a real-world ontology and validated our results with the help of domain experts.

Keywords: OWL Ontologies, Semantic Web, Multiple Choice Questions, Automatic Question Generation

Suggested Citation

Vinu, E. V. and Kumar, P. Sreenivasa, A Novel Approach to Generate MCQs from Domain Ontology: Considering Dl Semantics and Open-World Assumption (2015). Journal of Web Semantics First Look 34_3_4. Available at SSRN: https://ssrn.com/abstract=3199197 or http://dx.doi.org/10.2139/ssrn.3199197

E. V. Vinu (Contact Author)

Indian Institute of Technology (IIT), Madras - Artificial Intelligence and Databases Lab

Sardar Patel Road
Guindy
Chennai, 600034
India

P. Sreenivasa Kumar

Indian Institute of Technology (IIT), Madras - Artificial Intelligence and Databases Lab

Sardar Patel Road
Guindy
Chennai, 600034
India

Register to save articles to
your library

Register

Paper statistics

Abstract Views
176
Downloads
8