Comparative Analysis of Chatbots

Abstract

A chatbot is computer software that employs Natural Language Processing and Pattern Recognition techniques to provide appropriate answers to questions posed by humans. In this paper, we are analyzing and comparing the total accuracy score of the following chatbots: Rose, Google Assistant, Siri, Machine Comprehension Chatbot, Mitsuku, Jabberwacky, ALICE and Eliza based on the answers provided by them to a set of predefined questions. The chatbots were broadly analyzed on three focal parameters: 1. Assessment of Factual Questions, 2. Assessment of Conversational Attributes, and 3. Evaluation of Exceptional queries. The paper produces conclusive comparisons and conclusions and then ranks these chatbots according to their performance in the above-mentioned focal points. These focal points help in assessing the chatbots according to their responses by assigning a rank to each chatbot concerning others. The final level is evaluated by averaging grades attained in the three parameters above.

Keywords: Rose, Google Assistant, Siri, Machine Comprehension, Mitsuku, Jabberwacky, ALICE, ELIZA, Natural Language Processing, ChatBot, Pattern Recognition