Measuring Stress and Cognitive Load Effects on the Perceived Quality of a Multimodal Dialogue System

Abstract

In this paper we present the results of a pilot study investigating the impact of stress and cognitive load on the perceived interaction quality of a multimodal dialogue system for crisis management. Four test subjects interacted with the system in four differently configured trials aiming to induce low/high levels of stress and cognitive load. Physiological sensors and subjective ratings were collected to measure the level of stress and cognitive load. After each trial the subjects filled in an evaluation questionnaire regarding the system interaction quality. In the end we conducted an in-depth interview with each subject. The trials were recorded with a webcam to facilitate the behaviour analysis. Results showed that both factors had an influence on the way subjects perceived the interaction quality, whereas the cognitive load seems to have a higher impact. Further quantitative experiments are needed in order to validate the results and quantify the weight of each factor.

Keywords: Multimodal conversational interactions, qualitative evaluations, behavior analysis

JEL Classification: C91