Pushing the Boundaries of Vibrotactile Communication: Training to Understand Complex Phrases

44 Pages Posted: 10 Feb 2022

Abstract

The ability to understand simple vocabulary, conveyed by haptics, has demonstrated encouraging results, even with limited training. However, the level of achievable accuracy on communication indicative of real-world conversations, typically characterized by long phrases formed by complex vocabulary, remains unknown. This work presents an in-depth quantitative and qualitative analysis of the learning path of one experienced participant over a two-month period of daily practice with our vibrotactile communication system. By the end of the two months, this participant was able to correctly identify 97% of the words in phrases consisting of 6-8 words, delivered as a sequence of vibration patterns. We compare the progress of this individual with three naive participants who practiced on single-word identification, discussing the subjective aspects of haptic communication, such as the cognitive process of decoding words, and the need for personalization, both in the training program and the haptic encoding.

Keywords: multimodal communication, haptics, phoneme, tactile aid

Suggested Citation

Fontana de Vargas, Mauricio and Marino, David and Weill--Duflos, Antoine and Cooperstock, Jeremy, Pushing the Boundaries of Vibrotactile Communication: Training to Understand Complex Phrases. Available at SSRN: https://ssrn.com/abstract=4031266 or http://dx.doi.org/10.2139/ssrn.4031266

Mauricio Fontana de Vargas (Contact Author)

McGill University ( email )

1001 Sherbrooke St. W
Montreal
Canada

David Marino

McGill University ( email )

1001 Sherbrooke St. W
Montreal
Canada

Antoine Weill--Duflos

McGill University ( email )

1001 Sherbrooke St. W
Montreal
Canada

Jeremy Cooperstock

McGill University ( email )

1001 Sherbrooke St. W
Montreal
Canada

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
11
Abstract Views
51
PlumX Metrics