ConvNet on Doppler Spectrogram: A Novel Enactment of Hand Gesture Recognition

Abstract

Consumer electronics industry is investing much of its R&D backbone in realising the best human-machine interface at any point of time. Out of the different technologies conceived to meet this demand, hand gesture recognition is becoming a widely accepted one. Most of the existing systems are build by adding an additional sensing element to the device which is to be controlled. The present work introduces an external device free hand gesture recognition system using convolutional neural networks. The concept is proved in MacBook Air 13 inch laptop by converting it into an active sonar system and it can be extended to any of the similar mobile device with a pair of microphone and speaker. The system is able to decode and classify four types of hand gestures with a classification accuracy of 90%.

Keywords: Spectrogram, Convolution Neural Network, Doppler, Hand Gesture