Embedded Signcommunication Recognition Using KNN and HMM-VITERBI Fusion Classifiers

4 Pages Posted: 1 Aug 2019

See all articles by V.G.S. Archana

V.G.S. Archana

Kings Engineering College - Department of Electrical and Computer Engineering

Linie Sharon R

Kings Engineering College - Department of Electrical and Computer Engineering

Date Written: August 1, 2019

Abstract

A new hybrid approach for the Embedded Sign Language Recognition (ESLR) is proposed using the combination of the K-means NearbyNetwork (KNN) and Hidden Markov Model (HMM-VITERBI) classifiers in order to avoid the interpreter assistance. This system is combination of the hand gesture image recognition along with the Non-Audible Mumble (NAM) speech recognition system. For image recognition webcam with microcontroller unit with associated display device is used. For hand sign detection Bluetooth module is used. This type of approach will be very useful for the deaf and dump people. The proposed hybrid approach consists of two separate feature extraction techniques and one combined classification module is used to recognize the sigh language. By using this hybrid classifiers ourproposed method gives the accuracy ofabout 65% for the hand gesture images and accuracy of about 85% for the audio speech signals and the overall accuracy for both the inputs is been measured as 88%.

Keywords: Sign Language Recognition, ARM Processor, Hand Gesture, NAM microphone, KNN and HMM VITERBI classifier

Suggested Citation

Archana, V.G.S. and R, Linie Sharon, Embedded Signcommunication Recognition Using KNN and HMM-VITERBI Fusion Classifiers (August 1, 2019). Proceedings of International Conference on Recent Trends in Computing, Communication & Networking Technologies (ICRTCCNT) 2019. Available at SSRN: https://ssrn.com/abstract=3430255 or http://dx.doi.org/10.2139/ssrn.3430255

V.G.S. Archana (Contact Author)

Kings Engineering College - Department of Electrical and Computer Engineering ( email )

India

Linie Sharon R

Kings Engineering College - Department of Electrical and Computer Engineering ( email )

India

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
4
Abstract Views
134
PlumX Metrics