Hand Gesture Recognition and Voice Conversion for Speech Impaired

12 Pages Posted: 25 Nov 2020 Last revised: 7 Jan 2021

See all articles by Priyakanth R

Priyakanth R

BVRIT Hyderabad College of Engineering for Women

Sai Krishna N.M

BVRIT Hyderabad College of Engineering for Women

Radha Abburi

BVRIT Hyderabad College of Engineering for Women

Date Written: November 21, 2020

Abstract

Speech impairment may be infirmities that affect a human’s capability to reach out others via conversation and listening. Humankind in such community, suffering from the above said disability, adopts sign language as an alternate mode of conversation. Even though speech and hearing impaired are using sign language everywhere, the non-sign language speakers face challenges in communicating with speech impaired. Modern approaches in deep learning and computer vision have resulted in a tremendous improvement in the areas of motion and hand sign identification. The main motive presented work is to develop vision-based applications that provide sign language transliteration to speech enabling communication among verbal and non-verbal communicators. The proposed framework uses a methodology of collecting video sequences followed by extracting temporal and spatial features. Recognition of spatial features is compassed using “Convolutional Neural Networks” and to train on temporal features, “Recurrent Neural Networks” were utilized. The databases employed are the American Sign Language datasets.

Keywords: Speech Impairment; American Sign Language; Raspberry Pi, Machine Learning, Convolutional Neural Networks; Feature recognition

Suggested Citation

R, Priyakanth and N.M, Sai Krishna and Abburi, Radha, Hand Gesture Recognition and Voice Conversion for Speech Impaired (November 21, 2020). Proceedings of the 2nd International Conference on IoT, Social, Mobile, Analytics & Cloud in Computational Vision & Bio-Engineering (ISMAC-CVB 2020), Available at SSRN: https://ssrn.com/abstract=3734777 or http://dx.doi.org/10.2139/ssrn.3734777

Priyakanth R (Contact Author)

BVRIT Hyderabad College of Engineering for Women ( email )

Sai Krishna N.M

BVRIT Hyderabad College of Engineering for Women ( email )

Radha Abburi

BVRIT Hyderabad College of Engineering for Women ( email )

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
48
Abstract Views
250
PlumX Metrics