Sign Language to Text Converter Using Hand Gestures

Authors

  • Akanksha Pawar  Department of Computer Engineering, Zeal College of Engineering & Research, Pune, Maharashtra, India
  • Harshada Bhosale  Department of Computer Engineering, Zeal College of Engineering & Research, Pune, Maharashtra, India
  • Mansi Diwan  Department of Computer Engineering, Zeal College of Engineering & Research, Pune, Maharashtra, India

Keywords:

Support Vector Machine, Image Processing, Mediapipe, Gesture Recognition, Machine Learning.

Abstract

Sign Language is been used by hearing impaired people who are unable to interact through speech with normal people. According to the WHO study currently around more than 1.5 billion people live with hearing loss all over the world. Without sign language it becomes hard to interact with the hearing-impaired person as common people are unaware of sign language and gestures. Hence communication becomes hard. There is a need for a intermediate to translate what they want to express. Our work aims to improve the communication with the hearing-impaired person. This paper does American sign language recognition using google’s Mediapipe Hands API to detect landmarks on the hands to detect gestures and uses Support Vector Machine (SVM) classification algorithm for achieving high accuracy. The model works on web application. The proposed concept (sign language conversion to text, speech and image) is a breakthrough for helping the hearing-impaired community.

References

  1. Kohsheen Tiku, Jayshree Maloo, Aishwarya Ramesh and Indra R."Realtime Conversion of Sign Language to Text and Speech". Proceedings of the Second International Conference on Inventive Research in Computing Applications (ICIRCA-2020).
  2. Subhalaxmi Chakraborty, Nanak Bandyopadhyay, Piyal Chakraverty, Swatilekha Banerjee, Zinnia Sarkar, Sweta Ghosh."Indian Sign Language Classification (ISL) using Machine Learning ".American Journal of Electronics and Communication, Vol. I (3), 17-21.
  3. Ketan Gomase1, Akshata Dhanawade2, Prasad Gurav3, Sandesh Lokare4."Sign Language Recognition using Mediapipe". Volume: 09 Issue: 01 | Jan 2022.
  4. Adarsh Vishwakarma1 Niraj Yadav2 Prajnay Yadav3 Vaibhav Singh4 “Sign LanguageRecognition Using Mediapipe Framework with Python” (Vol. 9, Issue 3, 2021

Downloads

Published

2022-04-30

Issue

Section

Research Articles

How to Cite

[1]
Akanksha Pawar, Harshada Bhosale, Mansi Diwan, " Sign Language to Text Converter Using Hand Gestures" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 8, Issue 2, pp.435-439, March-April-2022.