Sign Language to Text Conversion for DUMB and DEAF

Authors

  • Dr. Rajiv Choudhary  Professor, Mechanical Department, Delhi Technological University, Main Bawana Road Rohini , Delhi, India
  • Abhishek Goswami  UG student, Mechanical Department, Delhi Technological University, Main Bawana Road Rohini , Delhi, India
  • Chirag Gupta  UG student, Mechanical Department, Delhi Technological University, Main Bawana Road Rohini , Delhi, India
  • Pooja Jangir  UG student, Mechanical Department, Delhi Technological University, Main Bawana Road Rohini , Delhi, India

Keywords:

CNN, text conversion, sign identification.

Abstract

One of the oldest and most prevalent types of language for correspondence is signing, but since most people are not familiar with gesture communication and interpreters are extremely hard to come by, we have come up with a consistent method using brain networks for fingerspelling-based American Gesture-based communication. In our approach, the hand is first processed by a filter, and once the filter has been applied, the hand is processed by a classifier that determines the class of hand movements. The 26 letters in the letter set are 95.7% precisely placed using our method.

References

  1. T. Yang, Y. Xu, and "A., Hidden Markov Model for Gesture Recognition," Carnegie Mellon University, CMU-RI-TR-94 10. Pittsburgh (Pa.) in May 1994.
  2. Mary Ellen Foster, Alois Knoll, Pujan Ziaie, Thomas Muller, and Mary Ellen of Robotics and Embedded Systems, Informatics VI, Boltzmann St. 3, Garching, Germany, DE-85748
  3. https://docs.opencv.org/2.4/doc/instructional exercises/imgproc/gausian_median_blur_b ilateral_filter/gausian_median_blur_bilateral_filter.html
  4. Mohammed Waleed Kalous, PowerGloves-based machine recognition of Auslan signs: toward the recognition of sign language with a large lexicon.
  5. aeshpande3.github.io/A-Beginner%27s-Guide-To-U.
  6. http://www-i6.informatik.rwth-aachen.de/~dreuw/database.php
  7. Kinder Mans PJ, Dieleman S, Pigou L, Schrauwen B. (2015) Communication via gestures Acknowledgment Utilizing Convolutional Brain Organizations. In: Agapito L., Bronstein M., Rother C. (eds) PC Vision - ECCV 2014 Studios. ECCV 2014. Volume 8925 of Lecture Notes in Computer Science. Cham, Springer
  8. Shaheen, Zaki, M.M., and S.I.: Communication through signing acknowledgment utilizing a mix of new vision based highlights. Letters on Pattern Recognition, 32(4), 572–577
  9. N. Mukai, N. Harada and Y. Chang, "Japanese Fingerspelling Acknowledgment In view of Grouping Tree and AI," 2017 Nicograph Worldwide (NicoInt), Kyoto, Japan, 2017, pp. 19-24. doi:10.1109/NICOInt.2017.9
  10. Byeongkeun Kang , Subarna Tripathi , Truong Q. Nguyen "Constant gesture based communication fingerspelling acknowledgment utilizing convolutional brain networks from profundity map" 2015 third IAPR Asian Meeting on Example Acknowledgment (ACPR)
  11. https://opencv.org/
  12. https://en.wikipedia.org/wiki/TensorFlow
  13. https://en.wikipedia.org/wiki/Convolutional_neural_network.

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2023-06-30

Issue

Volume 9, Issue 3, May-June-2023

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Dr. Rajiv Choudhary, Abhishek Goswami, Chirag Gupta, Pooja Jangir, " Sign Language to Text Conversion for DUMB and DEAF" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 9, Issue 3, pp.223-230, May-June-2023.