Sign Recognition and Voice Conversion Device for Dumb

CH Laxmana Sudheer; CH Susmitha; R Vishal; G Durga Prasad; B Sivakumar; C Girish Kumar

doi:10.32628/CSEIT24102130

Authors

CH Laxmana Sudheer Assistant Professor (M.Tech), Department of Electrical Communication Engineering, Siddhartha Institute of Science and Technology, Puttur, Karnataka, India Author
CH Susmitha Department of Electrical Communication Engineering, Siddhartha Institute of Science and Technology, Puttur, Karnataka, India Author
R Vishal Department of Electrical Communication Engineering, Siddhartha Institute of Science and Technology, Puttur, Karnataka, India Author
G Durga Prasad Department of Electrical Communication Engineering, Siddhartha Institute of Science and Technology, Puttur, Karnataka, India Author
B Sivakumar Department of Electrical Communication Engineering, Siddhartha Institute of Science and Technology, Puttur, Karnataka, India Author
C Girish Kumar Department of Electrical Communication Engineering, Siddhartha Institute of Science and Technology, Puttur, Karnataka, India Author

DOI:

https://doi.org/10.32628/CSEIT24102130

Keywords:

LCD, DHT11, Arduino Uno, APR9600, Sound Alert

Abstract

This project proposes a comprehensive hardware setup for home automation and environmental monitoring. The system includes components such as a Bluetooth module for remote control, a voice module (APR9600) for audio feedback, an LCD for display purposes, relay modules for controlling electrical devices, bulbs with holders for lighting, a CPU fan for temperature regulation, speakers for audio output, and a 5V power supply for operation. The core functionality of the system revolves around the integration of flux sensors for environmental monitoring. When flux sensors detect specific conditions, predefined audio signals are played through the voice module. These conditions correspond to six distinct signs, facilitating real-time alerts and notifications. Moreover, the system offers remote control capabilities through Bluetooth connectivity, enabling users to manage lighting and fan operations conveniently. Additionally, temperature monitoring is implemented using a DHT11 sensor, triggering the activation of the CPU fan when temperature thresholds are exceeded. Furthermore, an LCD display enhances user interaction by providing visual feedback and status updates. The project utilizes Arduino UNO as the central processing unit and incorporates 12V 1A adapters for powering specific components. Connectors and power cables are utilized for seamless integration and electrical connectivity. Overall, this project presents an integrated solution for home automation and environmental monitoring, offering flexibility, convenience, and enhanced user experience.

Downloads

Download data is not yet available.

References

Shinde, Shweta S., Rajesh M. Autee, and Vitthal K. Bhosale presented a novel method titled "Real-time bidirectional communication approach for individuals with hearing impairment and speech impediments leveraging image processing" at the 2016 IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), organized by the Institute of Electrical and Electronics Engineers (IEEE).

Shangeetha, R. K., V. Valliammai, and S. Padmavathi presented a research paper titled "Computer vision-based approach for Indian Sign Language character recognition" at the 2012 International Conference on Machine Vision and Image Processing (MVIP), organized by IEEE. DOI: https://doi.org/10.1109/MVIP.2012.6428790

Sood, Anchal, and Anju Mishra presented a communication system named AAWAAZ designed specifically for individuals who are deaf and mute. This innovative system was introduced at the 2016 5th International Conference on Reliability, Infocom Technologies, and Optimization (ICRITO), organized by IEEE.

Ahire, P.G., and colleagues authored a paper titled "Bidirectional Communication System for Deaf and Mute Individuals and Hearing Individuals," which was presented at the 2015 International Conference on Computing Communication Control and Automation (ICCUBEA), organized by IEEE.

Kumari, Sonal, and Suman K. Mitra conducted a study on human action recognition utilizing Discrete Fourier Transform (DFT). Their research was presented in a paper titled "Human action recognition using DFT" at the 2011 Third National Conference on Computer Vision, Pattern Recognition, Image Processing, and Graphics (NCVPRIPG), organized by the Institute of Electrical and Electronics Engineers (IEEE). DOI: https://doi.org/10.1109/NCVPRIPG.2011.58

"Designing and Developing a Hand Gesture Recognition System for Individuals with Speech Impairments" by R. Vinitha and A. Theerthana.

Pantic, M., Nijholt, A., Pentland, A., and Huang, T.S. (Year). Advancing Towards Human-Centered Intelligent Human-Computer Interaction (HCI2): Current Progress and Future Prospects

International Journal of Autonomous and Adaptive Communications Systems (IJAACS), Volume 1, Issue 2, published in 2008, with pages numbered 168 to 187. The Digital Object Identifier (DOI) for this publication is 10.1504/IJAACS.2008.019799.