Recognition of Human Facial Expressions through the Application of Emerging Neural Networks
DOI:
https://doi.org/10.32628/CSEIT2410612392Keywords:
Emotion Detection, Neural Network (NN), Face Expression, Pre-processing, Classification, PredictionAbstract
Emotion recognition based on facial expressions has long been a human strength, but developing an algorithm to do the same feat is a formidable challenge. Recent developments in computer vision and ML have made emotion detection in pictures a reality. For a long time, face detection has been available. The next logical step is to simulate the human brain's expressions using video, electroencephalogram (EEG), or still images of the face. In order for contemporary AI systems to mimic and assess reactions from face, human emotion recognition is an urgent necessity. Whether it's about identifying intent, promoting offerings, or security-related dangers, this may assist make educated judgments. Emotion recognition in photos or videos is easy for humans to do, but it's a huge challenge for computers and calls for a plethora of image processing algorithms to extract features. This task may be accomplished with the help of several machine learning techniques. In order for machine learning to do any sort of detection or identification, training algorithms must first be developed and then tested on appropriate datasets. Facial emotion recognition via neural networks (NN) is a new method that we present in this article. Using real-life human emotions, the suggested technique achieves an unprecedented level of real-time emotion identification an average accuracy of 94%.
Downloads
References
Garcia-Garcia JM, Penichet VMR, Lozano MD, “Emotion detection: a technology review”, In: Proceedings of the XVIII int. conf. on human computer interaction, pp 1–8, 2017 DOI: https://doi.org/10.1145/3123818.3123852
Saurabh Sahu, Km Divya, Dr. Neeta Rastogi, Puneet Kumar Yadav, Y. Perwej, “Sentimental Analysis on Web Scraping Using Machine Learning Method” , Journal of Information and Computational Science, Volume 12, Issue 8, Pages 24-29, 2022, DOI: 10.12733/JICS.2022/V12I08.535569.67004
Xavier Glorot and Yoshua Bengio. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, pages 249–256, 2010
Y. Perwej, “Unsupervised Feature Learning for Text Pattern Analysis with Emotional Data Collection: A Novel System for Big Data Analytics”, IEEE International Conference on Advanced computing Technologies & Applications (ICACTA'22), SCOPUS, IEEE No: #54488 ISBN No Xplore: 978-1-6654-9515-8, Coimbatore, India, 4-5 March 2022, DOI:10.1109/ICACTA54488.2022.9753501 DOI: https://doi.org/10.1109/ICACTA54488.2022.9753501
Kim J, Andre´ E,”Emotion recognition based on physio logical changes in music listening”, IEEE Trans Pattern Anal Mach Intell 30(12):2067–2083, 2008 DOI: https://doi.org/10.1109/TPAMI.2008.26
J Chen, X Yao, Huang Fen∗ et al., "N status monitoring model in winter wheat based on image processing[J]", Transactions of the Chinese Society of Agricultural Engineering, vol. 32, no. 4, pp. 163-170, 2016
Dawar Husain, Y. Perwej, Satendra Kumar Vishwakarma, Prof. (Dr.) Shishir Rastogi, Vaishali Singh, N. Akhtar, “Implementation and Statistical Analysis of De-noising Techniques for Standard Image”, International Journal of Multidisciplinary Education Research (IJMER), ISSN:2277-7881, Volume 11, Issue10 (4), Pages 69-78, 2022, DOI: 10.IJMER/2022/11.10.72
Schoneveld, L.; Othmani, A.; Abdelkawy, H. Leveraging recent advances in deep learning for audio-visual emotion recognition. Pattern Recognit. Lett. 2021, 146, 1–7 DOI: https://doi.org/10.1016/j.patrec.2021.03.007
Sun, Q.; Liang, L.; Dang, X.; Chen, Y. Deep learning-based dimensional emotion recognition combining the attention mechanism and global second-order feature representations. Comput. Electr. Eng. 2022, 104, 108469
Y. Perwej, F. Parwej, A. Perwej, “Copyright Protection of Digital Images Using Robust Watermarking Based on Joint DLT and DWT”, International Journal of Scientific & Engineering Research (IJSER), France, ISSN 2229-5518, Volume 3, Issue 6, Pages 1- 9, June 2012
Y. Perwej, “An Evaluation of Deep Learning Miniature Concerning in Soft Computing”, International Journal of Advanced Research in Computer and Communication Engineering (IJARCCE), ISSN (Online): 2278-1021, Volume 4, Issue 2, Pages 10 - 16, 2015, DOI: 10.17148/IJARCCE.2015.4203 DOI: https://doi.org/10.17148/IJARCCE.2015.4203
Kajal, Neha Singh, N. Akhtar, Ms. Sana Rabbani, Y.f Perwej, Susheel Kumar, “Using Emerging Deep Convolutional Neural Networks (DCNN) Learning Techniques for Detecting Phony News”, International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN: 2456-3307, Volume 10, Issue 1, Pages 122-137, 2024, DOI: 10.32628/CSEIT2410113 DOI: https://doi.org/10.32628/CSEIT2410113
Q. Fan, L. Brown and J. Smith, "A closer look at Faster R-CNN for vehicle detection", 2016 IEEE Intelligent Vehicles Symposium (IV), pp. 124-129, 2016 DOI: https://doi.org/10.1109/IVS.2016.7535375
Sepu´lveda A, Castillo F, Palma C, Rodriguez-Fernandez M,”Emotion recognition from ECG signals using wavelet scattering and machine learning”, Appl Sci 11(11):4945, 2021 DOI: https://doi.org/10.3390/app11114945
Pantic, M., Valstar, M., Rademaker, R., & Maat, L. Web-based database for facial expression analysis. In 2005 IEEE International Conference on Mult. and Expo 5 IEEE, 2005
Apoorva Dwivedi, Dr. Basant Ballabh Dumka, N. Akhtar, Ms Farah Shan, Y. Perwej, “Tropical Convolutional Neural Networks (TCNNs) Based Methods for Breast Cancer Diagnosis”, International Journal of Scientific Research in Science and Technology (IJSRST), Print ISSN: 2395-6011, Online ISSN: 2395-602X, Volume 10, Issue 3, Pages 1100 -1116, 2023, DOI: 10.32628/IJSRST523103183 DOI: https://doi.org/10.32628/IJSRST523103183
Dileep Kumar Gupta, Prof. (Dr.) Devendra Agarwal, Y. Perwej, Opinder Vishwakarma, Priya Mishra, Nitya, “Sensing Human Emotion using Emerging Machine Learning Techniques”, International Journal of Scientific Research in Science, Engineering and Technology (IJSRSET), Print ISSN: 2395-1990 , Online ISSN : 2394-4099, Volume 11, Issue 4, Pages 80-91, July-August -2024, DOI: 10.32628/IJSRSET24114104 DOI: https://doi.org/10.32628/IJSRSET24114104
Yang, B., Cao, J., Ni, R. & Zhang, Y. Facial expression recognition using weighted mixture deep neural network based on double channel facial ima. IEEE Access 6, 4630–4640, 2017 DOI: https://doi.org/10.1109/ACCESS.2017.2784096
Y. Perwej, A. Perwej, F. Parwej, “An Adaptive Watermarking Technique for the copyright of digital images and Digital Image Protection”, International journal of Multimedia & Its Applications (IJMA), which is published by Academy & Industry Research Collaboration Center (AIRCC) , USA , Volume 4, No.2, Pages 21- 38, April 2012, DOI: 10.5121/ijma.2012.4202 DOI: https://doi.org/10.5121/ijma.2012.4202
Y. Perwej, N. Akhtar, F. Parwej, “The Kingdom of Saudi Arabia Vehicle License Plate Recognition using Learning Vector Quantization Artificial Neural Network”, International Journal of Computer Applications (IJCA), USA, ISSN 0975 – 8887, Volume 98, No.11, Pages 32 – 38, 2014, DOI: 10.5120/17230-7556 DOI: https://doi.org/10.5120/17230-7556
Sahoo, G.K.; Das, S.K.; Singh, P. Deep learning-based facial emotion recognition for driver healthcare. In Proceedings of the 2022 National Conference on Communications (NCC), Mumbai, India, 24–27 May 2022; pp. 154–159. DOI: https://doi.org/10.1109/NCC55593.2022.9806751
A. Krizhevsky and G. Hinton. “Learning multiple layers of features from tiny images”, 2009
K. Bouaziz, T Ramakrishnan, S. Raghavan, K. Grove, A.A.Omari, C Lakshminarayan, “ Character Recognition by Deep Learning: An Enterprise solution.”, 2018 IEEE Conference on Big Data DOI: https://doi.org/10.1109/BigData.2018.8622465
N. Akhtar, Y. Perwej, F. Parwej, Jai Pratap Dixit, “A Review of Solving Real Domain Problems in Engineering for Computational Intelligence Using Soft Computing” Proceedings of the 11th INDIACom; INDIACom-2017; SCOPUS, IEEE Conference ID: 40353, 2017 4th International Conference on “Computing for Sustainable Global Development”, ISSN 0973-7529; ISBN 978-93-80544-24-3, Pages 706–711, Bharati Vidyapeeth's Institute of Computer Applications and Management (BVICAM), New Delhi (INDIA), 01st - 03rd March, 2017
Zhang X-D (2020) A matrix algebra approach to artificial intelligence. Springer DOI: https://doi.org/10.1007/978-981-15-2770-8
Liu H, Lang B, ”Machine learning and deep learning methods for intrusion detection systems: a survey,” Appl Sci 9(20):4396, 2019 DOI: https://doi.org/10.3390/app9204396
Jung, H., Lee, K., & Yoon, C. (2019). Facial emotion recognition using deep neural networks with multimodal data. IEEE Transactions on Affective Computing, 10(4), 554-565.
Aparna Trivedi, Chandan Mani Tripathi, Y. Perwej, Ashish Kumar Srivastava, Neha Kulshrestha, “Face Recognition Based Automated Attendance Management System”, International Journal of Scientific Research in Science and Technology (IJSRST), Print ISSN : 2395-6011, Online ISSN : 2395-602X, Volume 9, Issue 1, Pages 261-268, January-February-2022, DOI: 10.32628/IJSRST229147
Zhao, X., Liu, J., Wu, S., & Wang, L. (2019). Emotion detection from facial expressions using a novel convolutional neural network architecture. Pattern Recognition Letters, 125, 326-333. DOI: https://doi.org/10.1016/j.patrec.2019.07.009
S. Mishra, V. Verma, N. Akhtar, S. Chaturvedi and Y. Perwej, "An intelligent motion detection using OpenCV", Int. J. Sci. Res. Sci. Eng. Technol., vol. 9, no. 2, pp. 51-63, 2022 DOI: https://doi.org/10.32628/IJSRSET22925
Prasetyo, L. P., Mawengkang, H., & Wibowo, A. (2018). Visual emotion recognition from facial expressions using transfer learning and deep neural networks. Journal of Ambient Intelligence and Humanized Computing, 9(6), 1943-1952.
Martinez, B., Valstar, M. F., Jiang, B., Pantic, M., & Binefa, X. (2017). Facial landmark detection in the wild. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 781-790).
Ekman P, Friesen WV (1971) Constants across cultures in the face and emotion. J Personal Soc Psychol 17(2):124 DOI: https://doi.org/10.1037/h0030377
Matsumoto D (1992) More evidence for the universality of a contempt expression. Motiv Emot 16(4):363 DOI: https://doi.org/10.1007/BF00992972
Sajid M, Iqbal Ratyal N, Ali N, Zafar B, Dar SH, Mahmood MT, Joo YB (2019) The impact of asymmetric left and asymmetric right face images on accurate age estimation. Math Probl Eng 2019:1–10 DOI: https://doi.org/10.1155/2019/8041413
Ratyal NI, Taj IA, Sajid M, Ali N, Mahmood A, Razzaq S (2019) Three-dimensional face recognition using variance-based registration and subject-specific descriptors. Int J Adv Robot Syst 16(3):1729881419851716 DOI: https://doi.org/10.1177/1729881419851716
Ratyal N, Taj IA, Sajid M, Mahmood A, Razzaq S, Dar SH, Ali N, Usman M, Baig MJA, Mussadiq U (2019) Deeply learned pose invariant image analysis with applications in 3D face recognition. Math Probl Eng 2019:1–21 DOI: https://doi.org/10.1155/2019/3547416
Jung, H., Lee, K., & Yoon, C. (2019). Facial emotion recognition using deep neural networks with multimodal data. IEEE Transactions on Affective Computing, 10(4), 554-565. [38] Kim, K., Bang, H., & Kim, J. (2020). Emotion recognition from facial expressions using 3D convolutional neural networks. IEEE Tran.on Affective Computing, 11(1), 50-60.
Y. Perwej, A. Trivedi, C. Tripathi, A. Srivastava, and N. Kulshrestha, “Face recognition based automated attendance management system,” International Journal of Scientific Research in Science and Tech., vol. 9, pp. 261–268, 02 2022. DOI: https://doi.org/10.32628/IJSRST229147
Zeng, J., Wang, Z., & Pantic, M. (2018). Facial action unit recognition with LSTM networks in the wild. IEEE Transactions on Affective Computing, 9(5), 578-584.
Y. Perwej, “The Bidirectional Long-Short-Term Memory Neural Network based Word Retrieval for Arabic Documents”, Transactions on Machine Learning and Artificial Intelligence (TMLAI), which is published by Society for Science and Education, United Kingdom (UK), ISSN 2054-7390, Volume 3, Issue 1, Pages 16 - 27, 2015, DOI: 10.14738/tmlai.31.863 DOI: https://doi.org/10.14738/tmlai.31.863
Stanford University - CS230 Deep Learning, “Facial Expression Recognition with Deep Learning”, 2019
Neha Kulshrestha, N. Akhtar, Y. Perwej, “Deep Learning Models for Object Recognition and Quality Surveillance”, International Conference on Emerging Trends in IoT and Computing Technologies (ICEICT-2022), ISBN 978-10324-852-49, SCOPUS, Routledge, Taylor & Francis, CRC Press, Chapter 75, pages 508-518, Goel Institute of Technology & Management, 2022, DOI: 10.1201/9781003350057-75 DOI: https://doi.org/10.1201/9781003350057-75
W. Swinkels, L. Claesen, F. Xiao and H. Shen, "SVM point-based real-time emotion detection," 2017 IEEE Conference on Dependable and Secure Com.g, Taipei, 2017 DOI: https://doi.org/10.1109/DESEC.2017.8073838
Neumann,M.; Vu, N.T. Attentive convolutional neural network based speech emotion recognition: A study on the impact of input features, signal length, and acted speech. arXiv 2017, arXiv:1706.00612. DOI: https://doi.org/10.21437/Interspeech.2017-917
Imani, M.; Montazer, G.A. A survey of emotion recognition methods with emphasis on E-Learning environments. J. Netw. Comput. Appl. 2019, 147, 102423 DOI: https://doi.org/10.1016/j.jnca.2019.102423
Bhavesh Kumar Jaisawal, Y. Perwej, Sanjay Kumar Singh, Susheel Kumar, Jai Pratap Dixit, Niraj Kumar Singh, “An Empirical Investigation of Human Identity Verification Methods” , International Journal of Scientific Research in Science, Engineering and Technology (IJSRSET), Print ISSN: 2395-1990 ,Online ISSN : 2394-4099, Volume 10, Issue 1, Pages 16-38, 2022, DOI: 10.32628/IJSRSET2310012 DOI: https://doi.org/10.32628/IJSRSET2310012
Sha, T.; Zhang, W.; Shen, T.; Li, Z.; Mei, T. Deep Person Generation: A Survey from the Perspective of Face, Pose, and Cloth Synthesis. ACM Comput. Surv. 2023, 55, 1–37 DOI: https://doi.org/10.1145/3575656
Sachin Bhardwaj, Apoorva Dwivedi, Ashutosh Pandey, Y. Perwej, Pervez Rauf Khan, “Machine Learning-Based Crowd Behavior Analysis and Forecasting”, International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN: 2456-3307, Volume 9, Issue 3, Pages 418-429, 2023-2023, DOI: 10.32628/CSEIT23903104 DOI: https://doi.org/10.32628/CSEIT23903104
Sun, Q.; Liang, L.; Dang, X.; Chen, Y. Deep learning-based dimensional emotion recognition combining the attention mechanism and global second-order feature representations. Comput. Electr. Eng. 2022, 104, 108469 DOI: https://doi.org/10.1016/j.compeleceng.2022.108469
Shweta Pandey, Rohit Agarwal, Sachin Bhardwaj, Sanjay Kumar Singh, Y. Perwej, Niraj Kumar Singh, “A Review of Current Perspective and Propensity in Reinforcement Learning (RL) in an Orderly Manner” , International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 9, Issue 1, Pages 206-227, 2023, DOI: 10.32628/CSEIT2390147 DOI: https://doi.org/10.32628/CSEIT2390147
Y. Goldberg and M. Elhadad, "SVM: Fast Space-Efficient non-Heuristic Polynomial Kernel Computation for NLP Applications", Proc. ACL-08: HLT, 2008
Zhao H, Xiao Y, Zhang Z,”Robust semi supervised generative adversarial networks for speech emotion recognition via distribution smoothness”, IEEE Access 8:, 2020 DOI: https://doi.org/10.1109/ACCESS.2020.3000751
N. Akhtar, Dr. Hemlata Pant, Apoorva Dwivedi, Vivek Jain, Y. Perwej, “A Breast Cancer Diagnosis Framework Based on Machine Learning”, International Journal of Scientific Research in Science, Engineering and Technology (IJSRSET), Print ISSN: 2395-1990, Volume 10, Issue 3, Pages 118-132, 2023, DOI: 10.32628/IJSRSET2310375 DOI: https://doi.org/10.32628/IJSRSET2310375
Zhang J, Yin Z, Chen P, Nichele S ,”Emotion recognition using multi-modal data and machine learning techniques: a tutorial and review”, Inf Fusion 59:103–126, 2020 DOI: https://doi.org/10.1016/j.inffus.2020.01.011
Saurabh Sahu, Km Divya, Dr. Neeta Rastogi, Puneet Kumar Yadav, Y. Perwej, “Sentimental Analysis on Web Scraping Using Machine Learning Method” , Journal of Information and Computational Science (JOICS), ISSN: 1548-7741, Volume 12, Issue 8, Pages 24-29, 2022, DOI: 10.12733/JICS.2022/V12I08.535569.67004
Wan-Hui W, Yu-Hui Q, Guang-Yuan L.,”Electrocardio graphy recording, feature extraction and classification for emo tion recognition”, In: 2009 WRI World congress on computer science and info. engineering, vol 4, pp 168–172. IEEE, 2009 DOI: https://doi.org/10.1109/CSIE.2009.130
Mohsen S, Alharbi AG (2021) EEG-based human emotion prediction using an LSTM model. In: 2021 IEEE international midwest symposium on circuits and systems (MWSCAS), pp 458–461. IEEE DOI: https://doi.org/10.1109/MWSCAS47672.2021.9531707
Peng S, Cao L, Zhou Y, Ouyang Z, Yang A, Li X, Jia W, Shui Yu (2022) A survey on deep learning for textual emotion analysis in social networks. Dig Commun Netw 8(5):745–762 DOI: https://doi.org/10.1016/j.dcan.2021.10.003
S. Li, E. Hanson, X. Qian, H. Li and Y. Chen, "ESCALATE: Boosting the efficiency of sparse CNN accelerator with kernel decomposition", Proc. 54th Annu. IEEE/ACM Int. Symp. Micro., pp. 992-1004, Oct. 2021 DOI: https://doi.org/10.1145/3466752.3480043
Downloads
Published
Issue
Section
License
Copyright (c) 2024 International Journal of Scientific Research in Computer Science, Engineering and Information Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
