Facial Expression Recognition Using Convolutional Neural Network

Authors

  • Vaibhav Govindwar Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India Author
  • Aman Akbani Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India Author
  • Aachal Nandeshwar Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India Author
  • Aishwarya Wanjari Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India Author
  • Prachi Agashe Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India Author
  • Charan Pote Professor, Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India Author

DOI:

https://doi.org/10.32628/CSEIT24102122

Keywords:

Deep Learning, CNN, LeNet-5, FER-2013, Adam

Abstract

Understanding others' intentions through nonverbal cues like facial emotions is crucial in human communication. To design and train Deep Learning Models, this paper describes in detail how Convolutional Neural Network Models are developed using tf. Keras. The aim is to Sort facial photos into one of the seven face detection classifiers, our model is developed in such a manner that it learns hidden nonlinearity from the entered facial images, which is vital for discriminating the form of emotion someone is expressing. The model proposed on the Lenet-5 architecture by Yann LeCun uses the subsampling, feature map, and activation function (ReLu) in between the convolutional layer and fully connected layer for the output soft-max activation function will be used. The FER-2013 dataset, which consists of 35,887 structured 48x48 pixel grayscale images, was used to train the CNN models. The training dataset has 28,709 elements, while the testing dataset has 3,589 elements, and while validation has 3,589 elements. Train and test are the two folder names used to organize the FER dataset. separated even further into distinct files, each holding a different kind of FER dataset class. To mitigate the overfitting of the dropout, batch normalization and the model are employed. Since this is a multiclass classification problem, we are utilizing the Soft-max activation function and the Rectified linear unit for non-linear operation (ReLu). We are training a categorical cross- entropy and matrix for accuracy based on the parameters to assess the constructed CNN model's performance by examining the training epoch history and we have used optimizer Adam (Adaptive Moment Estimation) with the learning rate of 0.0001. We obtained the accuracy of the LeNet-5 model on training at 95.49% and testing at 49.47% [13].

Downloads

Download data is not yet available.

Author Biographies

  • Aman Akbani, Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India

    Computer Technology Department

  • Aachal Nandeshwar, Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India

    Computer Technology Department 

  • Aishwarya Wanjari, Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India

    Computer Technology Department 

  • Prachi Agashe, Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India

    Computer Technology Department 

  • Charan Pote, Professor, Department of Computer Technology, Priyadarshini College of Engineering, Nagpur, Maharashtra, India

    Computers Technology Department 

References

YANN LECUN, MEMBER, IEEE, L´ EON BOTTOU, YOSHUA BENGIO, AND PATRICK HAFFNER, Gradient-Based Learning Applied to Document Recognition, PROCEEDINGS OF THE IEEE, VOL. 86, NO. 11, NOVEMBER 1998 DOI: https://doi.org/10.1109/5.726791

Shima Alizadeh, Azar Fazel. Convolutional Neural Networks for Facial Expression Recognition, Stanford University, 2016

Raghuvanshi, Arushi, and Vivek Choksi. "Facial Expression Recognition with Convolutional Neural Networks." Stanford University, 2016

Alizadeh, Shima, and Azar Fazel. "Convolutional Neural Networks for Facial Expression Recognition." Stanford University, 2016

Diah Anggraeni, Pitalokaa,, Ajeng Wulandaria, T. Basaruddina, Dewi Yanti Lilianaa. Enhancing CNN with Preprocessing Stage in Automatic Emotion Recognition. 2nd International Conference on Computer Science and Computational Intelligence 2017, ICCSCI 2017, 13-14 October 2017.

Chu, William Wei-Jen Tsai, Hui-Chuan, YuhMin Chen and Min-Ju Liao. Facial expression recognition with transition detection for students with high-functioning autism in adaptive e- learning.” Soft Computing: ,2017. DOI: https://doi.org/10.1007/s00500-017-2549-z

”End-to-end multi-modal Expressions recousing neural networks.” IEEE Journal of Topics in Signal Processing 11, no. 8: 13011309, 2017 DOI: https://doi.org/10.1109/JSTSP.2017.2764438

Ravichandra ginne, krupa Jariwala. FACIAL EXPRESSION RECOGNITION USING CNN. International Journal of Advances in Electronics and Computer Science, 2018

Hai-Duong Nguyen, Soojan Yeom, Kyoung-Min Kim, Facial Expression Recognition Using Multi- Level Convolutional Neural Network, International Journal of Pattern Recognition and Artificial Intelligence, 2018 DOI: https://doi.org/10.1142/S0218001419400159

Guan Wang, Jun Gong. Facial Expression Recognition Based on Improved LeNet-5 CNN. IEEE, 2019 DOI: https://doi.org/10.1109/CCDC.2019.8832535

Joshua. G. Okemwa, Victor Mageto, Facial expression Recognition Using CNN and HOG classifier, IJRASET, 2019.

Sahar Zafar, Subhash Guriro, Fayyaz Ali, Ifran Ali. Facial Expression Recognition with Histogram of Oriented Gradients using CNN, Indian Journal of Science and Technology 12(24), 2019 DOI: https://doi.org/10.17485/ijst/2019/v12i24/145093

S. Marry Hima Preethi, P. Sobha, p. Rajalakshmi, k. Gowri Raghavendra Narayan, Facial Expression Recognition Using CNN, IJSRCSEIT 2020. DOI: https://doi.org/10.32628/CSEIT206248

J. Bodapati, U. Srilakshmi, N. Veer Anjaneyulu, FERNet: A Deep CNN Architecture for Facial Expression Recognition, published in Journal of the Institution of Engineers in 2021 DOI: https://doi.org/10.1007/s40031-021-00681-8

Akash Kumar, Athira B. Nair, S. Jena, Debaraj Rana, Subrat .K. Pradhan, Facial Expression Recognition using python using CNN model, Journal of Applied Science, and Technology, 2021. DOI: https://doi.org/10.9734/cjast/2021/v40i2031459

Raheena Bagwan1, Sakshi Chintawar1, Komal Dhapudkar1, Alisha Balamwar1, Mr. Sandeep Gore2. FACIAL EMOTION RECOGNITION USING CONVOLUTION NEURAL NETWORK. IJCRT, 2021

Downloads

Published

29-04-2024

Issue

Section

Research Articles

How to Cite

[1]
V. Govindwar, Aman Akbani, Aachal Nandeshwar, Aishwarya Wanjari, Prachi Agashe, and Charan Pote, “Facial Expression Recognition Using Convolutional Neural Network”, Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol, vol. 10, no. 2, pp. 786–794, Apr. 2024, doi: 10.32628/CSEIT24102122.

Similar Articles

1-10 of 89

You may also start an advanced similarity search for this article.