A Review of Classification Methods for Social Emotion Analysis

Authors(2) :-Selvapriya M , Dr.Maria Priscilla. G

Emotion classification has a broad range of applications. There are many application which uses Facial Expression to evaluate human nature, feelings, judgment, opinion. Recognizing Human Facial Expression is not a simple task because of some circumstances due to illumination, facial occlusions, face color/shape etc. Moreover, online comments are typically characterized by a sparse feature space, which makes the corresponding emotion classification tasks are very difficult. In our research work, social emotional classifications are classified through artificial neural network (ANN), deep learning and rich hybrid neural network (HNN) which will directly and indirectly used to recognize human expression in various conditions. This review also focuses on an up-to-date hybrid deep-learning approach combining a convolutional neural network (CNN) for the spatial features of an individual frame and long short-term memory (LSTM) for temporal features of consecutive frames. The analysed methodologies are implemented using Matlab. The experimental results show that the CNN model attained better classification accuracy compared than rich Hybrid Neural Network (HNN) and Artificial Neural Network (ANN) schemes. The performance evaluation conducted was proved that the each and every method has unique advantage and disadvantages among each other.

Authors and Affiliations

Selvapriya M
Research Scholar, Student Member, IEEE , Department of Computer Science, Sri Ramakrishna College of Arts and Science, Formerly S.N.R SONS College(Autonomous), Coimbatore, Tamilnadu, India
Dr.Maria Priscilla. G
Assistant Professor, Senior Member, IEEE, Head, Department of Computer Science, Sri Ramakrishna College of Arts and Science, Formerly S.N.R SONcollege(Autonomous), Coimbatore, Tamil Nadu, India

Artificial Neural Network (ANN), Hybrid Neural Network (HNN), convolutional neural network (CNN)

  1. Z. Jiang and C. Lu, "A latent semantic analysis based method of gettingthe category attribute of words," Proceedings - 2009 International Conference on Electronic Computer Technology, ICECT 2009, pp. 141–146, 2009.
  2. I. Hendrickx and V. Hoste, "Coreference resolution on blogs andcommented news," Lecture Notes in Computer Science (includingsubseries Lecture Notes in Artificial Intelligence and Lecture Notes inBioinformatics), vol. 5847 LNAI, pp. 43–53, 2009.
  3. P. Inrak and S. Sinthupinyo, "Applying latent semantic analysis to classifyemotions in Thai text," in ICCET 2010 - 2010 International Conferenceon Computer Engineering and Technology, Proceedings, 2010, vol. 6, no.1, pp. 450–454.
  4. Kaplan, A. M., &Haenlein, M. (2011). The early bird catches the news: Nine things 668you should know about micro-blogging. Business Horizons, 54, 105–113.
  5. Pak, A., &Paroubek, P. (2010). Twitter as a corpus for sentiment analysis and 684opinion mining. In Proceedings of LREC Vol. 2010.
  6. Zhang, C., Zeng, D., Li, J., Wang, F.-Y., &Zuo, W. (2009). Sentiment analysis of chinese 710documents: From sentence to document level. Journal of the American Society for 711Information Science and Technology, 60, 2474–2487.
  7. Mihalcea, R., & Liu, H. (2006). A corpus-based approach to finding happiness. In 681Proceedings of the AAAI spring symposium on computational approaches to 682Weblogs (p. 19).
  8. F. Siraj, N. Yusoff and L. C. Kee, "Emotion classification using neural network," 2006 International Conference on Computing & Informatics, Kuala Lumpur, 2006, pp. 1-7.
  9. C. K. Lee, S. K. Yoo, YoonJ Park, NamHyun Kim, KeeSam Jeong and ByungChae Lee, "Using Neural Network to Recognize Human Emotions from Heart Rate Variability and Skin Resistance," 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Shanghai, 2005, pp. 5523-5525.
  10. Liu, Yisi, and Olga Sourina. "EEG-based subject-dependent emotion recognition algorithm using fractal dimension." Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on. IEEE, (2014).
  11. M. Iqbal Quraishi, J. Pal Choudhury and M. De, "Image recognition and processing using Artificial Neural Network," 2012 1st International Conference on Recent Advances in Information Technology (RAIT), Dhanbad, 2012, pp. 95-100.
  12. A. Stuhlsatz, C. Meyer, F. Eyben, T. Zielke, G. Meier and B. Schuller, "Deep neural networks for acoustic emotion recognition: Raising the benchmarks," 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Prague, 2011, pp. 5688-5691.
  13. Janssen, D., Schollhorn, W. I., Lubienetzki, J., Folling, K., Kokenge, H., & Davids, K. (2008). Recognition of emotions in gait patterns by means of artificial neural nets. Journal of Nonverbal Behavior, 32(2), 79-92.
  14. Dony, R. D., & Haykin, S. (1995). Neural network approaches to image compression. Proceedings of the IEEE, 83(2), 288-303.
  15. K. A. Olkiewicz and U. Markowska-Kaczmar, "Emotion-based image retrieval—An artificial neural network approach," Proceedings of the International Multiconference on Computer Science and Information Technology, Wisla, 2010, pp. 89-96.
  16. Iranmanesh, S., & Mahdavi, M. A. (2009). A differential adaptive learning rate method for back-propagation neural networks. World Academy of Science, Engineering and Technology, 50(1), 285-288.
  17. Tesauro, G. (1992). Practical issues in temporal difference learning. In Advances in neural information processing systems (pp. 259-266).
  18. Mesnil, G., Dauphin, Y., Glorot, X., Rifai, S., Bengio, Y., Goodfellow, I., . & Vincent, P. (2011, July). Unsupervised and transfer learning challenge: a deep learning approach. In Proceedings of the 2011 International Conference on Unsupervised and Transfer Learning workshop-Volume 27(pp. 97-111). JMLR. org.
  19. Sun, Y., Wang, X., & Tang, X. (2014). Deep learning face representation from predicting 10,000 classes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 1891-1898).
  20. Shin, H. C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., . & Summers, R. M. (2016). Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE transactions on medical imaging, 35(5), 1285-1298.
  21. Fan, H., Cao, Z., Jiang, Y., Yin, Q., & Doudou, C. (2014). Learning deep face representation. arXiv preprint arXiv:1403.2802.
  22. Buciu, I. (2004, September). A new sparse image representation algorithm applied to facial expression recognition. In Machine Learning for Signal Processing, 2004. Proceedings of the 2004 14th IEEE Signal Processing Society Workshop (pp. 539-548). IEEE.
  23. Levi, G., & Hassner, T. (2015, November). Emotion recognition in the wild via convolutional neural networks and mapped binary patterns. In Proceedings of the 2015 ACM on international conference on multimodal interaction (pp. 503-510). ACM.
  24. M. Abdolali and M. Rahmati, "Facial expression recognition using sparse coding," 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP), Zanjan, 2013, pp. 150-153.
  25. M. S. Shakeel and Kin-Man-Lam, "Recognition of low-resolution face images using sparse coding of local features," 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA), Jeju, 2016, pp. 1-5.
  26. J. Wright, A. Y. Yang, A. Ganesh, S. S. Sastry and Y. Ma, "Robust Face Recognition via Sparse Representation," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210-227, Feb. 2009.
  27. Zhang, S., Zhao, X. I. A. O. M. I. N. G., & Lei, B. (2012). Facial expression recognition using sparse representation. WSEAS transactions on systems, 11(8), 440-452.
  28. El-Sayed, R. S., El Kholy, A., & El-Nahas, M. Y. (2013). Robust facial expression recognition via sparse representation and multiple gabor filters. International Journal of Advanced Computer Science and Applications, 4(3).
  29. Mi, J. X., & Liu, J. X. (2013). Face recognition using sparse representation-based classification on k-nearest subspace. PloS one, 8(3), e59430.
  30. Zheng, S., Song, Y., Leung, T., & Goodfellow, I. (2016). Improving the robustness of deep neural networks via stability training. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 4480-4488).
  31. M. B. Hossain, S. Islam, N. e. H. Zhumur, N. N. Khanam, M. I. Khan and M. A. Kabir, "Hybrid neural network for efficient training," 2017 International Conference on Electrical, Computer and Communication Engineering (ECCE), Cox's Bazar, 2017, pp. 528-532.
  32. Chen, C. B., & Li, T. (2005). A hybrid neural network system for prediction and recognition of promoter regions in human genome. Journal of Zhejiang University. Science. B, 6(5), 401.
  33. X. Li, Y. Rao, H. Xie, R. Y. K. Lau, J. Yin and F. L. Wang, "Bootstrapping Social Emotion Classification with Semantically Rich Hybrid Neural Networks," in IEEE Transactions on Affective Computing, vol. 8, no. 4, pp. 428-442, Oct.-Dec. 1 2017.
  34. Ko, B. C. (2018). A Brief Review of Facial Emotion Recognition Based on Visual Information. sensors, 18(2), 401.
  35. arloStrapparava and RadaMihalcea. Semeval-2007 task 14: Affective text. In Proceedings of the 4th International Workshop on Semantic Evaluations, pages 70–74. Association for Computational Linguistics, 2007.

Publication Details

Published in : Volume 3 | Issue 3 | March-April 2018
Date of Publication : 2018-04-30
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 1737-1750
Manuscript Number : CSEIT1833684
Publisher : Technoscience Academy

ISSN : 2456-3307

Cite This Article :

Selvapriya M , Dr.Maria Priscilla. G, "A Review of Classification Methods for Social Emotion Analysis", International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 3, Issue 3, pp.1737-1750, March-April-2018. |          | BibTeX | RIS | CSV

Article Preview