Enhanced EEG-Based Emotion Detection Technique using Deep Belief Network and Wavelet Transform

Authors(2) :-Sahar Jodat, Khosrow Amirizadeh

Today's, the role of emotion in communication , brain-computer interface, brain diseases and mental states, car driver monitoring and recommendation systems is proven. Therefore, automatic emotions detection has become one of the most challenging issue. Until now, numerous studies have been addressed different technique on improving automatic emotion detection.In this study, to achieve bether validation in classification of emotion by EEG signals, we combined wavelet transform with deep belief network. For, non-stationary and time-varying are the most important properties of EEG signals, we decided to use discrete wavelet transform (sym8) for extracting features such as power, then applied deep belief network as a classifier to classify emotions according to two-dimensional arousal-valence model. To examine the effectiveness of the method, we used DEAP database and mapped different emotions on two different classes of valence and arousal. Final results show an acceptable enhancement with the accuracy of 75.52% and 81.03% for valence and arousal, respectively.

Authors and Affiliations

Sahar Jodat

Khosrow Amirizadeh

EEG signals, Discrete Wavelet Transform, Deep Belief Network, two-dimensional arousal-valence model, DEAP

  1. Russell, James (1980). "A circumplex model of affect". Journal of Personality and Social Psychology. 39: 1161–1178.
  2. V. Petrushin, Emotion in speech: recognition and application to call centers, in: Proceedings of the Artificial Networks in Engineering Conference, 1999, pp. 7–10.
  3. M. Black, Y. Yacoob, Recognizing facial expressions in image sequences using local parameterized models of image motion, Int. J. Comput. Vis. 25 (1997) 23–48.
  4. K. Anderson, P. McOwan, A real-time automated system for the recognition of human facial expressions, IEEE Trans. Syst. Man Cybern. B Cybern. 36 (2006) 96–105.
  5. J. Wagner, J. Kim, From physiological signals to emotions: Implementing and comparing selected methods for feature extraction and classification, in: Proceedings of IEEE International Conference on Multimedia and Expo, 2005, pp. 940–943.
  6. K. Kim, S. Bang, S. Kim, Emotion recognition system using short-term monitoring of physiological signals, Med. Biol. Eng. Comput. 42 (2004) 419–427.
  7. J. Brosschot, J. Thayer, Heart rate response is longer after negative emotions than after positive emotions, Int. J. Psychophysiol. 50 (2003) 181–187.
  8. J.Coan,J.Allen,Frontal EEG asymmetry as a moderatoran dmediator of emotion, Biol.Psychol.67(2004)7–50.
  9. P.Petrantonakis, L.Hadjileontiadis, A novel emotion elicitation indexusing frontal brain asymmetry for enhanced EEG-based emotion recognition, IEEE Trans. Inf.Technol. Biomed.15(2011)737–746.
  10. X.Li,B.Hu,T.Zhu,J.Yan,F.Zheng,Towards affective learning with an EEG feedback approach, in: Proceedings of the 1st ACM International Workshopon Multimedia Technologies for Distance Learning, 2009,pp.33–38.
  11. Klem, G. H., Lüders, H. O., Jasper, H. H., & Elger, C. (1999). The ten-twenty electrode system of the International Federation. Electroencephalogr Clin Neurophysiol, 52(3), 3-6.
  12. B. Weiner, Attribution, emotion, and action, Handbook of Motivation and Cognition: Foundations of Social Behavior 1 (1986) 281–312.
  13. T. Kemper, A Social Interactional Theory of Emotions, Wiley, New York, 1978z
  14. R.Davidson,G.Schwartz,C.Saron,J.Bennett,D.Goleman,Frontalversus parietalEEGasymmetryduringpositiveandnegativeaffect,Psychophysiology 16(1979)202–203
  15. P.Ekman,R.Davidson,TheNatureofEmotion:FundamentalQuestions,Oxford UniversityPress,1994
  16. http://www.eecs.qmul.ac.uk/mmv/datasets/deap/
  17. Koelstra, S., Muhl, C., Soleymani, M., Lee, J. S., Yazdani, A., Ebrahimi, T., ... & Patras, I. (2012). Deap: A database for emotion analysis; using physiological signals. IEEE Transactions on Affective Computing, 3(1), 18-31.
  18. Liu, Y., & Sourina, O. (2013). Real-time fractal-based valence level recognition from EEG. In Transactions on Computational Science XVIII (pp. 101-120). Springer, Berlin, Heidelberg.
  19. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, "Greedy layer-wise training of deep networks," Advances in neural information processing systems, vol. 19, pp. 153, 2007.
  20. P. Smolensky, "Information processing in dynamical systems: Foundations of harmony theory," Parallel distributed processing: explorations in the microstructure of cognition, Cambridge, MA, USA: MIT Press, 1986, pp. 194-281.
  21. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, pp. 504-507, 2006.
  22. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural computation, vol. 14, pp. 1771-1800, 2002.
  23. divergence," N Keyvanrad, M. A., & Homayounpour, M. M. (2014). A brief survey on deep belief networks and introducing a new object oriented toolbox (DeeBNet). arXiv preprint arXiv:1408.3264.
  24. Lopes, N., & Ribeiro, B. (2015). Deep Belief Networks (DBNs). In Machine Learning for Adaptive Many-Core Machines-A Practical eural computation, vol. 14, pp. 1771-1800, 2002.
  25. Koelstra, S., Muhl, C., Soleymani, M., Lee, J. S., Yazdani, A., Ebrahimi, T., ... & Patras, I. (2012). Deap: A database for emotion analysis; using physiological signals. IEEE Transactions on Affective Computing, 3(1), 18-31.
  26. Bradley, M. M., & Lang, P. J. (1994). Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry, 25(1), 49-59.
  27. Kshirsagar, P., & Akojwar, S. (2016). Classification of Human Emotions using EEG Signals. International Journal of Computer Science, Volume146, (7).
  28. Petrantonakis, P. C., & Hadjileontiadis, L. J. (2011). A novel emotion elicitation index using frontal brain asymmetry for enhanced EEG-based emotion recognition. IEEE Transactions on information technology in biomedicine, 15(5), 737-746.
  29. Parameswariah, C., & Cox, M. (2002). Frequency characteristics of wavelets. IEEE Transactions on Power Delivery, 17(3), 800-804.
  30. Hinton, G. (2010). A practical guide to training restricted Boltzmann machines. Momentum, 9(1), 926.
  31. Hatamikia, S., Maghooli, K., & Nasrabadi, A. M. (2014). The emotion recognition system based on autoregressive model and sequential forward feature selection of electroencephalogram signals. Journal of medical signals and sensors, 4(3), 194.
  32. Hosseini M, Pouyan A, Ferdosi S,Mashayekhi H,(2016),”Emotion Recognition of EEG data using Deep Belief Network and Empirical Mode Decomposition”,submitted on journal of computational of Neuroscience
  33. Yoon, H. J., & Chung, S. Y. (2013). EEG-based emotion estimation using Bayesian weighted-log-posterior function and perceptron convergence algorithm. Computers in biology and medicine, 43(12), 2230-2237.

Publication Details

Published in : Volume 2 | Issue 7 | September 2017
Date of Publication : 2017-09-30
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 56-67
Manuscript Number : CSEIT174408
Publisher : Technoscience Academy

ISSN : 2456-3307

Cite This Article :

Sahar Jodat, Khosrow Amirizadeh, "Enhanced EEG-Based Emotion Detection Technique using Deep Belief Network and Wavelet Transform", International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 2, Issue 7, pp.56-67, September-2017. |          | BibTeX | RIS | CSV

Article Preview