Emotion Recognition Based Personal Entertainment Robot Using ML & IP

Authors

  • Shivani Chougule  Department Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon, Pune, Maharashtra, India
  • Shubham Bhosale  Department Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon, Pune, Maharashtra, India
  • Vrushali Borle  Department Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon, Pune, Maharashtra, India
  • Vaishnavi Chaugule  Department Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon, Pune, Maharashtra, India
  • Prof. Yogesh Mali  Department Computer Engineering, Dr. D. Y. Patil School of Engineering, Lohegaon, Pune, Maharashtra, India

Keywords:

Smart Emotion, Espeak and Pyttsx, and Face API

Abstract

This project presents a method to automatically detect emotional duality and mixed emotional experience using Linux based system. Co-ordinates, distance, and movement of tracked points were used to create features from visual input that captured facial expressions, head, face gestures, and face movement. Spectral features, prosodic features were extracted using the camera. Espeak and Pyttsx and Face API were used for calculations of features. A combined feature vector was created by feature level fusion and a cascade classifier was used for emotion detection. Live participants and actions are to be used for recording simultaneous mixed emotional experiences. As per the calculated result system will play songs and display the books list.

References

  1. A. S. Patwardhan, “Augmenting Supervised Emotion Recognition with Rule-Based Decision Model”, arXiv, 2016.
  2. A. S. Patwardhan and G. M. Knapp, “Affect Intensity Estimation Using Multiple Modalities,” Florida Artificial Intelligence Research Society Conference, May. 2014.
  3. A. S. Patwardhan and G. M. Knapp, “Multimodal Affect Analysis for Product Feedback Assessment,” IIE Annual Conference. Proceedings. Institute of Industrial Engineers-Publisher, 2013.
  4. SE. Kahou, C. Pal, X. Bouthillier, P. Froumenty, C. Glehre,R. Memisevic, P. Vincent, A. Courville, Y. Bengio, RC. Ferrari and M. Mirza. Combining modality-specific deep neural networks for emotion recognition in video. Proceedings of the 15th ACM on International conference on multimodal interaction, 2013.
  5. F. D. Schönbrodt and J. B. Asendorpf, " The Challenge of Constructing Psychologically Believable Agents," J. Media Psychology, vol. 23, pp. 100-107, Apr. 2011.
  6. N. C. Krämer, I. A. Gurgel, and G. Bente, " Emotion and motivation in embodied conversational agents," presented at the AISB'05 Conv., Symp. on Agents that Want and Like: Motivational and Emotional Roots of Cognition and Action, Hatfield, UK, 2005.

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2021-06-30

Issue

Volume 8, Issue 3, May-June-2021

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Shivani Chougule, Shubham Bhosale, Vrushali Borle, Vaishnavi Chaugule, Prof. Yogesh Mali, " Emotion Recognition Based Personal Entertainment Robot Using ML & IP" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 8, Issue 3, pp.299-303, May-June-2021.