Analysis and Importance of Deep Learning for Video Aesthetic Assessments

Authors

  • Manish Bendale  Department of Computer Engineering, MIT, Pune, Maharashtra, India
  • Madhura V. Phatak  Department of Computer Engineering, MIT, Pune, Maharashtra, India
  • Dr. Nitin N. Pise  Department of Computer Engineering, MIT, Pune, Maharashtra, India

DOI:

https://doi.org//10.32628/CSEIT1951100

Keywords:

Video Aesthetics, Preprocessing Techniques, Feature Extraction, Deep Learning, Applications.

Abstract

Deep Learning is one of the active analysis topic obtaining a great deal of analysis attention recently. This increase in analysis interest is driven by several area as that are being worked on like machine-based reality finding, good over-seeing, sensory activity recognition, online learning, world of advertisement, text analysis and so on. Videos have specific characteristics that make their method unique. Visual aesthetic typically: Remember what they see, understand and learn rather than what they hear. This paper principally emphasizes deep learning on basics of automatic video aesthetic assessments.

References

  1. Dhiraj Joshi, Ritendra Datta, Elena Fedorovskaya, Quang-Tuan Luong, James Z. Wang, Jia Li, and Jiebo Luo, “Aesthetics and Emotions in Images”, IEEE Signal Processing Magazine, Volume: 28, Issue: 5, Sept. 2011
  2. Xin Lu, Zhe Lin, Hailin Jin, Jianchao Yang, and James. Z. Wang, “Rating Image Aesthetics using Deep Learning ”, IEEE Transactions on Multimedia, Volume: 17, Issue: 11, Nov. 2015 
  3. Yubin Deng, Chen Change Loy, and Xiaoou Tang, “Image Aesthetic Assessment”, IEEE Signal Processing Magazine, Digital Object Identifier 10.1109/MSP.2017.2696576, 11 July 2017.
  4. Yubin Deng, Chen Change Loy, and Xiaoou Tang, “Image Aesthetic Assessment: An Experimental Survey”, arXiv:1610.00838v2 [cs.CV] 20 Apr 2017.
  5. Ritendra Datta Dhiraj Joshi Jia Li James Z. Wang, “Studying Aesthetics in Photographic Images Using a Computational Approach”, Computer Science, vol 3953. Springer, Berlin, Heidelberg, ECCV 2006
  6. Chongke Bi ,Ye Yuan, Ronghui Zhang , Yiqing Xiang,Yuehuan Wang, and Jiawan Zhang, “A Dynamic Mode Decomposition Based Edge Detection Method for Art Images”, IEEE Photonics Journal ( Volume: 9, Issue: 6, Dec. 2017
  7. Roberto Gallea, Edoardo Ardizzone, and Roberto Pirrone, “Automatic Aesthetic Photo Composition”, Image Analysis and Processing – ICIAP 2013: 17th International Conference, Naples, Italy, September 9, 2013.
  8. Stephen Groening, “Introduction: The Aesthetics of Online Videos”, The Aesthetics of Online Videos, June 2016, DOI: http://dx.doi.org/10.3998/fc.13761232.0040.201
  9. christos tzelepis, eftichia mavridaki, vasileios mezaris, ioannis patras, “Video aesthetic quality assessment using kernel support vector machine with isotropic gaussian sample uncertainty (ksvm-igsu)”, IEEE Int. Conf. On Image Processing (Icip 2016), Phoenix, Az, Usa.
  10. Jun-Ho Choi, Jong-Seok Lee, “Automated Video Editing for Aesthetic Quality Improvement”, 23rd ACM international conference on Multimedia, Brisbane, Australia — October 26 - 30, 2015 
  11. Anselm Brachmann, Christoph Redies, “Computational and Experimental Approaches to Visual Aesthetics”, Front. Comput. Neurosci., 14 November 2017 | https://doi.org/10.3389/fncom.2017.00102.
  12. Aarushi Gaur, “Ranking Images Based on Aesthetic Qualities”, Submitted for the Degree of Doctor of Philosophy from the University of Surrey, April 2015.
  13. Loris Nanni, Stefano Ghidoni, Sheryl Brahna, “Handcrafted vs. non-handcrafted features for computer vision classification”, Elsevier Journal on Pattern Recognition 71 (2017) 158–172, 2017.
  14. Hsin-Ho Yeh, Chun-Yu Yang, Ming-Sui Lee, and Chu-Song Chen, “Video Aesthetic Quality Assessment by Temporal Integration of Photo- and Motion-Based Features”, IEEE Transactions on Multimedia, Vol. 15, No. 8, December 2013.
  15. Katharina Schwarz, Patrick Wieschollek, Hendrik P. A. Lensch, “Will People Like Your Image? Learning the Aesthetic Space”, arXiv:1611.05203v2 [cs.CV] 4 Dec 2017
  16. Yanran Wang, Qi Dai, Rui Feng, Yu-Gang Jiang, “Beauty is Here: Evaluating Aesthetics in Videos Using Multimodal Features and Free Training Data”, ACM international conference on Multimedia, Pages 369-372, Barcelona, Spain — October 21 - 25, 2013
  17. Yuzhen Niu, Feng Liu, “What Makes a Professional Video? A Computational Aesthetics Approach”, IEEE Transactions on Circuits and Systems for Video Technology, Volume: 22, Issue: 7, July 2012
  18. Subhabrata Bhattacharya, Behnaz Nojavanasghari, Tao Chen, “Towards a Comprehensive Computational Model for Aesthetic Assessment of Videos”, ACM 978-1-4503-2404-5, 2013, Barcelona, Spain, http://dx.doi.org/10.1145/2502081.2508119.
  19. Chun-Yu Yang, Hsin-Ho Yeh, and Chu-Song Chen, “Video Aesthetic Quality Assessment By Combining Semantically Independent And Dependent Features”, Acoustics, Speech and Signal Processing (ICASSP), IEEE International Conference, 2011, Prague, Czech Republic.
  20. Yanxiang Chen, Yuxing Hu, Luming Zhang, Ping Li, Chao Zhang, “Engineering Deep Representations for Modeling Aesthetic Perception”, IEEE Transactions on Cybernetics, Volume: PP, Issue: 99 , 11 December 2017.
  21. A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Advances in Neural Information Processing Systems (NIPS), pp. 1106–1114, 2012.
  22. D. Ciresan, U. Meier, and J. Schmidhuber, “Multi-column deep neural networks for image classification,” in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3642–3649, 2012.
  23. Y. Sun, X. Wang, and X. Tang, “Hybrid deep learning for face verification,” in The IEEE International Conference on Computer Vision (ICCV), 2013.
  24. Jingwei Xu, Li Song, Rong Xie, "Shot boundary detection using convolutional neural networks", Visual Communications and Image Processing (VCIP) 2016, pp. 1-4, 2016.
  25. Simone Bianco, Luigi Celona, Paolo Napoletano, and Raimondo Schettini, “Predicting Image Aesthetics with Deep Learning” ,Springer International Journal on Advanced Concepts for Intelligent Vision Systems, 21 October 2016, volume: 10016. Springer, Cham.
  26. C. D. Manning and H. Schütze, “Foundations of Natural Language Processing,” Reading, pp. 678, 2000.
  27. P. K. Abhishek Kumar Chauhan, “Moving Object Tracking using Gaussian Mixture Model and Optical Flow,” vol. 3, no. 4, pp. 243–246, 2013.
  28. D. K. Srivastava, L. Bhambhu, and B. Cet, “Data classification using support vector machine,” Journal of Theoretical and Applied Information Technology, 2010.
  29. M. S. and W. P, “Research Paper on Basic of Artificial Neural Network,” International Journal of Recent Innovation Trends Computer Communication, vol. 2, no. 1, pp. 96–100, 2014.
  30. P. Sharma and A. P. R. Bhartiya, “Implementation of Decision Tree Algorithm to Analysis the Performance,” Int. J. Adv. Res. Computer Communication. Eng., vol. 1, no. 10, pp. 861–864, 2012.
  31. F. Park, “The Hierarchical Hidden Markov Model : Analysis and Applications,” vol. 62, pp. 41–62, 1998.
  32. Gartner Hype Cycle:
  33. https://medium.com/machine-learning-in-practice/deep-learnings-permanent-peak-on-gartner-s-hype-cycle-96157a1736e
  34. NadineKrefetz , streaming media https://www.streamingmedia.com/Authors/6837-Nadine-Krefetz.htm

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2019-02-28

Issue

Volume 5, Issue 1, January-February-2019

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Manish Bendale, Madhura V. Phatak, Dr. Nitin N. Pise, " Analysis and Importance of Deep Learning for Video Aesthetic Assessments, IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 5, Issue 1, pp.546-554, January-February-2019. Available at doi : https://doi.org/10.32628/CSEIT1951100