Egocentric Activity Recognition using Histogram Oriented Features and Textural Features

Authors

  • K. P. Sanal Kumar  Asst. Professor/Programmer, Dept. of ECE, Annamalai University, Tamilnadu, India.
  • R. Bhavani  Professor, Department. of CSE, Annamalai University, Tamilnadu, India

Keywords:

Egocentric: Histogram Oriented; Textural; Principal Component Analysis; Life Logging Activity

Abstract

Recognizing egocentric actions is a challenging task that has to be addressed in recent years. The recognition of first person activities helps in assisting elderly people, disabled patients and so on. Here, life logging activity videos are taken as input. There are 2 categories, first one is the top level and second one is second level. In this paper, the recognition is done using histogram oriented features like Histogram of Oriented Gradients (HOG), Histogram of optical Flow (HOF) and Motion Boundary Histogram (MBH) and textural features like Gray Level co-occurrence Matrix (GLCM) and Local Binary Pattern (LBP). The features like Histogram of Oriented Gradients (HOG), Histogram of optical Flow (HOF) and Motion Boundary Histogram (MBH) are combined together to form a feature (Combined HHM). The extracted features are fed as input to Principal component Analysis (PCA) which reduces the feature dimensionality. The reduced features are given as input to the classifiers like Support Vector Machine (SVM), k Nearest Neighbor (kNN) and Probabilistic Neural Network (PNN). The performance results showed that SVM gave better results than kNN and PNN classifier for both categories.

References

  1. Kenji Matsuo, Kentaro Yamada, Satoshi Ueno, Sei Naito, “An Attention-based Activity Recognition for Egocentric Video”, IEEE Conference on Computer Vision and Pattern Recognition, 2014.
  2. H. Pirsiavash and D. Ramanan, “Detecting activities of daily living in first-person camera views”, IEEE Conference on Computer Vision and Pattern Recognition, 2012.
  3. Sanal Kumar, K.P.  Bhavani, R. and M. Rajaguru, Egocentric Activity Recognition Using Bag of Visual Words, International Journal of Control Theory and Applications, Vol.9, Issue 3, pp. 235-241, 2016.
  4. M. Cerf, J. Harel, W. Einhauser, and C. Koch. Predicting human gaze using low-level saliency combined with face detection. Advances in Neural Information Processing Systems (NIPS), Vol. 20, pp. 241-248,2007.
  5. L. Itti, N. Dhavale, F. Pighin, et al. Realistic avatar eye and head animation using a neurobiological model of visual attention. In SPIE 48th Annual International Symposium on Optical Science and Technology, Vol. 5200, pp. 64-78, 2003.
  6. J. Harel, C. Koch, and P. Perona. Graph-based visual saliency. Advances in Neural Information Processing Systems (NIPS), Vol. 19, pp. 545-552, 2006.
  7. C. Koch and S. Ullman. Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology, Vol. 4, No. 4, pp. 219-227, 1985.
  8. L. Itti, C. Koch, and E. Neibur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), Vol. 20, No. 11, pp. 1254-1259, 1998.
  9. T. Avraham and M. Lindenbaum. Esaliency (extended saliency); Meaningful attention using stochastic image modeling. IEEE Transactions on Pattern Analysis and Machine intelligence (PAMI), Vol. 32, No. 4, pp. 693-708, 2010.
  10. L. F. Coasta. Visual saliency and attention as random walks on complex networks. ArXiv Physics e-prints, 2006.
  11. W. Wang, Y. Wang, Q. Huang, and W. Gao. Measuring visual saliency by site entropy rate. In Computer Vision and Pattern Recognition (CVPR), pp. 2368-2375, IEEE, 2010.
  12. T. Foulsham and G. Underwood. What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. Journal of Vision, Vol. 8, No. 2;6, pp. 1-17, 2008.
  13. M. Cheng, G. Zhang, N. Mitra, X. Huang, and S. Hu. Global contrast based salient region detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
  14. K. Yamada, Y. Sugano, T. Okabe, Y. Sato, A. Sugimoto, and K. Hiraki. “Attention prediction in egocentric video using motion and visual saliency,” in Proc. 5th Pacific-Rim Symposium on Image and Video Technology (PSIVT) 2011, vol.1, pp. 277–288, 2011.
  15. R. Messing, C. Pal, and H. Kautz, “Activity recognition using the velocity histories of tracked key points,” in IEEE International Conference on Computer Vision, 2009.
  16. J. Lei, X. Ren, and D. Fox, “Fine-grained kitchen activity recognition using RGB-D,” in ACM International Joint Conference on Pervasive and Ubiquitous Computing, 2012.
  17. M. Rohrbach, S. Amin, M. Andriluka, and B. Schiele, “A database for fine grained activity detection of cooking activities,” in IEEE Conference on Computer Vision and Pattern Recognition, 2012.
  18. H. Pirsiavash and D. Ramanan, “Detecting activities of daily living in first-person camera views,” in IEEE Conference on Computer Vision and Pattern Recognition, 2012.
  19. K. Ogaki, K. M. Kitani, Y. Sugano, and Y. Sato, “Coupling eye-motion and ego-motion features for first-person activity recognition,” in CVPR Workshop on Egocentric Vision, 2012.
  20. E. Taralova, F. De la Torre, and M. Hebert, “Source constrained clustering,” in IEEE International Conference on Computer Vision, 2011.
  21. A. Fathi, Y. Li, and J. M. Rehg, “Learning to recognize daily actions using gaze,” in European Conference on Computer Vision, 2012.
  22. A.Fathi, A. Farhadi, and J. M. Rehg, “Understanding egocentric activities,” in IEEE International Conference on Computer Vision, 2011.
  23. M. S. Ryoo and L. Matthies, “First-person activity recognition: What are they doing to me?” in IEEE Conference on Computer Vision and Pattern Recognition, 2013.
  24. Y. Poleg, C. Arora, and S. Peleg, “Temporal segmentation of egocentric videos,” in IEEE Conference on Computer Vision and Pattern Recognition, 2014.
  25. P. Mohanaiah, P. Sathyanarayana,L. GuruKumar, “Image Texture Feature Extraction Using GLCM Approach”, vol.3, no.5, May 2013.
  26. Zhihua Xia, Chengsheng Yuan, Xingming Sun, Decai Sun, RuiLv, “ Combining Wavelet Transform and LBP Related Features for Fingerprint Liveness Detection” , IAENG International Journal of Computer Science, vol.43, no.3, August 2016.
  27. Kishor B. Bhangale and R. U. Shekokar, “Human Body Detection in static Images Using HOG & Piecewise Linear SVM”, International Journal of Innovative Research & Development, vol.3 no.6, (2014).
  28. Sanal Kumar, K.P. and Bhavani, R., Egocentric Activity Recognition Using HOG, HOF and MBH Features, International Journal on Recent and Innovation Trends in Computing and Communication, vol. 5 no. 7, pp.236 – 240.
  29. Sri Devi Thota, Kanaka Sunanda Vemulapalli ,Kartheek Chintalapati, Phanindra Sai Srinivas Gudipudi, “Comparison Between The Optical Flow Computational Techniques”, International Journal of Engineering Trends and Technology, vol 4. no.10, 2013.
  30. N. Dalal, B. Triggs, and C. Schmid, “Human detection using oriented histograms of flow and appearance,” in European Conference on Computer Vision, 2006.
  31. Sanal Kumar, K.P. and Bhavani, R., Egocentric Activity Recognition Using HOG, HOF, MBH and Combined features, International Journal on Future Revolution in Computer Science & Communication Engineering, vol. 3 no. 8, pp. 74 – 79.
  32. N. Ikizler-Cinbis and S. Sclaroff, “Object, scene and actions: combining multiple features for human action recognition,” in European Conference on Computer Vision, 2010.
  33. H. Uemura, S. Ishikawa, and K. Mikolajczyk, “Feature tracking and motion compensation for action recognition,” in British Machine Vision Conference, 2008.
  34. Sanal Kumar K.P. and Bhavani R, “Activity Recognition in Egocentric video using SVM, kNN and Combined SVMkNN Classifiers”, IOP Conf. Series: Materials Science and Engineering 225, 012226, 2017.
  35. AlirezaSarveniazi, “An Actual Survey of Dimensionality Reduction” American Journal of Computational Mathematics, vol.4, pp.55-72, 2014.
  36. S.Anu H Nair, P.Aruna, “Image Fusion Techniques For Iris And Palm print Biometric System”, Journal of Theoretical and Applied Information Technology, vol. 61, no.3, pp.476-485, 2014.
  37. ArunGarg, Richika, “A Novel Approach for Brain Tumor Detection Using Support Vector Machine, K-Means and PCA Algorithm”, International Journal of Computer Science and Mobile Computing, vol.4, no.8, pp. 457-474, 2015.
  38. M.Suresha, N.A. Shilpa and B.Soumya, “Apples Grading based on SVM Classifier”, in National Conference on Advanced Computing and Communications, 2012.
  39. OpenCV-Introduction to Support Vector Machines. http://docs.opencv.org/2.4/doc/tutorials/ml/introduction_ to_svm/introduction_to_svm.html Accessed: 2016-07-22.
  40. Wanpracha Art Chaovalitwongse, Ya-Ju Fan, Rajesh C. Sachdeo, “On the Time Series K-Nearest Neighbor Classification of Abnormal Brain Activity”, IEEE Transactions on Systems, Man, and Cybernetics – Part A: Systems and Humans, vol.37, no.6 , 2007.
  41. Sanal Kumar, K.P. and Bhavani, R., “Human activity recognition in egocentric video using PNN, SVM, kNN and SVM+kNN classifiers”, Cluster Computing, 2017.
  42. Sanal Kumar K.P. and Bhavani R, “Analysis of SVM and kNN Classifiers for Egocentric Activity Recognition”, Proceedings of the International Conference on Informatics and Analytics (Pondicherry, India: ACM) August 25-26, 2016.

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2017-12-31

Issue

Volume 2, Issue 6, November-December-2017

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
K. P. Sanal Kumar, R. Bhavani, " Egocentric Activity Recognition using Histogram Oriented Features and Textural Features, IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 2, Issue 6, pp.397-405, November-December-2017.