Identifying Eye Fixation to Control the Mouse Operations Using Artificial Neural Network

Authors

  • K. N. Priyanka  PG Scholar, Computer Science and Engineering, Faculty of Engineering, Avinashilingam Institute for Home Science and Higher Education for Women, Coimbatore, Tamil Nadu, India
  • Dr. P. Amudha  Associate Professor, Head of the Department Computer Science and Engineering, Faculty of Engineering, Avinashilingam Institute for Home Science and Higher Education for Women, Coimbatore, Tamil Nadu, India

Keywords:

Image Processing, Iris Movement, Supervised learning, Eye detection, Machine learning, Artificial Neural Network

Abstract

Disability is the consequence of an impairment that may be physical, cognitive, mental, sensory, emotional, developmental, or some combination of these. The disability management is a critical task since it is caused by employing a digital system to assist the physically disabled people. This process is completed by applying a digital signal processing system which takes the analog input from the disabled people by using dedicated hardware with software, and then the raw data is converted it into informative data in the form of digital signal. The Iris tracking is the process of measuring either the point of gaze (where one is looking) or the motion of the eye relative to the head. Face and eye detection algorithm is used to identify and recognize the user input using web camera. The predefined pattern matching is initialized for detecting a face from the USB camera feed. Pattern matching algorithm is used to compute the pattern related to the mouse movement.Supervised learning with back propagation is used to identify the input type and click operation on the particular action event. When the position of the user is sufficiently constant, the system for detecting and analyzing blinks and mouse movements is initialized automatically, depending on the involuntary blink of the user. This approach is efficient for disabled people.

References

  1. Srinivas S S Kruthiventi, Kumar Ayush, and R. Venkatesh Babu "DeepFix: A Fully Convolutional Neural Network for predicting Human Eye Fixations" DOI 10.1109/TIP.2017.2710620, 2017
  2. J. Pan, K. McGuinness, E. Sayrol, N. O'Connor, and X. Giro-i Nieto, "Shallow and deep convolutional networks for saliency prediction," arXiv preprint arXiv:1603.00845, 2016
  3. C. Sheth and R. Venkatesh Babu, "Object saliency using a background prior," in IEEE International Conference on Acoustics, Speech and Signal Processing, 2016.
  4. S. S. Kruthiventi, V. Gudisa, J. H. Dholakiya, and R. Venkatesh Babu, "Saliency unified: A deep architecture for simultaneous eye fixation prediction and salient object segmentation," in IEEE Conference on Computer Vision and Pattern Recognition, 2016.
  5. H.HadizadehandI.V.Bajic,"Saliency-awarevideocompression,"IEEE Transactions on Image Processing, vol. 23, no. 1, pp. 19–33, 2014.
  6. A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems, 2012.
  7. L. Bottou, "Large-scale machine learning with stochastic gradient descent," in Proceedings of COMPSTAT'2010, 2010, pp. 177–186.
  8. O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. C. Berg, and L. Fei-Fei, "ImageNet Large Scale Visual Recognition Challenge," International Journal of Computer Vision, pp. 1–42, April 2015.
  9. B. Zhou, A. Lapedriza, J. Xiao, A. Torralba, and A. Oliva, "Learning deep features for scene recognition using places database," in Advances in Neural Information Processing Systems, 2014.
  10. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition," arXiv preprint arXiv:1409.1556, 2014.
  11. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich, "Going deeper with convolutions," arXiv preprint arXiv:1409.4842, 2014.
  12. J. Long, E. Shelhamer, and T. Darrell, "Fully convolutional networks for semantic segmentation," in IEEE Conference on Computer Vision and Pattern Recognition, 2015.
  13. T. Judd, F. Durand, and A. Torralba, "A benchmark of computational models of saliency to predict human fixations," in MIT Technical Report, 2012.
  14. A. Borji and L. Itti, "Cat2000: A large scale fixation dataset for boosting saliency research," CVPR workshop on "Future of Datasets", 2015, arXiv preprint arXiv:1505.03581.
  15. S. Hossein Khatoonabadi, N. Vasconcelos, I. V. Bajic, and Y. Shan, "How many bits does it take for a stimulus to be salient?" in IEEE Conference on Computer Vision and Pattern Recognition, 2015.
  16. M. Kummerer, L. Theis, and M. Bethge, "Deep gaze i: Boosting saliency prediction with feature maps trained on imagenet," arXiv preprint arXiv:1411.1045, 2014.
  17. C. Shen and Q. Zhao, "Learning to predict eye fixations for semantic contents using multi-layer sparse network," Neurocomputing, vol. 138, pp. 61–68, 2014.
  18. E. Vig, M. Dorr, and D. Cox, "Large-scale optimization of hierarchical features for saliency prediction in natural images," in IEEE Conference on Computer Vision and Pattern Recognition, 2014.
  19. N. Liu, J. Han, D. Zhang, S. Wen, and T. Liu, "Predicting eye fixations using convolutional neural networks," in IEEE Conference on Computer Vision and Pattern Recognition, 2015.
  20. A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson, "CNN features off-the-shelf: an astounding baseline for recognition," in Computer Vision and Pattern Recognition Workshops, 2014.
  21. X. Huang, C. Shen, X. Boix, and Q. Zhao, "SALICON: Reducing the semantic gap in saliency prediction by adapting deep neural networks," in IEEE International Conference on Computer Vision, 2015.
  22. R. Zhao, W. Ouyang, H. Li, and X. Wang, "Saliency detection by multicontext deep learning," in IEEE Conference on Computer Vision and Pattern Recognition, 2015.
  23. S. Srivatsa R and R. Venkatesh Babu, "Salient object detection via objectness measure," in IEEE International Conference on Image Processing, 2015.
  24. Deeplearning.net," http://deeplearning.net/tutorial/.
  25. Z. Bylinskii, P. Isola, C. Bainbridge, A. Torralba, and A. Oliva, "Intrinsic and extrinsic effects on image memorability," Vision research, vol. 116, pp. 165–178, 2015.
  26. Ms. Sonali. B. Maind, Ms. Priyanka Wankar," Research Paper on Basic of Artificial Neural Network"International Journal on Recent and Innovation Trends in Computing and Communication ISSN: 2321-8169 Vol: 2 Issue: 1.

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2018-04-30

Issue

Volume 3, Issue 3, March-April-2018

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
K. N. Priyanka, Dr. P. Amudha, " Identifying Eye Fixation to Control the Mouse Operations Using Artificial Neural Network, IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 3, Issue 3, pp.968-977, March-April-2018.