An Efficient Road Surveillance Approach to Detect, Recognize & Tracking Vehicles Using Deep Learning Methods

Authors

  • Vinod Kumar Yadav  PHD (Research Scholar), Computer Science & Engineering Department, RNTU, Bhopal, Madhya Pradesh, India
  • Dr. Pritaj Yadav  Associate Professor, Computer Science and Engineering Department, RNTU, Bhopal, Madhya Pradesh, India
  • Dr. Shailja Sharma  Associate Professor, Computer Science and Engineering Department, RNTU, Bhopal, Madhya Pradesh, India

DOI:

https://doi.org/10.32628/CSEIT2174106

Keywords:

Deep Neural network, CNN, R-FCN, YOLO, YOLOv4, Deep-Sort Tracking.

Abstract

In the current scenario on the increasing number of motor vehicles day by day, so traffic regulation faces many challenges on intelligent road surveillance and governance, this is one of the important research areas in the artificial intelligence or deep learning. Among various technologies, computer vision and machine learning algorithms have the most efficient, as a huge vehicles video or image data on road is available for study. In this paper, we proposed computer vision-based an efficient approach to vehicle detection, recognition and Tracking. We merge with one-stage (YOLOv4) and two-stage (R-FCN) detectors methods to improve vehicle detection accuracy and speed results. Two-stage object detection methods provide high localization and object recognition precision, even as one-stage detectors achieve high inference and test speed. Deep-SORT tracker method applied for detects bounding boxes to estimate trajectories. We analyze the performance of the Mask RCNN benchmark, YOLOv3 and Proposed YOLOv4 + R-FCN on the UA-DETRAC dataset and study with certain parameters like Mean Average Precisions (mAP), Precision recall.

References

  1. Chien-Yao Wang, Hong-Yuan Mark Liao, Yueh-Hua Wu, Ping,Yang Chen, Jun-Wei Hsieh, and I-Hau Yeh., “CSPNet: A new backbone that can enhance learning capability of cnn”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshop, 2020.
  2. Xiang, Y., Fu, Y., Huang, H.,”Global topology constraint network for fine-grained vehicle recognition”, IEEE Transactions on Intelligent Transportation Systems, 2019.
  3. Zhao, Z.Q., Zheng, P., Xu, S.T., Wu, X., “Object detection with deep learning: A review.” arXiv e-prints, arXiv: 1807.05511, 2018.
  4. Redmon, J., & Farhadi, A., “Yolov3: An incremental improvement”, arXiv preprint arXiv: 1804.02767,2018.
  5. Ding Lu, Yong Wang, Robert Laganière, Xinbin Luo, and Shan Fu. "Scale-Aware RPN for Vehicle Detection." In International Symposium on Visual Computing, pp. 487-499. Springer, Cham, 2018.
  6. Shu Liu, Lu Qi, Haifang Qin, Jianping Shi, and Jiaya Jia., “Path aggregation network for instance segmentation”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 8759–8768, 2018.
  7. E. Bochinski, T. Senst, and T. Sikora, "Extending IOU based multi-object tracking by visual information." In 2018 15th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 1-6. IEEE, 2018.
  8. Luo, Z., Branchaud-Charron, F., Lemaire, C., Konrad, J., Li, S., Mishra, A., Achkar, A., Eichel, J., Jodoin, P.M.,” MIOTCD: a new benchmark dataset for vehicle classification and localization”, IEEE Transactions on Image Processing, 27(10), 5129–5141, 2018.
  9. Rachmadi, R.F., Uchimura, K., Koutaki, G., Ogata, K.,” Single image vehicle classification using pseudo long short-term memory classifier”, Journal of Visual Communication and Image Representation, 2018,56, 265–274.
  10. Redmon, J., & Farhadi, A.,” Yolo9000: Better, faster, stronger: IEEE”, 2017.
  11. Sanjay Saini, S. Nikhil, Krishna Reddy Konda, Harish S. Bharadwaj, and N. Ganeshan. "An efficient vision-based traffic light detection and state recognition for autonomous vehicles." In 2017 IEEE Intelligent Vehicles Symposium (IV), pp. 606-611. IEEE, 2017.
  12. Hung Ngoc Phan, Long Hoang Pham, Duong Nguyen-Ngoc Tran, and Synh Viet-Uyen Ha. , "Occlusion vehicle detection algorithm in crowded scene for Traffic Surveillance System." In 2017 International Conference on System Science and Engineering (ICSSE), pp. 215-220. IEEE, 2017.
  13. N. Wojke, A. Bewley, and D. Paulus, “Simple online and realtime tracking with a deep association metric,” in 2017 IEEE international conference on image processing (ICIP). IEEE, 2017, pp. 3645–3649.
  14. Kim, P.K., & Lim, K.T., “Vehicle type classification using bagging and convolutional neural network on multi view surveillance image”. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2017, (pp. 41–46).
  15. Taek Lee, J., & Chung, Y., “Deep learning-based vehicle classification using an ensemble of local expert and global networks. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2017, (pp. 47–52).
  16. Theagarajan, R., Pala, F., Bhanu, B.,“EDen: ensemble of deep networks for vehicle classification”. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, 2017, pp. 33–40.
  17. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., Berg, A.C. “Ssd: Single shot multibox detector, In 2016 European conference on computer vision”,: Springer International Publishing, 2016 ,pp. 21–37.
  18. Redmon, J., Divvala, S., Girshick, R., Farhadi, A., “You only look once: Unified, real-time object detection”, In 2016 IEEE conference on computer vision and pattern recognition, 2016, p.p. 779–788: IEEE.
  19. Tianqi Chen and Carlos Guestrin., "A scalable tree boosting system." In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining, pp. 785-794. ACM, 2016.
  20. A. Bewley, Z. Ge, L. Ott, F. Ramos, and B. Upcroft, "Simple online and realtime tracking." In 2016 IEEE International Conference on Image Processing (ICIP), pp. 3464-3468. IEEE, 2016.
  21. Xuezhi Wen, Ling Shao, Wei Fang, and Yu Xue. "Efficient feature selection and classification for vehicle detection." IEEE Transactions on Circuits and Systems for Video Technology, 25, no. 3, 2015: 508-517.
  22. Synh Viet-Uyen Ha, Long Hoang Pham, Hung Ngoc Phan, and Phong Ho-Thanh., "A robust algorithm for vehicle detection and classification in intelligent traffic system." In 16th Asia Pacific Industrial Engineering & Management Systems Conference (APIEMS 2015), no. 1, pp. 1832-1838. 2015.
  23. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun, “Spatial pyramid pooling in deep convolutional networks for visual recognition”. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 37(9):1904–1916, 2015.
  24. L. Wen, D. Du, Z. Cai, Z. Lei, M.-C. Chang, H. Qi, J. Lim, M.-H. Yang, and S. Lyu, “Ua-detrac: A new benchmark and protocol for multi-object detection and tracking,” arXiv preprint arXiv: 1511.04136, 2015.
  25. Girshick, R., Donahue, J., Darrell, T., Malik, J.” Rich feature hierarchies for accurate object detection and semantic segmentation”, IEEE Conference on Computer Vision and Pattern Recognition, 2014.81: IEEE.
  26. Kaiming, H., Xiangyu, Z., Shaoqing, R., Jian, S. “Spatial pyramid pooling in deep convolutional networks for visual recognition”. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2014, 37(9), 1904–16.
  27. Erhan, D., Szegedy, C., Toshev, A., Anguelov, D., “Scalable object detection using deep neural networks”, In 2014 IEEE conference on computer vision and pattern recognition. https://doi.org/10.1109/cvpr., 2014, pp. 2147–2154, IEEE.
  28. Luo, W., Xing, J., Milan, A., Zhang, X., Liu, W., Zhao, X., Kim, T.K., “Multiple object tracking: A literature review”. arXiv preprint arXiv:1409.7618., 2014.
  29. Uijlings, J.R.R., van de Sande, K.E.A., Gevers, T., Smeulders, A.W.M.”Selective search for object recognition. International Journal of Computer Vision”, 2013, 104(2), 154–171.
  30. Xing, J., Ai, H., Lao, S.,”Multi-object tracking through occlusions by local track lets filtering and global track lets association with detection responses”, In 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009, pp. 1200–1207.
  31. Zhou, H., Yuan, Y., Shi, C., “Object tracking using sift features and mean shift. Computer Vision & Image Understanding”, 2009 113(3), 345–352.
  32. Pedro F. Felzenszwalb, David A. McAllester, and Deva Ramanan. "A discriminatively trained, multiscale, deformable part model." In Computer Vision and Pattern Recognition (CVPR),2008, vol. 2, no. 6, p. 7.
  33. Navneet Dalal and Bill Triggs, "Histograms of oriented gradients for human detection." In International Conference on Computer Vision & Pattern Recognition (CVPR'05), 2005, vol. 1, pp. 886-893. IEEE Computer Society.
  34. Paul Viola and Michael Jones. "Robust real-time object detection." International Journal of Computer Vision, 4, no. 34-47, 2001: 4.
  35. ohan AK. Suykens, and Joos Vandewalle. "Least squares support vector machine classifiers." Neural Processing Letters, 9, no. 3, 1999: 293-300.

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2021-08-30

Issue

Volume 7, Issue 4, July-August-2021

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Vinod Kumar Yadav, Dr. Pritaj Yadav, Dr. Shailja Sharma, " An Efficient Road Surveillance Approach to Detect, Recognize & Tracking Vehicles Using Deep Learning Methods" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 7, Issue 4, pp.503-512, July-August-2021. Available at doi : https://doi.org/10.32628/CSEIT2174106