The Integration of OpenCV and Unity for the Development of Interactive Educational Game
DOI:
https://doi.org/10.32628/CSEIT2390452Keywords:
OpenCV, Interactive educational game, Unity 3D, Computer Vision, User Datagram Protocol (UDP)Abstract
In recent years, online and interactive educational games have become increasingly popular as a tool to improve and accelerate the learning experience for students. Computer vision libraries in python such as OpenCV provide a wide range of tools for image processing, object detection, and face recognition that can be used to create interactive and engaging games. This paper explores the use of OpenCV in Unity 3D for the development of interactive online educational games. Specifically, we discuss how OpenCV can be used to create interactive games that respond to user actions in real-time, such as tracking the movement of a user’s hand or face to control in-game actions. It focuses on an unconventional approach to interactive game development using OpenCV combined with a computer network based protocol namely User Datagram Protocol (UDP) as communication channel to transfer real-time data to Unity Game Engine from Python Server. Though being the conventional approach for object and face tracking based games Augmented Reality (AR) requires specialized hardware and high camera quality for accurate tracking of object position and orientation. Given the lack of technical infrastructure and computational resources in majority government schools under the Indian academic education system this approach is not feasible for large scale implementation. This research paper aims to contribute to the development of innovative and effective approaches for interactive and online educational games suitable for large scale implementation in the form of a Vlab (Virtual Lab).
References
- G. Garg and S. Shivani,” Controller free hand interaction in Virtual Reality,” 2022 OITS International Conference on Information Technology (OCIT), Bhubaneswar, India, 2022, pp. 553-557, DOI: 10.1109/OCIT56763.2022.00108.
- S. L. Kim, H. J. Suk, J. H. Kang, J. M. Jung, T. H. Laine and J. Westlin,” Using Unity 3D to facilitate mobile augmented reality game development,” 2014 IEEE World Forum on Internet of Things (WF-IoT), Seoul, Korea (South), 2014, pp. 21-26, DOI: 10.1109/WFIoT.2014.6803110.
- B. A. Koca and B. Cubukcu,” Augmented Reality Application for Preschool Children with Unity 3D Platform,” 2019 3rd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), Ankara, Turkey, 2019, pp. 1-4, DOI: 10.1109/ISMSIT.2019.8932729.
- R. M. Gurav and P. K. Kadbe,” Real time finger tracking and contour detection for gesture recognition using OpenCV,” 2015 International Conference on Industrial Instrumentation and Control (ICIC), Pune, India, 2015, pp. 974-977, DOI: 10.1109/IIC.2015.7150886
- Introduction OpenCV. Available at: https://docs.opencv.org/4.x/d1/dfb/intro.html (Accessed: 11 July 2023).
- Arkit Apple Developer Documentation. Available at: https://developer.apple.com/documentation/arkit (Accessed: 11 July 2023).
- Google Developers Overview of arcore and supported development environments — google for developers, Google. Available at: https://developers.google.com/ar/develop (Accessed: 11 July 2023).
- E. Smeets,” Does ICT Contribute to Powerful Learning Environments in Primary Education” Computers and Education, Vol. 44, No 3, pp 343-355. 2005.
- M. Peat and A. Fernandez,” The Role of Information Technology in Biology Education: an Australian perspective”. Journal of Biological Education. Vol 34, 2000, pp. 69-73.
Downloads
Published
Issue
Section
License
Copyright (c) IJSRCSEIT
This work is licensed under a Creative Commons Attribution 4.0 International License.