Language Translation on Intelligent Navigation System using Image Processing

Authors

  • Anubhuti Rane  Department of Computer Engineering, Dr. D. Y. Patil Institute of Technology, Pimpri, Pune, Maharashtra, India
  • Sampada Gaonkar  Department of Computer Engineering, Dr. D. Y. Patil Institute of Technology, Pimpri, Pune, Maharashtra, India
  • Gauri Gulwane  Department of Computer Engineering, Dr. D. Y. Patil Institute of Technology, Pimpri, Pune, Maharashtra, India
  • Tamanna Kasliwal  Department of Computer Engineering, Dr. D. Y. Patil Institute of Technology, Pimpri, Pune, Maharashtra, India
  • Dr. Chaya Jadhav  Professor, Department of Computer Engineering, Dr. D. Y. Patil Institute of Technology, Pimpri, Pune, Maharashtra, India

DOI:

https://doi.org/10.32628/CSEIT206412

Keywords:

Detect, Extract, Translate, Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN), Long Short Term Memory networks (LSTMs).

Abstract

Visitors traveling to different countries around the world often find it hard to understand and communicate in local languages, because they don't understand it. They can't read the words written on the navigational boards or banners at these new locations. Text detection, extraction, and translation system must, therefore, be built to identify and recognize the text found on the navigation boards. This system proposes and implements a three-stage process that involves detection, extraction, and translation using the concepts of Convolutional Neural Network (CNN) and Long Short Term Memory networks or simply “LSTMs”. The framework has been designed to take into account the need to create a desktop application that extracts the text from images based on traffic navigation boards and then translates it further into a user-understandable language. In this way, the user can grasp the unfamiliar language and roam freely in the unfamiliar terrains.

References

  1. Fares Aqlan , Xiaoping Fan , Abdullah Alqwbani, and Akram Al-Mansoub. “Arabic-Chinese Neural Machine Translation: Romanized Arabic As Subword Unit For Arabic-Sourced Translation” IEEE Access, 2019
  2. Yongchao Xu, Yukang Wang, Wei Zhou, Yongpan Wang, Zhibo Yang, Xiang Bai. “TextField: Learning A Deep Direction Field for Irregular Scene Text Detection” IEEE Transaction on Image Processing, 2019.
  3. Muhammad A.Panhwar Kamran A. Memon,SaleemullahMemonSijjad A. Khuhro. “Signboard Detection and Text Recognition Using Artificial Neural Networks Signboard Detection and Text Recognition Using Artificial Neural Networks” IEEE Transcation on Image Processing, 2019.
  4. Kehai Chen, Rui Wang, Masao Utiyama, EiichiroSumita, and Tiejun Zhao. “Neural Machine Translation with Sentence-level Topic Context” IEEE/ACM Transactions On Audio, Speech, And Language Processing, 2019.
  5. YingyingZhu ,Minghui Liao , Mingkun Yang , and Wenyu Liu. “Cascaded- Segmentation- Detection Networks for Text-Based Traffic Sign Detection” IEEE Transactions On Intelligent Transportation Systems, 2018.
  6. ZhaorongZong, Changchun Hong. “On Application of Natural Procesing in Machine Translation” 3rd International Conference on Mechanical Controland Computer Engineering, 2018.
  7. Kehai Chen , Tiejun Zhao, Muyun Yang, Lemao Liu , Akihiro Tamura , Rui Wang , Masao Utiyama,and EiichiroSumita. “A Neural Approach to Source Dependence Based Context Model for Statistical Machine Translation” IEEE/ACM Transactions On Audio, Speech, And Language Processing,2018.
  8. Youbao Tang and Xiangqian Wu, “Scene Text Detection and Segmentation Based on Cascaded Convolution Neural Networks” IEEE Transaction on Image Processing, 2017.
  9. Jack Greenhalgh, Majid Mirmehdi. “Recognizing Text-Based Traffic Signs” IEEE Transaction on Intelligent Transportation Systems, 2014.
  10.  Fig 2 : Image source : MingxianLin (https://commons.wikimedia.org/wiki/File:LSTM.png), https://creativecommons.org/licenses/by-sa/4.0/legalcode

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2020-08-30

Issue

Volume 6, Issue 4, July-August-2020

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Anubhuti Rane, Sampada Gaonkar, Gauri Gulwane, Tamanna Kasliwal, Dr. Chaya Jadhav, " Language Translation on Intelligent Navigation System using Image Processing" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 6, Issue 4, pp.38-47, July-August-2020. Available at doi : https://doi.org/10.32628/CSEIT206412