Offline Handwritten Mathematical Expression Recognition using CNN and Xception

Authors

  • Sanjeevini Nasi  Student, Department of CSE SDMCET, Dharwad, Karnataka, India
  • Sharada H N  Assistant Professor, Department of CSE SDMCET, Dharwad, Karnataka, India

DOI:

https://doi.org//10.32628/CSEIT228420

Keywords:

Mathematical Handwriting recognition, data processing, Classification, CNN.

Abstract

Mathematical expressions generally play a requisite role in scientific communications. They are not just used for numerical calculations, on the other hand, are also employed for fetching scientific information with less ambiguity, and facilitate researchers to exactly outline and formalize target problems. It takes far longer to manually enter mathematical formulas into a computer than it does to write them down on paper using a pen. Recently, we proposed deep learning methods that can identify images of trigonometric expressions from 2dimensional layouts to 1dimensional strings in order to solve this issue. As densely connected convolutional neural networks (CNN) can boost accuracy, we utilize CNN to improve the results in this study. In order to compare performance, the Transfer Learning framework Exception is employed, which obtains 90% accuracy when recognizing handwritten mathematical expressions. CNN provides 98% accuracy in this regard. Therefore, the CNN model that we created has a higher accuracy rating than the Transfer Learning model Xception

References

  1. C. Lu and K. Mohan. “Recognition of Online Handwritten Mathematical Expressions” cs231n Project Report Stanford (2015)
  2. Lyzandra D’souza and Maruska Mascarenhas, “Offline Handwritten Mathematical Expression Recognition using Convolutional Neural Network”, 2018 International Conference on Information, Communication, Engineering and Technology (ICICET) Zeal College of Engineering and Research, Narhe, Pune, India.
  3. Surendra P. Ramteke, Dhanashri V. Patil , Nilima P. Patil “Neural network approach to mathematical expression recognition system” (2012) INTERNATIONAL JOURNAL OF ENGINEERING RESEARCH & TECHNOLOGY (IJERT) Volume 01, Issue 10 (December 2012)
  4. Dai Hai Nguyen, Masaki Nakagawa and Anh Le Duc. “Recognition of Online Handwritten Math Symbols using Deep Neural Networks” IEICE Transaction and Systems - October 16
  5. Yanyan Zou, Wei Lu “Text2Math: End-to-end Parsing Text into Math Expressions” Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing.
  6. Chuanjun Li, Robert Zeleznik, Timothy Miller, Joseph LaViola “Online recognition of handwritten mathematical expressions with support for matrices” 2008 19th International Conference on Pattern Recognition.
  7. Sanjay S. Gharde, Pallavi V. Baviskar, K. P. Adhiya “Identification of Handwritten Simple Mathematical Equation Based on SVM and Projection Histogram” International Journal of Soft Computing and Engineering (IJSCE) ISSN: 2231-2307, Volume-3, Issue-2, May 2013.
  8. M Abirami; Suresh Jaganathan “Handwritten Mathematical Recognition Tool” Second International Conference on Computational Intelligence in Data Science (ICCIDS-2019)
  9. Nicolas D. Jimenez, Lan Nguyen “ Recognition of Handwritten Mathematical Symbols with PHOG Features” ID - cs22 Stanford education published 2013
  10. Prathamesh Tope, Sarvesh Ransubhe, Mohammad Abdul Mughni, Chinmay Shiralkar, Mrs. Bhakti Ratnaparkhi “ Recognition of Handwritten Mathematical Expression and Using Machine Learning Approach” International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056,p-ISSN: 2395-0072 Volume: 08 Issue: 12 | Dec 2021.
  11. Vuong, Ba-Quy; Hui, Sui-Cheung and He, Yulan “Progressive structural analysis for dynamic recognition of on-line handwritten mathematical expressions” 2008.
  12. Dongxiang Zhang, Lei Wang, Luming Zhang, Bing Tian Dai, and Heng Tao Shen “The Gap of Semantic Parsing: A Survey on Automatic Math Word Problem Solvers” April 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence PP(99):1-1

Downloads

Published

2022-08-30

Issue

Section

Research Articles

How to Cite

[1]
Sanjeevini Nasi, Sharada H N, " Offline Handwritten Mathematical Expression Recognition using CNN and Xception , IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 8, Issue 4, pp.142-149, July-August-2022. Available at doi : https://doi.org/10.32628/CSEIT228420