Web Application for Interpretation of Doctor's Handwritten Prescription and Suggesting the best Price Offer over Various e- Commerce Websites using AI

Authors

  • Tanmesh Joshi  Department of Computer Engineering, Shree L.R Tiwari College of Engineering, Mumbai, Maharashtra, India
  • Saumen Das  Department of Computer Engineering, Shree L.R Tiwari College of Engineering, Mumbai, Maharashtra, India
  • Sankalp Ghosh  Department of Computer Engineering, Shree L.R Tiwari College of Engineering, Mumbai, Maharashtra, India
  • Chirag Jha  Department of Computer Engineering, Shree L.R Tiwari College of Engineering, Mumbai, Maharashtra, India
  • Dr. Vinayak D. Shinde  Assistant Professor, Department of Computer Engineering, Shree L.R Tiwari College of Engineering, Mumbai, Maharashtra, India

DOI:

https://doi.org//10.32628/CSEIT2390230

Keywords:

OCR, NLP, Cosine Similarity, NER, Word2vec, Amazon Textract, Google Cloud Vision.

Abstract

Patient record-keeping is crucial for accurate diagnoses and treatment. In India, due to time constraints, most doctors manually write prescriptions, making it challenging for pharmacists to read them correctly. This increases the risk of dispensing the wrong medicine, which can have serious and even fatal consequences for patients. To address this problem, this research proposes an online handwritten medical prescription recognition system that allows users to scan prescriptions and compare prices across different websites. OCR techniques are used to recognize medicine names in handwritten prescriptions, while NLP techniques such as Cosine Similarity are employed to overcome the issue of misinterpretation. The review study focuses on Named Entity Recognition and Relation Extraction, which help identify named entities and extract relations between entities. Most state-of-the-art techniques are offline and computationally expensive, highlighting the need for understanding the deep-learning processes used in the proposed system. The system stores various features such as medicine names, uploaded images, user details, and search history to improve recognition accuracy. Additionally, new features are proposed to enhance accuracy further. Uses a local dataset from a pharmacy shop and past prescription records from local doctors.

References

  1. T. Hegghammer, “OCR with Tesseract, Amazon Textract, and Google Document AI: a benchmarking experiment,” Journal of Computational Social Science, vol. 5, no. May 2022, pp. 861-882, 2022.
  2. C. I. Patel, D. Labana, S. Pandya, K. Modi, H. Ghayvat and M. Awais, “Histogram of Oriented Gradient-Based Fusion of Features for Human Action Recognition in Action Video Sequences,” MDPI, vol. 20, no. 24, 2020
  3. Z. NASAR, S. W. JAFFRY and M. K. MALIK, “Named Entity Recognition and Relation Extraction:,” Research Gate, p. 39, 2021.
  4. E. UZUN, “A Novel Web Scraping Approach Using the Additional Information Obtained From Web Pages,” IEEE Access, vol. 8, pp. 61726 - 61740, 2020.
  5. W. Yang and K. Orkphol, “Word Sense Disambiguation Using Cosine Similarity Collaborates with Word2vec and WordNet,” MDPI, vol. 11, no. 5, 2019
  6. J. Zhang, F. Wang, F. Ma and G. Song, “Text Similarity Calculation Method Based on Optimized Cosine Distance,” 2022 International Conference on Electronics and Devices, Computational Science (ICEDCS), pp. 37-39, 2023
  7. X. Yi, R. Zheng, A. Wang, H. Qin and Y. Chen, “Design and implementation of Word2Vec parallel algorithm based on HPC,” 2017 Chinese Automation Congress (CAC), Jinan, China, pp. 585-590, 2017A
  8. D. M. Thomas and S. Mathur, “Data Analysis by Web Scraping using Python,” 2019 3rd International conference on Electronics, Communication and Aerospace Technology (ICECA) , pp. 450-454, 2019.
  9. H. Hosseini, B. Xiao and R. Poovendran, “Google's Cloud Vision API is Not Robust to Noise,” 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA) , pp. 101-105, 2017.

Downloads

Published

2023-04-30

Issue

Section

Research Articles

How to Cite

[1]
Tanmesh Joshi, Saumen Das, Sankalp Ghosh, Chirag Jha, Dr. Vinayak D. Shinde, " Web Application for Interpretation of Doctor's Handwritten Prescription and Suggesting the best Price Offer over Various e- Commerce Websites using AI , IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 9, Issue 2, pp.283-289, March-April-2023. Available at doi : https://doi.org/10.32628/CSEIT2390230