Automatic Image Caption Generation

Authors

  • Kavitha S  Department of Computer Science and Engineering, Sri Ramakrishna Engineering College, Coimbatore, TamilNadu, India
  • Keerthana V  Department of Computer Science and Engineering, Sri Ramakrishna Engineering College, Coimbatore, TamilNadu, India
  • Bharanidharan A  Department of Computer Science and Engineering, Sri Ramakrishna Engineering College, Coimbatore, TamilNadu, India

Keywords:

Machine Learning, KNN, MATLAB, RGB

Abstract

Recent work in machine learning uses an attention-based model, which automatically learns to predict the content of image. Automated Image Caption generation uses a type of artificial intelligence called deep learning to generate appropriate caption for the images. It also provides the best words to explain the image entirely. The textual description of the image would be generated after processing the image and its visual content has been analyzed. Caption generation can talk about the features of the scene and how the people and the objects in the image interact. The shape information of an image is mostly enclosed in edges. So, it is necessary to detect edges for an input image, by using certain filters and by enhancing those areas of image which contains edges, sharpness of image will increase and image will become clearer. The filter used here is sobel operator. Edge detection is used to extract features from the image and based on these features, caption will be generated which depicts the image. To convert these features into a meaningful caption, KNN classifier is used.

References

  1. Aswathy K S, Gnana Sheela K, “Survey on Feature Extraction of Images for Appropriate Caption Generation”, International Journal of Engineering Research and General Science Volume 4, Issue 1, January-February, 2016 ISSN 2091-2730.
  2. D. D. Sapkal, Pratik Sethi, Rohan Ingle, Shantanu Kumar Vashishtha, Yash Bhan, “A Survey on Auto Image     Captioning”, Vol. 5, Issue 2, February 2016.
  3. Thirupathi Podeti , Bhanu Prasad A, “Dynamic Caption Generation with Image Annotation”, Thirupathi Podeti et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 5 (4) , 2014, 5221- 5224,ISSN:0975-9646.
  4. Vini Varghese, J Saravanan,” A Systematic Approach for News Caption Generation”, International Journal of Advanced Research in Computer Science & Technology (IJARCST 2014), Vol. 2, Issue 2, Ver. 1 (April - June 2014).
  5. Priyanka M. Kadhav, Pragati Patil,” Efficient Phrase- Based Model for Automatic Caption Generation of     Images”.International journal of innovative Research and Development, Vol 2 Issue 11, November, 2013.
  6. Amitkumar Kohakade, Emmanuel M,” Content based Caption Generation for Images Embedded in News Articles”, International Journal of Computer Applications (0975 – 8887) Volume 100– No.11, August 2014.
  7. Deshmukh Sonali Dattatray,Ugale Pravin Chandrakant Walzade Amit Balasaheb,Kshirsagar Jayesh Prabhakar , Prof. S.B.Gote,” The Review of The Automatic Caption Generation for News Articles and Personal Photos”, International Journal of Advance Engineering and Research Development, Volume 3, Issue 3, March -2016, e-ISSN (O): 2348-4470 p-ISSN (P): 2348-6406.
  8. Zenghai Chen, Hong Fu, Zheru Chi and David Dagan Feng. 2012. “An Adaptive Recognition Model for Image Annotation”, IEEE Transactions on Systems, Man, and Cybernetic Part C: Applications and Reviews. Vol.42. Issue 6. pp.1120-1127.
  9. Yansong Feng, Member and Mirella Lapata. 2013. “Automatic Caption Generation for News Images”. IEEE Transactions on Pattern Analysis and Machine Intelligence.Vol.35. Issue 4. pp.797-812 .
  10. Man Lan, Chew Lim Tan, Jian Su. 2009. “Supervised and Traditional Term Weighting Methods for Automatic Text Categorization”. IEEE Transactions on Pattern Analysis and Machine Intelligence. Vol.31. Issue 4. pp. 21-735.

Downloads

Published

2017-04-30

Issue

Section

Research Articles

How to Cite

[1]
Kavitha S, Keerthana V, Bharanidharan A, " Automatic Image Caption Generation, IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 2, Issue 2, pp.537-540, March-April-2017.