Automatic Academic Paper Rating Based on Convolutional Neural Network

Authors

  • Mubeena A. K  Computer Science and Engineering, MEA Engineering College, Perinthalmanna, Kerala, India
  • Shahad P.  Computer Science and Engineering, MEA Engineering College, Perinthalmanna, Kerala, India

DOI:

https://doi.org//10.32628/CSEIT1953164

Keywords:

Convolutional Neural Network, Word2vec

Abstract

As an ever increasing number of academic papers are being submitted to journals and conferences, assessing every one of these papers by experts is tedious and can cause imbalance because of the personal factors of the reviewers. In this system, in order to help professionals in assessing academic papers, here propose a task: Automatic Academic Paper Rating (AAPR), which automatically determine whether to accept academic papers. We build a convolutional neural network (CNN) model to achieve automatic academic paper rating task. It has two phases, first phase is identifying abstract part of source paper and generate rating score using CNN model and second phase is taking decision based on the score to accept or decline papers. This model takes word embedding of the abstracts as the input and learns useful features. The word embedding used for training the model is a semantically enriched set of Word2Vec word embedding. After the training phase, the proposed model will be able to generate the score of a new abstract. And find that the title and abstract parts have the most influence on whether the source paper quality when setting aside the other part of source papers. The proposed system outperforms the state-of-art technique.

References

  1. Valenti, S., Neri, F., and Cucchiarelli, A. (2003). An overview of current research on automated essay grading. Journal of Information Technology Education: Research, 2(1):319–330.
  2. Attali, Y. and Burstein, J. (2004). Automated essay scoring with e-rater® v. 2.0. ETS Research Report Series, 2004(2):i–21.
  3. Yannakoudakis, H., Briscoe, T., and Medlock, B. (2011). A new dataset and method for automatically grading esol texts. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, pages 180–189. Association for Computational Linguistics.
  4. Taghipour, K. and Ng, H. T. (2016). A neural approach to automated essay scoring. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1882–1891.
  5. Dong, F. and Zhang, Y. (2016). Automatic features for essay scoring–an empirical study. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1072–1077.
  6. Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., and Kuksa, P. (2011). Natural language processing (almost) from scratch. Journal of machine learning research, 12(Aug):2493–2537.
  7. Kalchbrenner, N., Grefenstette, E., and Blunsom, P. (2014). A convolutional neural network for modelling sentences. arXiv preprint arXiv:1404.2188.
  8. Kim, Y. (2014). Convolutional neural networks for sentence classification. arXiv preprint arXiv:1408.5882
  9. Gulli, A. and Pal, S. (2017). Deep Learning with Keras. Packt Publishing Ltd.

Downloads

Published

2019-06-30

Issue

Section

Research Articles

How to Cite

[1]
Mubeena A. K, Shahad P., " Automatic Academic Paper Rating Based on Convolutional Neural Network, IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 5, Issue 3, pp.569-574, May-June-2019. Available at doi : https://doi.org/10.32628/CSEIT1953164