Improving Classifier Performance Using Feature Selection with Ensemble Learning

Authors

  • Bhavesh Patankar  Department of Computer Science, Hemchandracharya North Gujarat University, Patan, Gujarat, India.
  • Dr. Vijay Chavda  

Keywords:

Classification; Pre-processing; Feature Selection; Ensemble Learning;

Abstract

One of the critical task in data mining is classification. It is very much important in classification to achieve maximum accuracy. In the field of data mining, numerous classifiers are present for the classification task. Each classification techniques have their pros and cons. Some of the techniques work well with certain data sets while other techniques work well with other data sets. There have been many techniques evolved for improving classification accuracy. One of such technique is pre-processing which helps in improving quality of the data. Another method is to combine the classifiers, which will in turn improve the classification accuracy. In this paper, empirical study is been done on various techniques for improving classification accuracy. One of the technique is feature selection, which will select best features from the available features in the data set. Other approach is ensemble learning which combines many classifiers to improve the classification accuracy.

References

  1. Moeinzadeh, H, Nasersharif, B, Rezaee, A., Pazhoumand-dar, H., “Improving Classification Accuracy Using Evolutionary Fuzzy Transformation”, 11th Annual Conference on Genetic and Evolutionary Computation Conference (GECCO 2009), Montreal, Canada, 2009 (1)
  2. Han, Jiawei, Micheline Kamber, and Jian Pei. Data mining, southeast asia edition: Concepts and techniques. Morgan kaufmann, 2006.
  3. Bratu, Camelia Vidrighin, Tudor Muresan, and Rodica Potolea. "Improving classification accuracy through feature selection." Intelligent Computer Communication and Processing, 2008. ICCP 2008. 4th International Conference on. IEEE, 2008.
  4. Dietterich, Thomas G. "Ensemble methods in machine learning." International workshop on multiple classifier systems. Springer Berlin Heidelberg, 2000.
  5. Zhao, Ying, Jun Gao, and Xuezhi Yang. "A survey of neural network ensembles."2005 International Conference on Neural Networks and Brain. Vol. 1. IEEE, 2005.
  6. Lira, Milde MS, et al. "Combining multiple artificial neural networks using random committee to decide upon electrical disturbance classification." 2007 International Joint Conference on Neural Networks. IEEE, 2007. Nilsson,R., Statistical Feature Selection, with Applications in Life Science, PhD Thesis, Linkoping University, 2007.
  7. Natesan, P., P. Balasubramanie, and G. Gowrison. "Improving the attack detection rate in network intrusion detection using adaboost algorithm." Journal of Computer Science 8.7 (2012): 1041.

Downloads

Published

2016-08-30

Issue

Section

Research Articles

How to Cite

[1]
Bhavesh Patankar, Dr. Vijay Chavda, " Improving Classifier Performance Using Feature Selection with Ensemble Learning, IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 1, Issue 1, pp.44-48, July-August-2016.