Challenges in Handling Imbalanced Big Data: A Survey

Authors(2) :-B. S. Mounika Yadav, Sesha Bhargavi Velagaleti

Big Data describes enormous sets that have more divergent and intricate structure like weblogs, social media, email, sensors, and photographs. These unstructured data and peculiar characteristics from traditional databases typically associated with extra complications in storing, analyzing and applying further procedures or extracting results. Big Data analytics is the process of auditing gigantic amounts of complex data to find out unseen patterns or recognizing hidden correlations. Big Data applications are rising during the last years, and researchers from many disciplines are aware of the advantages related to the knowledge extraction from this type of problem. However traditional learning approaches cannot be enforced due to the scalability issues. Being still a recent discipline, handful research has been conducted on imbalanced data classification for Big Data. The apprehension behind this is mainly the difficulties in adapting standard techniques to the Map-Reduce programming style. Additionally, inner problems of imbalanced data, namely lack of data for training, the overlap between classes, the presence of noise and small disjuncts, are emphasized during the data partitioning to fit the Map-Reduce programming style. A literature survey on classification problem in Big Data has been done and existing methodologies were discussed with their pros and cons in this paper. This study suggests that there is a great need for finding a new method of classification when it comes to Big Data which addresses several issues like multi-class problems, class imbalance etc.,

Authors and Affiliations

B. S. Mounika Yadav
Assistant Professor, IT Dept.,Vasavi College of Engineering, Hyderabad, Telangana, India
Sesha Bhargavi Velagaleti
Assistant Professor, IT Dept., G. Narayanamma Institute of Technology and Science, Hyderabad, Telangana, India

Big Data, TNrate, SMOTE, MapReduce

  1. Río S, López V, Benítez J, Herrera F (2014) On the use of MapReduce for imbalanced Big Data using random forest. Inf Sci 285:112–137
  2. Owen S, Anil R, Dunning T, Friedman E (2011) Mahout in action, 1st edn. Manning Publications Co., Greenwich
  3. Lyubimov D, Palumbo A (2016) ApacheMahout: beyond MapReduce, 1st edn. CreateSpace Independent, North Charleston
  4. Triguero I, Río S, López V, Bacardit J, Benítez JM, Herrera F (2015) ROSEFW-RF: the winner algorithm for the CBDL’14 Big Data competition: an extremely imbalanced Big Data bioinformatics problem. Knowl Based Syst 87:69–79
  5. T.riguero I, GalarM, Vluymans S, Cornelis C, Bustince H, Herrera F, Saeys Y (2015) Evolutionary under sampling for imbalanced Big Data classification. In: IEEE congress on evolutionary computation (CEC), pp 715–722.
  6. Hu F, Li H, Lou H, Dai J (2014) A parallel oversampling algorithm based on NRSBoundary-SMOTE. J Inf Comput Sci 11(13):4655–
  7. Zhai J, Zhang S, Wang C (2015) the classification of imbalanced large data sets based on MapReduce and ensemble of elm classifiers. Int J Mach Learn Cybern. doi:10.1007/s13042-015-0478-
  8. Wang X, Liu X, Matwin S (2014) A distributed instance-weighted SVM algorithm on large-scale imbalanced datasets. In: Proceedings of the 2014 IEEE international conference on Big Data, 2014, pp 45–51.
  9. Río S, López V, Benítez J, Herrera F (2014) On the use of MapReduce for imbalanced Big Data using random forest. Inf Sci 285:112–137
  10. López V, Río S, Benítez JM, Herrera F (2015) Cost-sensitive linguistic fuzzy rule based classification systems under the MapReduce framework for imbalanced Big Data. Fuzzy Sets Syst 258:5-38.
  11. Río S, López V, Benítez JM, Herrera F (2015) A MapReduce approach to address Big Data classification problems based on the fusion of linguistic fuzzy rules. Int J Comput Intell Syst 8(3):422–437

Publication Details

Published in : Volume 4 | Issue 1 | March-April 2018
Date of Publication : 2018-04-25
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 172-177
Manuscript Number : CSEIT411829
Publisher : Technoscience Academy

ISSN : 2456-3307

Cite This Article :

B. S. Mounika Yadav, Sesha Bhargavi Velagaleti, "Challenges in Handling Imbalanced Big Data: A Survey", International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 4, Issue 1, pp.172-177, March-April.2018
URL : http://ijsrcseit.com/CSEIT411829

Follow Us

Contact Us