Mapreduce Based Pattern Mining Algorithm In Distributed Environment

Authors(3) :-R.Rampriya, D.Nivetha, P.Swetha Sri

DCE (Distributed Computing Environment) is an industry-standard software technology for setting up and managing computing and data exchange in a system of distributed computers. The proposed method initially extracts frequent item sets for each zone using existing distributed frequent pattern mining algorithms. It also compares the time efficiency of MapReduce based frequent pattern mining algorithm with Count Distribution Algorithm and Fast Distributed Mining algorithms. It presents novel approach to identify consistent and inconsistent association rules from sales data located in distributed environment and overcomes the main memory bottleneck and computing time overhead of single computing system by applying computations to multi node cluster. Here the association generated from frequent item sets are too large that it becomes complex to analyze it. Thus, the MapReduce based consistent and inconsistent rule detection (MR-CIRD) algorithm is proposed to detect the consistent and inconsistent rules from big data and provide useful and actionable knowledge to the domain experts.

Authors and Affiliations

R.Rampriya
Assistant Professor, Department of Computer Science and Engineering, C. K. College of Engineering and Technology, Chellangkuppam, Cuddalore, Tamil Nadu, India
D.Nivetha
Assistant Professor, Department of Computer Science and Engineering, C. K. College of Engineering and Technology, Chellangkuppam, Cuddalore, Tamil Nadu, India
P.Swetha Sri
Assistant Professor, Department of Computer Science and Engineering, C. K. College of Engineering and Technology, Chellangkuppam, Cuddalore, Tamil Nadu, India

MapReduce, Pattern mining, Count Distribution, Fast Distribution, Inconsistent association.

  1. Apache Hadoop, 2014. Welcome to Apache™ Hadoop®. http://hadoop.apache.org (3 Nov. 2014).
  2. M. Barkhordari, N. Mahdi, ScadiBino: an effective MapReduce based association rule mining method, in: Proc. of the Sixteenth Int. Conf. on Electronic Commerce, ACM, 2014.
  3. D.J. Prajapati, S. Garg, MapReduce based multilevel association rule mining from concept hierarchical sales data, in: Int. Conf. on Advances in Computing and Data Sciences, ICACDS-2016, 2016.
  4. T. Ban, M. Eto, S. Guo, D. Inoue, K. Nakao, R. Huang, A study on association rule mining of darknet big data, in: Proc. IEEE Int. Joint Conf. on Neural Network, IJCNN, 2015, pp. 1–7.
  5. J. Han, M. Kamber, Data Mining Concepts and Techniques, Morgan Kaufmann Publishers, San Francisco, 2004.
  6. MapReduce Based Multilevel Consistent and Inconsistent Association Rule Detection from Big Data Using Interestingness Measures (PDF Download Available). Available from: https://www.researchgate.net/publication/318737487_MapReduce_Based_Multilevel_Consistent_and_Inconsistent_Association_Rule_Detection_from_Big_Data_Using_Interestingness_Measures [accessed Oct 23 2017].

Publication Details

Published in : Volume 2 | Issue 5 | September-October 2017
Date of Publication : 2017-10-31
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 935-941
Manuscript Number : CSEIT1725203
Publisher : Technoscience Academy

ISSN : 2456-3307

Cite This Article :

R.Rampriya, D.Nivetha, P.Swetha Sri, "Mapreduce Based Pattern Mining Algorithm In Distributed Environment", International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 2, Issue 5, pp.935-941, September-October-2017. |          | BibTeX | RIS | CSV

Article Preview