An Efficient Management for Map Reduce Using Partition and Aggregation in Software Application
Keywords:
MapReduce, NSK, K-nearest, ProMiSHAbstract
In this paper, we study to reduce data traffic and to avoid duplication using a MapReduce technique and data partition scheme. Aggregator problem and large-scale optimization problem of duplication and data traffic were made in online or offline. In these problem we use map reduce technique to clustering the data and use k-nearest algorithm is used to reduce the time and cluster the nearest data to avoid conflict. Then we also use ProMiSH based on random projections and hashing for partition process to avoid data traffic in the search engine. In this, we also using k-nearest algorithm for aggregation to clustering the nearest neighbor data and using ProMiSH based on random projections and hashing for partition process to avoid data traffic in the search engine. Then these we use algorithms to decrease the traffic and conflict while processing the data and improve the speed to access the data faster.
References
- C. Long, R. C.-W. Wong, K. Wang, and A. W.-C. Fu, “Collective spatialkeyword queries: a distance owner-driven approach,” in SIGMOD, 2013.
- D. Zhang, B. C. Ooi, and A. K. H. Tung, “Locating mapped resourcesin web 2.0,” in ICDE, 2010, pp. 521–532.
- V. Singh, S. Venkatesha, and A. K. Singh, “Geo-clustering of imageswith missing geotags,” in GRC, 2010, pp. 420–425.
- X. Cao, G. Cong, C. S. Jensen, and B. C. Ooi, “Collective spatialkeyword querying,” in SIGMOD, 2011.
- W. Li and C. X. Chen, “Efficient data modeling and querying systemfor multi-dimensional spatial data,” in GIS, 2008, pp. 58:1–58:4.
- V. Singh, A. Bhattacharya, and A. K. Singh, “Querying spatial patterns,”in EDBT, 2010, pp. 418–429.
- J. Bourgain, “On lipschitz embedding of finite metric spaces in Hilbert space,” Israel J. Math., vol. 52, pp. 46–52, 1985.
- H. He and A. K. Singh, “Graphrank: Statistical modeling and mining ofsignificantsubgraphs in the feature space,” in ICDM, 2006, pp. 885–890.
Downloads
Published
Issue
Section
License
Copyright (c) IJSRCSEIT
This work is licensed under a Creative Commons Attribution 4.0 International License.