Security and Challenges in Implementation of Hadoop Technology in Cloud

Authors

  • Nuzhat Shabir  M.Tech (Scholar), CSE Depatment Desh Bhagat University, Mandi Gobindgarh, Punjab, India
  • Manoj Kumar Srivastava  Assistant Professor, CSE Department, Desh Bhagat University, Mandi Gobindgarh, Punjab, India

Keywords:

Cloud Clusters, Security in Hadoop, HDFS, Map Reduce, Cloud Computing

Abstract

In this Cloud Computing era, major area of worry today is managing terrific increase of over flown and exponentially growing data. The security particularly for organizing data in database. The rising exponential Internet of Things (IoT) data has led to several governance issues for government and private organization. Threats to security have compelled corporate and public sector businesses to build their own Hadoop-based cloud storage infrastructure. It builds numerous clusters of computers and efficiently coordinates work among them under the Apache Hadoop architecture. HDFS (Hadoop Distributed File System) and Map Reduce (Hadoop Map Reduce) are two key Hadoop components. HDFS is Hadoop's principal storage system. It allows for accurate and quick calculations. HDFS enables diverse user applications executing for end user with high-availability rich data set. Map Reduce framework software for analysing vast amount of data and transform into the required output. Here it examines HDFS architecture, as well as its numerous functionalities, such as analytical and security capabilities.

References

  1. Zhao J., Wang L., Tao J.,Chen J., Sun W., Ranjan R., et al., "A security framework in G-Hadoop for big data com- puting across distributed Cloud data centres," Journal of Computer and System Sciences, vol. 80, pp.994-1007, 2014
  2. Kadre Viplove , Chaturvedi Sushil , “AES – MR: A Novel Encryption Scheme for securing Data in HDFS Environ- ment using MapReduce http://www.ijcaonline.org/research/volume129/number12 /kadre-2015-ijca 906994.pdf, International Journal of Computer Applications (0975 – 8887) Volume 129 – No.12, November2015.
  3. Gaikwad Rajesh Laxman , Prof. Dhananjay M Dakhane and Prof. Ravindra L Pardhi,” Network Security Enhancement in Hadoop Clusters”, IJAIEM ,Volume 2, Issue 3, March 2013 ISSN 2319 – 4847.
  4. Saraladevia B.,Pazhanirajaa N., Victer Paula, Saleem Bashab, Dhavachelvanc P.,” Big Data and Hadoop-A Study in Security Perspective”, 2nd International Symposium on Big Data and Cloud Computing (ISBCC’15).
  5. Karthik D, Manjunath T N, Srinivas K,” A View on Data Security System for Cloud on Hadoop Framework”, http://research.ijcaonline.org/nckite2015/number3/nckite2 661.pdf, International Journal of Computer Applications (0975 – 8887) National Conference on Knowledge, Inno- vation in Technology and Engineering (NCKITE 2015).
  6. Vinit G. Savant,” Approaches to Solve Big Data Security Issues and Comparative Study of Cryptographic Algorithms for Data Encryption “,http://ijicar.com/wp- content/uploads/2015/04/RJ010106.pdf, Volume 1 : Issue 1 International Journal of Integrated Computer Applica- tions & Research (ijicar) idin rJ010106 ISSN 2395-4310 2015 © IJICAR http://ijicar.com.
  7. Monika Kumari ,Dr.Sanjay Tyagi ,”A Three Layered Se- curity Model for Data Management in Hadoop Environ- ment “ https://www.ijarcsse.com/docs/papers/Volume_4/ 6_June2014/V4I6-0105.pdf , Volume 4, Issue 6, June 2014 ISSN: 2277 128X International Journal of Advanced Re- search in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com.
  8. B. Saraladevia, N. Pazhanirajaa, P. Victer Paula, M.S. Saleem Bashab, P. Dhavachelvanc ,” Big Data and Hadoop-A Study in Security Perspective “,http://www.sciencedirect.com/science/article/pii/S187705 091500592X,2nd International Symposium on Big Data and Cloud Computing (ISBCC’15).
  9. Ms. Chetana Girish Gorakh, Dr. Kishor M. Dhole,”A Re- view on Security Approach in Big Data”,http://www.iosrjournals.org/iosrjce/papers/conf.15013/ Volume%2010/9.%2037-40.pdf?id=7557 , IOSR Journal of Computer Engineering (IOSR-JCE) e-ISSN: 2278-0661, p- ISSN: 2278-8727 PP 37-40 www.iosrjournals.org.
  10. Al-Janabi, Rasheed, M.A.-S., “Public-Key Cryptography Enabled Kerberos Authentication”, IEEE, Develop- meashents in E-systems Engineering (DeSE), 2011.
  11. Zvarevashe Kudakw, Mutandavari Mainford, Gotora Trust, , “A Survey of the Security Use Cases in Big Daa”,http://www.ijircce.com/upload/2014/may/13_ASurv ey.pdf, International Journal of Innovative Research in Computer and Communication Engineering,(An ISO 3297: 2007 Certified Organization),Vol. 2, Issue 5, May 2014
  12. Mehak, Gagandeep, “Improving Data Storage Security in Cloud using Hadoop”, http://www.ijera.com/papers/ Vol4_issue9/Version%203/U4903133138.pdf, Int. Journal of Engineering Research and Applications, www.ijera.com ISSN: 2248-9622, Vol. 4, Issue 9(Version 3), September 2014, pp.133-138
  13. Bhojwania Nikita, Prof. Vatsal Shahb,” A Survey on HADOOP File System”, http://ijiere.com/FinalPaper/ Fi- nalPaper2014112822174540.pdf, International Journal of Innovative and Emerging Research in Engineering Vol- ume 1, Issue 1, 2014, e-ISSN: 2394 – 3343
  14. Jorge Veiga, Roberto R. Exp´osito, Xo´an C. Pardo, Guillermo L. Taboada, and Juan Touri˜no. “Performance Evaluation of Big Data Frameworks for Large-Scale Data Analytics”. In: 2015 IEEE International Conference on Big Data. IEEE Big Data’15. 2015, pp. 193–202.
  15. Parmita Mehta, Sven Dorkenwald, Dongfang Zhao, Tomer Kaftan, Alvin Cheung, Magdalena Balazinska, Ariel Rokem, Andrew J. Connolly, Jacob VanderPlas, and Yusra AlSayyad. “Comparative Evaluation of Big-Data Systems on Scientific Image Analytics Workloads”. In: Proceedings of the 43rd International Conference on Very Large Data Bases 10.11 (2017), pp. 1226–1237.
  16. Aaron N. Richter, Taghi M. Khoshgoftaar, Sara Landset, and Tawfiq Hasanin. “A Multi-dimensional Comparison of Toolkits for Machine Learning with Big Data”. In: 2015 IEEE International Conference on Information Reuse and Integration. IRI’15. 2015, pp. 1–8.
  17. Jack Galilee and Ying Zhou. A study on implementing iterative algorithms using big data frameworks.url:https://webarchive.org/web/20160602063912/ http://sydney.edu.au/engineering/it/research/conversazione-2014/Galilee-Jack.pdf (visited on 08/19/2017).
  18. Shvachko K, Kuang H, Radia S, et al. The hadoop distributed file systemC// Mass Storage Systems and Technologies (MSST), 2010 IEEE 26th Symposium

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2021-08-30

Issue

Volume 7, Issue 4, July-August-2021

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Nuzhat Shabir, Manoj Kumar Srivastava, " Security and Challenges in Implementation of Hadoop Technology in Cloud" International Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 7, Issue 4, pp.252-261, July-August-2021.