An Overview of Apache Pig and Apache Hive

Authors

  • Saiyam Arora  Department of Computer Science, Chandigarh University, Mohali, Punjab, India
  • Abinesh Verma  Department of Computer Science, Chandigarh University, Mohali, Punjab, India
  • Richa Vasuja  Assistant Professor Department of Computer Science, Chandigarh University, Mohali, Punjab, India

DOI:

https://doi.org//10.32628/CSEIT195250

Keywords:

Big Data, Hadoop, Map Reduce, HDFS, Pig, Hive.

Abstract

Ever since the enhancement of technology has taken place, the data is growing at an alarming rate. The most prominent factor of data growth is the “Social Media”, leads to the origination of a tremendous amount of data called Big Data. Big Data is a term used for data sets that are extremely large in size as well as complicated to store and process using traditional database processing applications. A saviour to deal with Big Data is “Hadoop” and two major components of Hadoop which are HDFS (Distributed Storage) and Map Reduce(Parallel Processing). Apache Pig and Hive is an essential part of the Hadoop Ecosystem. This paper covers an overview of both Apache Pig and Hive with their architecture. As Hadoop, no doubt is doing tremendously great work by storing and processing the huge volume of data but there are more frameworks now a days to increase the efficiency of Hadoop framework which are basically seen as the layers of Hadoop or a part of Apache Hadoop project. And that is why this paper includes the two most important layers namely Apache Pig and Apache Hive.

References

  1. Kadhar Bhasha J, Dr. M. Balamurugan, “A Review on Hive and Pig”, International Journal of Advanced Research in Basic Engineering Sciences and Technology (IJARBEST), 2017, ISSN 2456-5717.
  2. Vaishali Chauhan, Meenakshi Sharma, “Hive, Pig & HBase Performance Evaluation for Data Processing Applications”, International Journals of Advanced Research in Science Engineering, 2016, ISSN 2319-8354.
  3. Ms. Sarika Rathi, “A Brief Study of Big Data Analytics using Apache Pig and Hadoop Distributed File System”, International Journals of Advanced Research in Science Engineering, 2017, ISSN 2278-1323.
  4. Rupinder Singh, Puneet Jai Kaur, “Analyzing performance of Apache Tez and MapReduce with Hadoop multinode cluster on Amazon cloud”, 2016, DOI 10.1186/s40537-016-0051-6.
  5. Richa Vasuja, Ayesha Bhandralia, Kanika Chuchra, “Daemons of Hadoop: An Overview”, International Journal of Engineering Research and Technology, 2018, ISSN: 2278-0181.
  6. Maitrey S, Jha CK. “Handling Big Data efficiently by using MapReduce technique.”, IEEE international conference on computational intelligence & communication technology (CICT), 2015, pp 703-8.

IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology

Downloads

Published

2019-04-30

Issue

Volume 5, Issue 2, March-April-2019

Section

Research Articles

License

Copyright (c) IJSRCSEIT

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

[1]
Saiyam Arora, Abinesh Verma, Richa Vasuja, " An Overview of Apache Pig and Apache Hive, IInternational Journal of Scientific Research in Computer Science, Engineering and Information Technology(IJSRCSEIT), ISSN : 2456-3307, Volume 5, Issue 2, pp.432-436, March-April-2019. Available at doi : https://doi.org/10.32628/CSEIT195250