An Overview of Apache Pig and Apache Hive

Authors(3) :-Saiyam Arora, Abinesh Verma, Richa Vasuja

Ever since the enhancement of technology has taken place, the data is growing at an alarming rate. The most prominent factor of data growth is the “Social Media”, leads to the origination of a tremendous amount of data called Big Data. Big Data is a term used for data sets that are extremely large in size as well as complicated to store and process using traditional database processing applications. A saviour to deal with Big Data is “Hadoop” and two major components of Hadoop which are HDFS (Distributed Storage) and Map Reduce(Parallel Processing). Apache Pig and Hive is an essential part of the Hadoop Ecosystem. This paper covers an overview of both Apache Pig and Hive with their architecture. As Hadoop, no doubt is doing tremendously great work by storing and processing the huge volume of data but there are more frameworks now a days to increase the efficiency of Hadoop framework which are basically seen as the layers of Hadoop or a part of Apache Hadoop project. And that is why this paper includes the two most important layers namely Apache Pig and Apache Hive.

Authors and Affiliations

Saiyam Arora
Department of Computer Science, Chandigarh University, Mohali, Punjab, India
Abinesh Verma
Department of Computer Science, Chandigarh University, Mohali, Punjab, India
Richa Vasuja
Assistant Professor Department of Computer Science, Chandigarh University, Mohali, Punjab, India

Big Data, Hadoop, Map Reduce, HDFS, Pig, Hive.

  1. Kadhar Bhasha J, Dr. M. Balamurugan, “A Review on Hive and Pig”, International Journal of Advanced Research in Basic Engineering Sciences and Technology (IJARBEST), 2017, ISSN 2456-5717.
  2. Vaishali Chauhan, Meenakshi Sharma, “Hive, Pig & HBase Performance Evaluation for Data Processing Applications”, International Journals of Advanced Research in Science Engineering, 2016, ISSN 2319-8354.
  3. Ms. Sarika Rathi, “A Brief Study of Big Data Analytics using Apache Pig and Hadoop Distributed File System”, International Journals of Advanced Research in Science Engineering, 2017, ISSN 2278-1323.
  4. Rupinder Singh, Puneet Jai Kaur, “Analyzing performance of Apache Tez and MapReduce with Hadoop multinode cluster on Amazon cloud”, 2016, DOI 10.1186/s40537-016-0051-6.
  5. Richa Vasuja, Ayesha Bhandralia, Kanika Chuchra, “Daemons of Hadoop: An Overview”, International Journal of Engineering Research and Technology, 2018, ISSN: 2278-0181.
  6. Maitrey S, Jha CK. “Handling Big Data efficiently by using MapReduce technique.”, IEEE international conference on computational intelligence & communication technology (CICT), 2015, pp 703-8.

Publication Details

Published in : Volume 5 | Issue 2 | March-April 2019
Date of Publication : 2019-04-30
License:  This work is licensed under a Creative Commons Attribution 4.0 International License.
Page(s) : 432-436
Manuscript Number : CSEIT195250
Publisher : Technoscience Academy

ISSN : 2456-3307

Cite This Article :

Saiyam Arora, Abinesh Verma, Richa Vasuja, "An Overview of Apache Pig and Apache Hive", International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT), ISSN : 2456-3307, Volume 5, Issue 2, pp.432-436, March-April-2019. Available at doi : https://doi.org/10.32628/CSEIT195250
Journal URL : http://ijsrcseit.com/CSEIT195250

Article Preview